"Alway" is incorrect, except in some poetry. Always use "always". Depending on context, I think your sentence should say "I threw it a long time ago."

Always use always. But you can say all the way as in (all the way home )