When you say "(Subject) used to work …", you are implying that the subject was habitually doing that action in the past. If you are familiar with European verb tenses, this is one of the imperfect equivalents.
The second (I worked) was definitely done in the past at a particular time. This is the preterite or perfect past tense in other European languages.