Yes, 'push' is the neutral, general term, while 'shove' is more specific.
'Shove' (which rhymes with 'love', pronounced with an 'u' sound) is both a verb and noun. A shove is a quick, rough and careless movement.
'Shove' can also simply mean 'put'.
For example:
'What should I do with the dishes?'
'Oh, just shove them in the sink. We can wash them later'.