dont let it get you down' is used when the problem or the issue being faced is quite serious, or sad, or has the potential to really upset you. 'dont worry about it ' can be used in many different situations, from light to heavy, from insignificant to serious. Its more versatile. Neil Young wrote a nice song called 'Dont let it Bring You Down', listen to it on Youtube or Itunes.