That is a very good question! I'm not sure I can fully explain the difference but I would say that 'closet' and 'cabinet' are words more commonly used by Americans. In the UK we use the word 'cupboard' (storing CUPS, plates, bowls etc.) When the Americans use the word 'closet' we use the word 'wardrobe' and this is where we keep our clothes.
Hope this helps!