There are a couple of things I would suggest to improve it.
I would use 'made from' instead of 'made of'. I can't really explain why, but to me it sounds better to use 'made from' in this instance.
I would also say 'can cause allergies.' The way it is written it sounds like artificial fibres always cause allergies, which isn't the case. And as you may have just noticed fiber is the American spelling.
Avoid wearing clothes made from artificial fibres, they can cause allergies.