Well, you're taking it at face value. :) Other LOST fans have commented on what Charlie said, and it turns out later that Charlie is an experienced swimmer after all.
So, it's kind of a half-lie. "I don't swim" is a conscious choice not to swim, but if he said "I can't swim" he would be lying completely. Given the situation at that moment, people may assume "I don't swim" means "I can't swim", but Charlie didn't say "can't"... see? :)