Hello Nydia,
In this context the person seems to mean it that " you are modest", because obviously he notices that your English not 'so so' as you say.
So in this case you either tell the person concretely why you think your English is only 'so so' ,for example by pointing out that your spoken English is not as good as your written and that is what you have to improve.You could say:
You should hear me speaking , it is not really that good ".