I agree with some that have said, "Actions speak louder than words." I also agree that you need to confront him. "Why do you always try to make me feel bad about myself? Does it make you feel superior? Are you unhappy in our situation? Do you want me to leave?"
Find out the answer to these questions before you make any decisions about whether to stay or leave. Now if he is physically abusive then leave him and do not look back. Anyone who chooses to fix a problem with violence has their own issues that you can not help them with. I believe if he continues to be verbally abusive after you have given him the opportunity to vent why he is acting this way you have no choice but to leave. You have an obligation to yourself to make sure you are respected and treated with dignity. NO ONE has the right to treat you any other way.
If children are involve you have a greater responsibility to make sure they do not grow up thinking it is okay to treat your partner badly. You have a responsibility to make sure they know they have to take up for their right to be treated with dignity and respect and to make sure that they do not allow ANYONE to treat them badly.
I hope this is helpful and that you find resolution.
Peace and Light,
We gain strength, and courage, and confidence by each experience in which we really stop to look fear in the face... we must do that which we think we cannot.