So sorry to hear of this my dear
Is difficult to suggest anything to you, not knowing you guys personally!
If he is abusive towards you, and I hope not, then you have other options open to you!
I assume that you are married, and live in the UK?
Do you have you ILR yet??
I am not suggesting anything at this stage, but if he is being rude to you telling you to Pi** of, then after you get your leave to remain( maybe you already have it) then you can tell him likewise.
I got hurt pretty bad recently also, and NEVER did anything like this to my ex.
Whatever happens in life I wish you all the very best, and as other members have said here, keep you head up, and stick up for yourself, and don't let anyone bully you!!