Hi Min and welcome to our forum
I tend to agree with Graham and would like to suggest you copy and paste your post and send it to your partner to let him know exactly how you feel.
My wife and I have had to cope with a refusal and I know how difficult and stressful this can be. I just think he's not handling it to well and taking it out on you. He probably needs to join a forum like this so he will be able to meet others who are or have been in similar situations to you. The most important thing surely is to take what ever action is needed to make an appeal or another application successful.
But I think you should really let him know how he is making you feel and that this is not good for your relationship.
I wish you well.