Oh Ate Nids I never expect to hear this bad news from you!..
I think you're both stressed with your visa.. Get some rest the both of you and be patient of waiting till the visa is ready..
To fight is normal but don't ever let him give up on you.. As you've said you never done nothing wrong which will upset him so why will he do that?.. Best not to pester him about your visa coz maybe that's the reason why he told you that his gonna cancel it.. I already told you that it will come in God's perfect time.. I waited more than what you waited right now but my husband and I never ever give up...
To give up is the hardest part we can't ever do.
Anyway I wish you luck and may you find peace and I pray you and your husband will be fine the next day and please try to fix the problem so in the end you will both be happy.
GOD BLESS YOU!