Sorry to be so blunt but your husband is insensitive and spineless. From reading your posts it comes across as though he would put his family before you. If you're already paying the rent on that place try finding somewhere new to live and give him an ultimatum - "Either show me some respect or we're finished."
Be strong & good luck
