I agree with what the others have said, especially that they don't really seem to be treating you seriously. Also what your brother-in-law said to you was quite hurtful and especially so considering that they are living with you. Did you say to your husband what he said to you? If you have or do and he doesn't say much or stand up for you, then he doesn't sound much of a good husband! Also strange is that your brother-in-law said that his gf fancies your husband! If I was him and I did think that, then I would not be wanting to live there anymore, unless he is saying that to try and wind you up?

Like Jonathan says, do you have anyone close that you can talk to about it all (preferably someone who lives near to you or at least in UK as they will understand how things/people are in UK more)?

A big hug to you!