Unfortunately that seems about right. As you are living there and you are not entitled to any benefits at the very least the council tax is going to be 75% of the full value.
Also council tax is one thing they seem to check when you apply for ILR. I've seen cases of people being called in for interviews when applying for ILR because for example the British spouse forgot to notify the council that they were no longer entitled to the single person discount.
