Not all of it - the UKBA receives some funding from the visa fees. The jusification for the increased cost in visas in recent years has been to pay for the increased cost of securing the UK borders.
Admittedly some of the visas are paid for by the British spouse (a UK taxpayer..) so technically in some cases it is really a tax on marrying a non-EU citizen.