will it be impossible for me to get a fiance visa?

Not at all.
As long as you & your bloke are able to adhere to the requirements of the fiance visa, and satisfy the ECO of the genuine nature of your relationship.