If you're exercising your treaty rights, you have virtually a legal right to bring your partner to the EU country you're in.
The only major reasons they could refuse the visa for, is if they believe it's a marriage of convenience, or you were not exercising your treaty rights