You can still have your child registered at the Embassy as long as you and your wife can supply the required documents. You don't need to be there, far as I'm aware. Then he won't need a visa ...he'll have a British passport, and you'll only need to show ability to support your partner.
Go for it !
