With regard to child benefit, I don't think that is seen as "Public Funds". Child Benefit is paid for every child in the UK regardless of the immigration status of the childs mother, so your wife should make claim ASAP. When it comes to child tax credit, it's OK because you are the one who will be claiming it not your wife, although your wifes details will also have to be on the form.
Iain.