child benefits cant be claimed jointly only the person who is responsible for the child can claim it.

purple did you fill in a child benefit form ? if so did you put that you were subject to immigration control ?

in your letter have you mentioned what the nurse/midwife told you.

if it is a genuine mistake then you might have to pay back the child benefit