Your short visit back to the Phils should not affect your ILR....only long trips like over 3 months.
When your baby has a British passport she will be free to travel with either you or your husband (or both together), and will need no visa for UK of course.
