Yes, it's extreme and crazy seeing other Europeans living in the UK can claim benefits for their kids back home in their European country.
But rules are rules, if they allow them to stay, what about the next people who break immigration rules, where do you draw a line if you allow them to stay?
Maybe they should change the immigration rules, so depending on the offence you're given a warning not to break immigration rules again or you could be deported.