He even blamed it on the Tories