On top of feeding crime and straining social services around the country, all those illegal migrants were doing direct damage to affordability for average Americans.