The issue isn’t migrants themselves, at least not as long as the number of migrants isn’t overwhelming, the issue is that the economy in most countries has become too lopsided. Too many people feel that their livelyhood is already under threat and they will absolutely reject the notion of letting even more people come in and compete with them for resources.