If you're concerned about the reaction of the refugees to the locals then house the refugees where they won't interact with too many of the locals, especially kids.
Playing Cluedo with my mum while I was at Uni:
"You did WHAT? With WHO? WHERE???"