If immigration is an order of magnitude higher than natality, it's fair to say it's a relevant factor. I don't think that's shifting blame, only pointing out that without immigration, there might be more homes built than new people born.