A huge part of the Holocaust was the forced relocation of Jewish people* to concentration camps, which would have been (rightly) remembered as an inexcusable horror even if the killings in said camps hadn't been as extensive and inhuman.

* and Roma, and Armenians, and others - but that's less salient here.