Have you tried VR at 1080p? I understand your point (one number does not adequately represent "quality of experience") but for VR, 1080p is simply not enough due to the distance to the display (pixels are very visible).
FWIW, I own HP Reverb G2 (2160x2160 per eye - the highest I could find when I got it), and it's still not quite enough. 4K per eye might be what it takes.
1080p: I disagree, that can either be good or bad depending on the content. E.g. original iPhone was only 320x480, but Apple made it feel good.