I think a lot of the benefits you (can) get from this you can take with you after you leave the company. I have good friends I still hang out with from my previous work places 1 and 6 years ago.
If it would have been all/mostly virtual interactions, I'm sure things would have been OK, but I don't think it would have resulted in the same level of connection with some of my coworkers.
YMMV, different people form connections differently.