I might be wrong, but my understanding is that we're on a decelerating slope of perf/transistor and have been for quite a while - I just looked up the OpenCL benchmark results of the 1080 Ti vs 4090, and the perf/W went up by 2.8x despite going from 16nm to 5nm, with perfect power scaling, we would've seen a more than 10x increase.
Probably not. There will be better GPUs. It's like we did use all those Kepler K10 and K80 fifteen or so years ago, they were Ok for models with few millions of parameters, then Pascal and Volta arrived ten years ago with massive speed up and larger memory, allowing to train same size models 2-4 times faster, so you simply had to replace all Keplers. Then Turing happened making all P100 and V100 obsolete. Then A100, and now H100. Next L100 or whatever with just more on-board memory will make H100 obsolete quickly.
One thing that is missing is that we have massively improved the performance of the algorithms lately to require less compute power, so a H100 will still be performant several years from now. The problem will be that it's going to be using up more power and physical space than an out-performing future version and so will need to be scrapped.
The closest I have come is a copy of a museum exhibition catalog about Dieter Rams from 1981 that is signed by him. I bought it online. The copy was described as having a scribble on the front page and priced very low as a consequence. Years after, I saw Dieter’s signature somewhere and realized that my book was signed.
I got a copy of a David Attenborough signed book in a similar way. It was a used book about wild flowers with an introduction by Attenborough bought very cheap about 100 INR in a used book store in Mumbai. Only later while looking at the book I realised it was an autographed copy.
I use a single 40" 4k display at 1x. This allows me to fluidly switch between different layouts like one huge canvas when doing design or multiple windows when coding, writing, etc.
I used multiple monitors in the past, but the seams between displays was a hinderance when spanning a single window across.
My first visit to Japan, there were still places that would only accept a subset of IC cards and not all.