The model weights are MIT licensed.

Welcome to the club. If you're _really_ competitive in cs2, I'd swap out to a 9800x3d setup, but it's still a maybe. Very little reason to upgrade right now other than to run LLMs.

It will never make sense to me to run Llms locally unless I had 50k. I don't even think that would compete with price perf of a remote llm and getting business done. And that's completely ignoring that sol/fable level is not local

Yeah, instead I have unsubbed from WoW this week. The atrocious state of the game's code and scripting is unbearable.

You need latency for token parallelism, not bandwidth. Hence actual RDMA that bypasses the software TCP stack (ROCe or whatever).

You just need social stigma on bad tires. It's the single most important thing on your vehicle, for literally all the reasons out there.

Right after we have a social stigma for people that keep voting to have the government involved in every bit of their lives.

How about when the market fails customers, still no government involvement? Food and drugs regulation, environment stuff (you are here) and so on?

The US military-industrial complex is the single largest institutional hydrocarbon consumer and greenhouse gas emitter on the planet. It would be pretty stupid for me to listen to the government's advice about how best we should preserve the environment.

So the issue is under regulation, yeah, agree on that point.

Sounds like the only reasonable solution to the problem you raise is that the part of our government that's responsible for defense should be put under the seperate part that is responsible for protecting our environment instead of being exempt. I can't see any other real way of resolving that issue can you?

Because government self regulation totally works and the resources used up and the size of the government has not grown by such magnitudes that would make the founding fathers rethink the whole idea of democracy?

Ok, so no particular disagreement or pragmatic pitched alternative, great! I agree, structurally improved government and regulations is the only definable way forward for me too.

China has been the largest ghg emitter for the last 20 years, and currently emits more than twice as much as the us. Gdp spent on defense is similar as a fraction of gdp (slightly more in the us). So realistically the Chinese military is by far a larger emitter of ghg than the us military.

We can’t successfully shame each other to avoid Hot Pockets and big brands of cereal that acutely poison our kids.

You think people are going to tread-peek?!

I agree with you, but we’re both going to be disappointed.

I've tried social stigma on lack-of-using-turn-signals, and have been about as disappointed as you are likely to be hah.

I literally had Fable tell me that I've checked out a nonexistent upstream commit of LMDB - two days ago. Sol called its BS, of course.

I mean, a big RAG setup with a smart LLM ought to do it, right? Or even just locally provided knowledge database - given the size of LLMs, what's a clone of wikipedia and whatever else you'd need?

Never been easier to make one.

Poolside's stuff (US) is pretty good.

You don't have to. Chatgpt-sol-high already does that for me. Could be the extra instructions or the base system prompt or whatever, point is - it already does it.

The MI350p exists and should run a decent quant (say, the ~96GB antirez mix) well, but you can get two rtx pro 6000s for one of these, or 8x (actually more) r9700 + probably the gear to run them, etc.

Otherwise, you can probably buy one of these second hand from somewhere (SXM A100s are available that way) and run it in an adapter board.

I thought MI350P wasn't available yet, curious where to source it right now.

There's at least one systems integrator selling a rack server with 2x MI350Ps.

I haven't seen the cards all by themselves yet.