I run 3bit GLM5.2 and full precision Qwen3.6-27B. GLM is much much closer to frontier models in it's breadth and ability to plan. If you just need to implement Python code from an existing plan Qwen is your choice but it has problem succeeding with more complex tasks that GLM5.2 does not.

As I type this my local GLM5.2 is troubleshooting bugs that Qwen would not be able to handle.

Not sure how much of your GLM is offloaded to CPU. I was contending the suggestion of using system RAM + VRAM.

On a model of this size quantization has much less impact on quality of output. I'm running a 3bit version and find it comparable to sonnet, almost opus.

No. Unsloth has CPU offloading. It'll be slow but it'll work even with SSD offloading.

I have a friend who may be dying. It's not cancer but equally dangerous. They caught it early but they're powerless to do anything. We're just watching, waiting, and hoping.

vLLM supports "banning" certain tokens but I don't know if it can dynamically reduce them.

To my knowledge you can also "ban" with llama.cpp but it is passed in the API call rather than to the server at initialization.

It's remarkable how capable GLM 5.1 is, what's amazing is the recent development of Qwen 3.6 27B being close in real world performance.

Can you back that up with.... you know... evidence? "regulation bad" tends to be a political talking point more than a valid argument when you're this vague.

Edited: to add, this speech talks a lot about the reduction in research funding from the US government which arguably has nothing to do with the regulatory environment.

You should be able to open up shop as a doctor or lawyer or engineer without any degree (!) in a free market, or spin up a school if you want

We are so very far from any of that, that people think it's merely funding or AI or immigration causing this current issue (maybe immediately but not on the long term trend if you see older articles on a "college bubble" maybe a decade ago), where it is decades of over-regulation of these industries preventing any competitive alternative to them

So you get less and less quality options that cost more

Evidence of this would be in contrast, something like computer hardware that keeps improving and getting cheaper, relatively speaking

This is a weird take. I get the desire to house people but someone choosing to rent rather than sell a home they own is not the crux of the issue. When there are corporations keeping swaths of housing empty to raise rent rates the real issue is market manipulation not small participants.

it's def not the crux of the issue, never said that. it's a dynamic of the market though

> When there are corporations keeping swaths of housing empty to raise rent rates the real issue is market manipulation not small participants.

curious where this is happening? would love to learn about that.

Thank you for this comment, there is no way I could eloquently explain my read on the comment you're replying to the way you did.

Have you had to file a claim with them yet? I go with State Farm not because I can get a cheaper rate but because for their price they provide all of the services I expect from my insurance company when I need them.

[1] https://www.reddit.com/r/Insurance/comments/1kji0bm/just_fil...

Second this, after one incident (at fault) and having to pay nothing for the other persons $4k bill (no hassle, no deductible), SF is a good choice and paid itself back