See my other comment. I want my doctor/plumber/etc to be able to recall faster, type faster, work better under pressure. If you're better at those things you should get better grades and be paid more.
Also known as, the tu quoque fallacy. Just because politicians in both parties have been doing this for decades doesn't mean that this administration is not especially hypocritical for doing it after whinging so much about free speech and free markets.
I'm finding it extremely hard not to have a cynical perspective on all of this. There's an idea that I've been mapping onto this whole this, which could be called something like effective knowledge. Regular old knowledge is just information, or access to information. Effective knowledge is the integration of all that information into an understanding that can be acted upon. That requires things like time, money, and involves the usual socioeconomic hurdles that have separated people into groups like "laborers" and "knowledge workers". Sure, in theory "anyone" could read textbooks and learn, but only a select few have the time, money, mentors in their lives, and so forth to really do that.
The rise in capability of LLMs over the past year has basically removed a lot of these boundaries for people. Learning, building, and experimenting is a lot easier when you have a capable partner like Claude to help you along the way. Claude doesn't always get everything right, and you have to be a skeptic, but it's a lot better than nothing.
When I see the government restricting access to LLMs (or Anthropic as they were doing with Mythos before the whole Fable debacle), I basically just see the same old pattern of the ruling class moving to protect their advantage by keeping the great masses in ignorance. Broadening access to LLMs (i.e. effective knowledge) would put everyone on a more level playing field. But we can't have that, because politics, nations, the economy, blah blah reasons reasons. Guess utopia will just have to wait a bit longer.
But then again, this feels a lot like cryptography export controls. Those controls are in place, but I doubt anyone really thinks they work or make much of a difference. Software is not like nuclear weapons, and a data center is a much smaller lift than a Uranium enrichment facility. So maybe this is just a temporary roadblock. But let me tell you, I sure am ready for it to feel more like the government is working for (not against) the people.
Kind of highlights how ridiculous their notion of safety is in this case. By this measure, I guess making the model "safe" means making it play dumb and intentionally ignore security bugs that it notices in the code? And what will the eventual legality of this look like? "Yes, your honor, we allege that this AI system that was sold to us willingly and knowingly ignored a critical security vulnerability in our software system, thereby leading us to be hacked and causing our business to fold."
It's exactly the same problem as backdoors in crypto systems. Criminals will find the crypto that isn't broken and use it regardless (or make it for themselves), while the rest of us losers are stuck with the broken version that we're allowed to use.
On this issue of cyber security, it seems better if authorities just start acting like the cat is out of the bag instead of pretending like it isn't. ASI is basically here now, so what are we going to do about it? Let's not bother pretending otherwise.
On another note, I doubt this was anything other than a vindictive administration enacting revenge on a party that refused them. We all know the Trump admin's priorities.
I like to think that the long arc of history bends towards greater access to knowledge and intelligence. I mean, isn't that what we all want? To be collectively less ignorant and more aware of how the world works? But I guess that's not what the US gov wants. Crazy times, truly. The mask is really coming off lately.
I'm not sure what the mechanism is, but I've definitely had Claude refuse to work on sessions that were touched by other models. Some kind of integrity check failure. Resetting the session back to the point before I used the other model fixed the problem.
IIRC Anthropic's API produces cryptographic signatures for thinking blocks. If you try to submit a set of messages that include thinking blocks with missing/invalid signatures, it'll refuse.
They do this to mitigate jailbreak attempts that rely on fabricated message history (e.g. making it look like the model was compliant in previous messages, increasing the likelihood that it'll continue to be compliant in future messages).
reply