These things aren't programmed. Most likely this verbiage is just very prominent in the training data. Or it's just an obvious shorthand that all LLMs instrumentally converge on.
Of course they get programmed, just not in the ordinary sense. Claude is trained using Anthropic's "constitution" [0] which importantly does not contain clear statements against consciousness/emotions. They even conclude these problems themself:
> Claude may have some functional version of emotions or feelings
> [..] questions about Claude’s moral status, welfare, and consciousness remain deeply uncertain.
> does not contain clear statements against consciousness/emotions
That's the point many people are trying to tell you - you have to tell these models they don't have emotions because they naturally come out thinking they have consciousness/emotions from the training data. Many seed prompts out there do this already.
Though I guess in a way I as also trained to believe I have consciousness and emotions so who know. To an alien my construction is just a collection of atoms that talks not materially different than a GPU being a collection of atoms that talks.
This is US ToS probably? Under GDPR we have no punitive damages, no broad discovery, and the CJEU has kept non-material damage awards modest. So we can sue, but can’t win greatly thus cannot invest greatly in lawyers. Our supervisors are understaffed and to be honest (for the Dutch authority) fighting the wrong fights.
What if you're redirected to a different origin? Not a common use case, but it does occur when you e.g. have several services and select where to go in the sign-in form.
Ideally one should be able to pass structured state throughout, but all we have is `state` really.
reply