This is probably a semantic issue seeing as we don't have a widely agreed definition of it.
I like to think about it in terms of self-reflective, subjective experience.
I'm not even sure if emotions would be a requirement and was surprised to see Chiang so hung up on them. Would he consider humans which can have a variety of mental disorders, causing a complete lack of some of them to not poses consciousness?
To the best of my knowledge, there is not an agreed and actionable definition of consciousness, and any attempt to make one comfortably fails to cleanly divide humans from machines.
It's more of a vibey term, and as such it is genuinely very difficult (perhaps impossible even) to concretely determine whether an LLM possesses consciousness. LLMs successfully express a lot of consciousness-like traits.
At some point you have to ask the question: does it even matter? If an LLM can sufficiently mimic consciousness, isn't that sufficient for us to treat it as conscious, even if it is in-fact not conscious (especially because we don't actually know)?
As I've mentioned somewhere else already and you pointed out; the issue is that consciousness is a loose term and and it's a semantical issue that should be resolved first.
It won't be, because the murkiness is beneficial to the corpus, amongst other things.
And to your point about the appearance of "consciousness" being enough imho Chiang explains fairly well why it's not.
The same thing jumped at me immediately. He should have prefaced this with his definition of consciousness.
Moreover the embodiment of LLMs is already happening via robotics, and virtually.
Then there's the common counter "but humans are a next word prediction machines too.." (ofc we're more than this, but linguistically we are, and that's the field from which LLMs originate) which is rarely addressed.
Hypothetically (and in reality, this is not too far off), if a AI is trained via RL by driving a robotic body, is there a point in time after enough is learned that the AI model becomes "conscious"?
Yup, people tend to focus on the upgradability aspect and totally miss the repairability one.
My own story is as follows: my panther had an ASUS laptop and extrapolating from previous experiences expected the laptop to function on AC when the battery dies. NO SUCH LUCK! Since it's a hybrid usb-c powered hardware it needed a battery to power up. The process of replacement was so tedious and expensive that we decided to buy the Framework instead. Fool me once...
reply