> rather than agents that can live, feel, think and will, which would require a different term, like "soul"
You're just substituting one ill-defined, and overloaded, word ("consciousness") with a bunch of others ("live", "feel", etc), and asserting that to you they mean something different.
It's impossible to have a discussion on this basis, and I'm sure to many people "soul" is exactly what they mean by "consciousness", or at least part of it. It's no less reasonable that an AI has a soul as that it is conscious - it depends on exactly what you define those words to mean.
People have made due with conceptual fuzziness, I think it's disingenuous to suggest that discussion is impossible without absolute conceptual clarity. All you are saying is that using these terms does not allow you to have a specific kind of discussion - which, a lot of the time, is one that reduces humans to mathematical objects that perform computations.
Yet, if that is your goal and the definition of "soul" or "consciousness" are entirely arbitrary decisions that you don't care about - then it's worth remembering the adage "you may not care about politics, but politics cares about you".
Yes, but as noted elsewhere in this thread it's a matter of degree. Consciousness is such an ill-defined and overloaded word that it's hard to say it really means anything - it's more of an all-encompassing term for a bunch of largely subjective phenomena.
I don't disagree - for a long while I believed that the study of "consciousness" was the result of a linguistic mixup and best dealt w/ via Wittgenstein.
However, if you move past surface appearances, you can think about what kind of cultural "work" is being done spending effort on this mixup. What's happening is that, in the noosphere, the cloud of concepts around "consciousness" is battling it out with the cloud of concepts around "soul" over which cloud of concepts best describes what it means to be human, with big implications on what it means to be good person. Now we're dealing with a mix of Aquinas and Latour.
You're just substituting one ill-defined, and overloaded, word ("consciousness") with a bunch of others ("live", "feel", etc), and asserting that to you they mean something different.
It's impossible to have a discussion on this basis, and I'm sure to many people "soul" is exactly what they mean by "consciousness", or at least part of it. It's no less reasonable that an AI has a soul as that it is conscious - it depends on exactly what you define those words to mean.