That would be a massive improvement. “I don’t know, maybe these other smarter more expensive models with more recent training data might… here are some questions you could ask them:…”
Simply those first three words out of an LLM would be a massive improvement: "I don't know". "I am not sure". "My confidence in the following answer is low due to a lack of reliable information in my training and online sources ..."
If you haven't gotten a refusal from AI yet to answer a question, I guess you haven't annoyed it enough. Claude very much threatens to stop conversing on re-hashed topics with repeated arguments within a thread lol.
AI passed the Turing Test empirically long ago. Further and more practically, they consistently convince millions of people that they are a real person with real intentions all the time, every day.
They are so convincing that an emergent property of the Turing Test is also being shown: that real humans are called bots by people that genuinely believe the other is a bot.
The standard 3-person Turing test with 2 people talking and a third observing and trying to decide which is a computer, if any, has been summarily defeated.
So many people I know believe that AI has already passed the Turing test. What's weird is that a lot of them are managers and should understand that never getting an "I don't know" means something ain't right.
I remember reading a news article over a decade ago (maybe even two) about people testing their bots on dating sites and how they have to occasionally break the hearts of people who fell for their bot.
When I run the Turing test, it's me testing the computer. I don't care if anyone else isn't able to discriminate. Of course there is no "standard Turing test" as that would imply that it's an some kind of bot testing another AI and obviously that fraud with issues.
The Turing test is a human testing the computer and that human is me.