> Although I want to believe this problem is more exacerbated with LLMs than with human-tutors.
Well, yeah, but the central insight here is that LLMs enable a worse-is-better approach with a tighter feedback loop. They're not as good as a regular tutor, but a regular tutor costs money, gets impatient, is only available at set hours, etc.
Part of the appeal of learning-by-LLM is that you can get a flash of motivation at 2 AM and go "hey, I should totally learn about X, that would be cool!", open up ChatGPT, ask some very naive questions, and get just enough to get started.
(It's funny, when I wrote this yesterday I thought "this is an unrealistic example", and yet here I am, at 1 AM, asking ChatGPT a bunch of questions about Google's XLS. I'm pretty sure the answers I got were hallucinations, but at least it helped me formulate the questions for when I go to the mailing list.)
I have no evidence other than hundreds of hours using ChatGPT.