Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> There is no such thing as an LLM 'session'.

This matches my understanding too, at least how it works with Open AI. To me, that would explain why there's a 20 or 30 question limit for a conversation, because the necessary context that needs to be sent with each request would necessarily grow larger and larger.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: