Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

"tool call" is just a reference to any elementary interaction with the outside system. It's not calling third-party APIs or anything like that.


True, but that's still 1,500 inference cycles. Even without external API fees, the latency and compute burden seems huge. I don't see how the economics work there without significant subsidies.


FWIW many tool calls can be and often are made in one inference cycle.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: