Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This has not been my experience. Generally I do pin to 1 provider, or 1 provider with a couple fallbacks (especially with deepseek - most providers are 10x the cached token price compared to deepseek themselves), but even when I don't I still usually see 99%+ cache hit percentage. Specifically using pi with various ad-hoc customisations (that I was careful not to break prompt caching with).
 help



then what is the point of using operouter for this model? Just use the deepseek API and save the 5% fee on top of the better caching rate.

Because they don’t want to sign up for 10 different providers and subscriptions/etc, especially if some models are just going to receive light, or rare usage?



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: