Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The only other pricing data available suggests its the context cache that's eating usage. If you have a big context on a 5 min cache (default) you're essentially sending the whole context every time you take a break from the api. You can configure 1 hr TTL which should help if you run long heavy sessions like me. That's been my theory lately. Still need to get my company admin to let me test lol.


Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: