OpenAI API adds Prompt Caching with automatic discounts for recently seen inputs
Original title:Prompt Caching in the API
AI summary
OpenAI introduced Prompt Caching in its API, automatically offering discounts on input content the model has recently seen. The feature is aimed at API users and lowers input costs for requests with repeated prefixes.
Key Takeaways
- OpenAI introduced Prompt Caching in its API
- automatically offering discounts on input content the model has recently seen.
- The feature is aimed at API users and lowers input costs for requests with repeated prefixes.
Quick Facts
- Published
- Updated
- Source
- OpenAI:官网动态(RSS · 排除企业/客户案例)
- Category
- Products & Apps
- AI score
- 67
Related entities
Source & copyright
This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.
How to Cite
When citing this article, keep the title, date, and permalink, and credit Orange News as the source.
Orange News: OpenAI API adds Prompt Caching with automatic discounts for recently seen inputs. October 1, 2024. https://new.nat6.net/en/news/atkkyiqugv25any27ecorza9i/