Optimize costs with the Batch API, prompt caching, evals, rate limits, and the Moderation API. Part of the free OpenAI Academy — every lesson below is open to everyone, no signup required.
50% Cost Savings for Async Work The Batch API lets you submit large batches of requests asynchronously. In exchange for flexible completion times (up...
Automatic Prompt Caching The Responses API automatically caches repeated prompt prefixes. If your requests share a long system prompt or common contex...
Evaluating AI Quality Evals are automated tests that measure your AI system's quality. OpenAI provides an evaluation framework for testing model outpu...