LLM Batch API & Prompt Caching Cost Estimator
NewCompare LLM API costs for standard, batch, and prompt-cached workloads to see how much a batch discount and caching could save on your volume.
| Strategy | Total cost | Saving |
|---|
Claude and OpenAI presets come from Anthropic and OpenAI published pricing (checked October 2026; Anthropic cache figures use the 5-minute cache; OpenAI Batch and Flex are 50% of Standard; OpenAI prompts above 272K input tokens cost 2x input and 1.5x output, which this tool does not model). For other providers choose Custom. Caching assumes the prefix is written once and read on every other request within the cache lifetime; batch and caching discounts may not stack with every provider. Batch jobs are asynchronous.
Frequently Asked Questions
How much does the batch API save?
Providers commonly advertise around 50% off for asynchronous batches; check current pricing.
How does caching reduce cost?
A repeated prompt prefix is billed at a much lower read price after the first write.
Do the discounts stack?
It depends on the provider, so the combined row is labelled accordingly.
Are the presets accurate?
They are approximate examples; enter your model's current prices for exact numbers.
Related Tools
LLM Token Counter
NewEstimate token counts for GPT, Claude, and Llama-style models as you type.
AI Cost Calculator
NewEstimate LLM API costs from input/output token counts across popular models.
Prompt Template Builder
NewBuild reusable AI prompt templates with {{variable}} placeholders and instant preview.