From Sync APIs to Task-Based Inference: Priority, Standard, Flex, Async, and Batch
The same model can serve a live chat, a 20-minute agent task, and a 100K-sample eval. What should differ is how each call is executed. A guide to Priority, Standard, Flex, Async, and Batch, and how to choose between them.