search

Prompt caching

hashtag
Manual caching

For fine-grained control, you can manually mark content with cache_control:

Prompt Cachingchevron-right
PreviousReasoning configurationNextEmbeddings

Last updated