How Infron gives you control over your data
Zero Data Retention (ZDR) means that a provider will not store your data for any period of time.
Infron allows you to route to endpoints that have a Zero Data Retention policy.
Providers that do not retain your data are also unable to train on your data. However we do have some endpoints & providers who do not train on your data but do retain it (e.g. to scan for abuse or for legal reasons). Infron gives you controls over both of these policies.
Infron works with providers to understand each of their data policies and structures the policy data in a way that gives you control over which providers you want to route to.
Note that a provider’s general policy may differ from the specific policy for a given endpoint. Infron keeps track of the specific policy for each endpoint, works with providers to keep these policies up to date, and in some cases creates special agreements with providers to ensure data retention or training policies that are more privacy-focused than their default policies.
If Infron is not able to establish or ascertain a clear policy for a provider or endpoint, we take a conservative stance and assume that the endpoint both retains and trains on data and mark it as such.
You can enforce Zero Data Retention on a per-request basis using the zdr parameter in your API calls.
Include the zdr parameter in your provider preferences:
{
"model": "gpt-4",
"messages": [...],
"provider": {
"zdr": true
}
}When zdr is set to true, the request will only be routed to endpoints that have a Zero Data Retention policy.
Some endpoints/models provide implicit caching of prompts. This keeps repeated prompt data in an in-memory cache in the provider’s datacenter, so that the repeated part of the prompt does not need to be re-processed. This can lead to considerable cost savings.
Infron has taken the stance that in-memory caching of prompts is not considered “retaining” data, and we therefore allow endpoints/models with implicit caching to be hit when a ZDR routing policy is in effect.
Infron itself has a ZDR policy; your prompts are not retained.
Last updated