Quick Start
Welcome to Infron AI — your unified gateway to cutting-edge language, reasoning, and multimodal models. This guide will walk you through setting up your environment, making basic API calls, and exploring advanced features.
Setup your API Key
To begin using Infron AI, you first need to create an account and generate your API Key.
Once you have your API key, set it as an environment variable in your runtime environment. This allows your applications to securely access Infron’s API.
export INFRON_KEY="YOUR_API_KEY"You can verify the variable is set correctly by running:
echo $INFRON_KEYIf it prints your API key, you’re ready to start making requests.
Submit a demo request
You can interact with Infron AI through two primary methods: direct API calls or using the OpenAI SDK.
Example with Texts
In the example below, we use the Rerank API endpoint to index the list of documents from most to least relevant to the query "What is the capital of the United States?".
Request
In this example, the documents being passed in are a list of strings:
import requests
import json
url = "https://llm.onerouter.pro/v1/rerank"
headers = {
"Content-Type": "application/json",
"Authorization": f"Bearer {INFRON_KEY}"
}
data = {
"model": "qwen/qwen3-reranker-4b",
"query": "What is the capital of the United States?",
"top_n": 3,
"documents": [
"Carson City is the capital city of the American state of Nevada. At the 2010 United States Census, Carson City had a population of 55,274.",
"The Commonwealth of the Northern Mariana Islands is a group of islands in the Pacific Ocean that are a political division controlled by the United States. Its capital is Saipan.",
"Charlotte Amalie is the capital and largest city of the United States Virgin Islands. It has about 20,000 people. The city is on the island of Saint Thomas.",
"Washington, D.C. (also known as simply Washington or D.C., and officially as the District of Columbia) is the capital of the United States. It is a federal district. The President of the USA and many major national government offices are in the territory. This makes it the political center of the United States of America.",
"Capital punishment has existed in the United States since before the United States was a country. As of 2017, capital punishment is legal in 30 of the 50 states. The federal government (including the United States military) also uses capital punishment.",
]
}
response = requests.post(url, headers=headers, data=json.dumps(data))
print(response.json())Response
{
"id": "26c8ad0bb95011f0a5edda799fbd82e9",
"results": [
{
"index": 3, // "Washington, D.C. (also known as simply Washington or D.C., and officially as the District of Columbia) ..."
"relevance_score": 0.9990564
},
{
"index": 4, // "Capital punishment has existed in the United States since before the United States was a country. As of 2017 ..."
"relevance_score": 0.7516481
},
{
"index": 1, // "The Commonwealth of the Northern Mariana Islands is a group of islands in the Pacific Ocean that are a political division ..."
"relevance_score": 0.08882029
},
{
"index": 0, // "Carson City is the capital city of the American state of Nevada. At the 2010 United States Census, Carson City had a ..."
"relevance_score": 0.058238626
},
{
"index": 2, // ""Charlotte Amalie is the capital and largest city of the United States Virgin Islands. It has about 20,000 people ..."
"relevance_score": 0.019946935
}
]
}Example with Structured Data
If your documents contain structured data, for best performance we recommend formatting them as YAML strings.
Request
import requests
import json
url = "https://llm.onerouter.pro/v1/rerank"
headers = {
"Content-Type": "application/json",
"Authorization": f"Bearer {INFRON_KEY}"
}
data = {
"model": "qwen/qwen3-reranker-4b",
"query": "What is the capital of the United States?",
"top_n": 3,
"documents": [
{
"Title": "Facts about Carson City",
"Content": "Carson City is the capital city of the American state of Nevada. At the 2010 United States Census, Carson City had a population of 55,274.",
},
{
"Title": "The Commonwealth of Northern Mariana Islands",
"Content": "The Commonwealth of the Northern Mariana Islands is a group of islands in the Pacific Ocean that are a political division controlled by the United States. Its capital is Saipan.",
},
{
"Title": "The Capital of United States Virgin Islands",
"Content": "Charlotte Amalie is the capital and largest city of the United States Virgin Islands. It has about 20,000 people. The city is on the island of Saint Thomas.",
},
{
"Title": "Washington D.C.",
"Content": "Washington, D.C. (also known as simply Washington or D.C., and officially as the District of Columbia) is the capital of the United States. It is a federal district. The President of the USA and many major national government offices are in the territory. This makes it the political center of the United States of America.",
},
{
"Title": "Capital Punishment in the US",
"Content": "Capital punishment has existed in the United States since before the United States was a country. As of 2017, capital punishment is legal in 30 of the 50 states. The federal government (including the United States military) also uses capital punishment.",
},
]
}
response = requests.post(url, headers=headers, data=json.dumps(data))
print(response.json())In the documents parameter, we are passing in a list YAML strings, representing the structured data.
Response
{
"id": "26c8ad0bb95011f0a5edda799fbd82e9",
"results": [
{
"index": 3, // "Washington, D.C. (also known as simply Washington or D.C., and officially as the District of Columbia) ..."
"relevance_score": 0.9990564
},
{
"index": 4, // "Capital punishment has existed in the United States since before the United States was a country. As of 2017 ..."
"relevance_score": 0.7516481
},
{
"index": 1, // "The Commonwealth of the Northern Mariana Islands is a group of islands in the Pacific Ocean that are a political division ..."
"relevance_score": 0.08882029
},
{
"index": 0, // "Carson City is the capital city of the American state of Nevada. At the 2010 United States Census, Carson City had a ..."
"relevance_score": 0.058238626
},
{
"index": 2, // ""Charlotte Amalie is the capital and largest city of the United States Virgin Islands. It has about 20,000 people ..."
"relevance_score": 0.019946935
}
]
}