NVIDIA: Llama 3.1 Nemotron 70B Instruct

nvidia/llama-3.1-nemotron-70b-instruct

NVIDIA's Llama 3.1 Nemotron 70B is a language model designed for generating precise and useful responses. Leveraging Llama 3.1 70B architecture and Reinforcement Learning from Human Feedback (RLHF), it excels in automatic alignment benchmarks. This model is tailored for applications requiring high accuracy in helpfulness and response generation, suitable for diverse user queries across multiple domains.

Model specifications

Input
text
Output
text
Context
131,072 tokens
Max output
16,400 tokens
Input price
.2 / 1M tokens
Output price
.2 / 1M tokens
Released
2026-03-19

Capabilities

  • Streaming
  • Function calling
  • Vision
  • JSON mode
  • Playground

Provider pricing, discounts and data privacy

Compare effective provider prices, published discounts, regions, retention policies, training use, compliance, and privacy links by service tier.

Standard service tier

1 available provider · tier input average .2 / 1M tokens · tier output average .2 / 1M tokens

DeepInfra

Tier: Standard · Region: US · Quantization: fp8

Pricing
Input
.2 / 1M tokens
Output
.2 / 1M tokens

No provider discount is currently published.

Data privacy and compliance
Region
US
Zero data retention
Yes
Data retention
Zero retention
Used for training
No
Data collection
Moderated
No
GDPR compliant
Yes
HIPAA compliant
No
SOC 2 certified
Yes
BYOK supported
Yes

Privacy policy · Terms · Official website · Documentation · Status · Support

Frequently asked questions

What is NVIDIA: Llama 3.1 Nemotron 70B Instruct?
NVIDIA's Llama 3.1 Nemotron 70B is a language model designed for generating precise and useful responses. Leveraging Llama 3.1 70B architecture and Reinforcement Learning from Human Feedback (RLHF), it excels in automatic alignment benchmarks. This model is tailored for applications requiring high accuracy in helpfulness and response generation, suitable for diverse user queries across multiple domains.
How much does NVIDIA: Llama 3.1 Nemotron 70B Instruct cost?
Input costs start at .2 / 1M tokens and output costs start at .2 / 1M tokens. Provider-level prices vary by service tier.
What is the context length of NVIDIA: Llama 3.1 Nemotron 70B Instruct?
NVIDIA: Llama 3.1 Nemotron 70B Instruct supports a 131,072 token context window and up to 16,400 output tokens.
What capabilities does NVIDIA: Llama 3.1 Nemotron 70B Instruct support?
NVIDIA: Llama 3.1 Nemotron 70B Instruct supports Streaming, Function calling, Vision, JSON mode, Playground.
Which providers offer NVIDIA: Llama 3.1 Nemotron 70B Instruct?
NVIDIA: Llama 3.1 Nemotron 70B Instruct is available from DeepInfra.
How do providers handle data privacy for NVIDIA: Llama 3.1 Nemotron 70B Instruct?
1 of 1 providers report that customer data is not used for training, and 1 offer zero-data-retention routing. Retention, compliance, and privacy-policy links are listed per provider.

Browse all AI models