nvidia/Nemotron-120B-A12B:
Everything you need to know about the model

nvidia/Nemotron-120B-A12B is a NVIDIA model available through Merge Gateway via Baseten. Use it with Gateway routing policies, spend controls, request logs, and a 203,000 token context window. It supports streaming through at least one Gateway vendor route.

nvidia/Nemotron-120B-A12B pricing

| Vendor | Input / 1M tokens | Output / 1M tokens | Zero data retention | | --- | ---: | ---: | --- | | Baseten | $0.3000 | $0.7500 | Yes |

Test nvidia/Nemotron-120B-A12B with Merge Gateway’s Simulator

nvidia/Nemotron-120B-A12B
Synced
Synced
Run simulation to see response

Ready to try it out?

Start routing requests to hundreds of large language models in your product within minutes.

Route requests to nvidia/Nemotron-120B-A12B with Merge Gateway

Merge Gateway is a unified LLM API that lets your product route requests to nvidia/Nemotron-120B-A12B and every other major model through a single endpoint. You get built-in fallback routing, per-request cost tracking, zero data retention support, and observability without changing your application architecture.
To get started in seconds, add our Gateway Implementation skill to your project, or pick your preferred SDK below. Check out our other quick start skills here.
Install the Merge Gateway SDK
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11
Make your first API call
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11
Try a diffrent model
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11
Install the Merge Gateway SDK
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11
Make your first API call
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11
Try a diffrent model
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11
Install the Merge Gateway SDK
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11
Make your first API call
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11
Try a diffrent model
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11
Install the Merge Gateway SDK
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11
Make your first API call
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11
Try a diffrent model
Python
1{
2  "mcpServers": {
3    "agent-handler": {
4      "url": "https://ah-api-develop.merge.dev/api/v1/tool-packs/{TOOL_PACK_ID}/registered-users/{REGISTERED_USER_ID}/mcp",
5      "headers": {
6        "Authorization": "Bearer yMt*****"
7      }
8    }
9  }
10}
11

Explore other models available in Merge Gateway

model logo
Llama 3.2 11B
model logo
Llama 3.2 1B
model logo
Llama 3.2 90B
model logo
Llama 33 70B Fp8
model logo
Llama 3 8B
model logo
Llama 4 Maverick 17B
model logo
Llama 4 Maverick Instruct Fp8
model logo
Llama 4 Scout 17B
model logo
Magistral Medium 2509
model logo
Magistral Medium Latest
model logo
Magistral Small Latest
model logo
Meta.Llama3 70B Instruct V1:0
model logo
meta-llama/Llama-3.3-70B-Instruct
model logo
meta-llama/Llama-3.3-70B-Instruct-Turbo
model logo
meta-llama/Llama-4-Maverick-17B-128E-Instruct
model logo
MiniMaxAI/MiniMax-M2.5
model logo
MiniMax M2
model logo
MiniMax M2.1
model logo
Minimax M25
model logo
MiniMax M2.5 Highspeed
model logo
MiniMax M2.7
model logo
MiniMax M2.7 Highspeed
model logo
Ministral 8B 2512
model logo
Mistral Large

nvidia/Nemotron-120B-A12B FAQ

In case you have any more questions on using nvidia/Nemotron-120B-A12B, we’ve addressed several below.

Heading

What provider owns nvidia/Nemotron-120B-A12B?

nvidia/Nemotron-120B-A12B is a NVIDIA model.

Which vendors can run nvidia/Nemotron-120B-A12B?

Baseten is the default listed vendor, and other active vendors may also be available.

What context window does nvidia/Nemotron-120B-A12B support?

nvidia/Nemotron-120B-A12B supports 203,000 tokens on the primary listed vendor route.

What capabilities does nvidia/Nemotron-120B-A12B support?

Gateway currently lists streaming support for nvidia/Nemotron-120B-A12B across its available vendor routes.

Try nvidia/Nemotron-120B-A12B through Merge Gateway

Route, observe, and control AI requests across providers from one API.