Route requests to
Mistral NeMo
with Merge Gateway

Apply your own routing policies, reduce token costs automatically, and see every routing decision in real time with Merge Gateway.

What Mistral NeMo costs to run

| Vendor | Input / 1M tokens | Output / 1M tokens | Zero data retention | | --- | ---: | ---: | --- | | Mistral | $0.3000 | $0.3000 | No |

Test Mistral NeMo
with Gateway’s Simulator

See a prompt's output, token spend, latency, and more with Mistral NeMo.

Route requests to Mistral NeMo in minutes

To get started in seconds, add our Gateway Implementation skill to your project, or pick your preferred SDK below. Check out our other quick start skills here.
Install the Merge Gateway SDK
Python
Copied!
1$ pip install merge-gateway-sdk
Send a request
Python
Copied!
1from merge_gateway import MergeGateway
2
3client = MergeGateway(api_key="YOUR_API_KEY")
4
5response = client.responses.create(
6    model="openai/gpt-5.2",
7    input=[
8        {"type": "message", "role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
9        {"type": "message", "role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
10    ],
11)
12
13print(response.output[0].content[0].text)
Try a diffrent model
Swap the model string to route to a different provider. No other code changes needed.
Anthropic
Copied!
1response = client.responses.create(
2    model="anthropic/claude-sonnet-4-20250514",
3    input=[
4        {"type": "message", "role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
5        {"type": "message", "role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
6    ],
7)
Point to Gateway
Python
Copied!
1from openai import OpenAI
2
3client = OpenAI(
4    api_key="YOUR_API_KEY",
5    base_url="https://api-gateway.merge.dev/v1/openai",
6)
Send a request
Use the standard chat.completions.create method. No provider prefix needed on the model name.
Python
Copied!
1response = client.chat.completions.create(
2    model="gpt-5.2",
3    messages=[
4        {"role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
5        {"role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
6    ],
7)
8
9print(response.choices[0].message.content)
Install packages
Copied!
1npm install merge-gateway-ai-sdk-provider ai
Create the provider
TypeScript
Copied!
1import { createMergeGateway } from "merge-gateway-ai-sdk-provider";
2
3const gateway = createMergeGateway({
4  apiKey: "YOUR_API_KEY",
5});
Send a request
Use generateText to send a request. Model names use the provider/model format.
TypeScript
Copied!
1import { generateText } from "ai";
2
3const { text } = await generateText({
4  model: gateway("openai/gpt-4o"),
5  prompt: "Explain the concept of recursion in programming with a simple set of examples.",
6});
7
8console.log(text);
If you already have @ai-sdk/openai installed, point it at Gateway with a base URL change:
TypeScript
Copied!
1import { createOpenAI } from "@ai-sdk/openai";
2
3const gateway = createOpenAI({
4  apiKey: "YOUR_API_KEY",
5  baseURL: "https://api-gateway.merge.dev/v1/ai-sdk",
6});
7
8// All generateText/streamText calls work unchanged
Install the Merge Gateway SDK
Anthropic SDK
Copied!
1from anthropic import Anthropic
2
3client = Anthropic(
4    api_key="YOUR_API_KEY",
5    base_url="https://api-gateway.merge.dev/v1/anthropic",
6)
7
8message = client.messages.create(
9    model="claude-sonnet-4-20250514",
10    max_tokens=1024,
11    messages=[
12        {"role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
13    ],
14)
15
16print(message.content[0].text)

Explore other models available in Merge Gateway

model logo
Amazon Nova 2 Lite
model logo
Amazon Nova 2 Sonic
model logo
Amazon Nova Lite
model logo
Amazon Nova Micro
model logo
Amazon Nova Premier
model logo
Amazon Nova Pro
model logo
Claude 3.7 Sonnet
model logo
Claude Haiku 4.5 (20251001)
model logo
Claude Opus 4.6
model logo
Claude Opus 4.7
model logo
Claude Opus 4.8
model logo
Claude Sonnet 4.5
model logo
Claude Sonnet 4.6
model logo
Claude Sonnet 5
model logo
Codestral
model logo
Codestral 25.08
model logo
Command R 08-2024
model logo
Command R+ 08-2024
model logo
Command R7B 12-2024
model logo
DeepSeek R1
model logo
DeepSeek V3
model logo
DeepSeek V3.2
model logo
DeepSeek V4 Flash
model logo
DeepSeek V4 Pro

Mistral NeMo FAQ

Have more questions about Mistral Nemo? We've answered a few more below. Please note that this was written in June, 2026 and is subject to change.

Heading

What other models does Mistral AI offer?

Mistral AI offers a catalog that spans multilingual open-source models, reasoning flagships, and specialist coding tools. Here are some other models Mistral AI supports:

  • Ministral 8B: A compact 8B model designed for edge and on-device inference, priced at $0.10 per million tokens. It shares Mistral Nemo's low-cost positioning but includes vision capabilities and is the recommended replacement for Nemo in newer integrations
  • Mistral Small 4: A hybrid reasoning and instruction model priced at $0.10 input / $0.30 output per million tokens, with a 256k token context window and multimodal image input. It targets teams that need reasoning capability without flagship pricing
  • Mistral Large 3: The current general-purpose flagship from Mistral AI, with a 256k token context window, 675B total parameters in a mixture-of-experts architecture, and Apache 2.0 licensing at $0.50 input / $1.50 output per million tokens
  • Magistral Medium: A chain-of-thought reasoning model built for domain-specific, multilingual analytical tasks. It is available at $2.00 input / $5.00 output per million tokens via magistral-medium-latest
  • Codestral: A specialist code completion and fill-in-the-middle model priced at $0.30 input / $0.90 output per million tokens via codestral-latest. It is purpose-built for developer tooling integrations
  • Devstral 2: Mistral AI's frontier agentic coding model, priced at $0.40 input / $2.00 output per million tokens, designed for autonomous software engineering tasks in agentic frameworks

How does Mistral Nemo differ from Mistral AI's other models?

Mistral Nemo (12B) is a multilingual open-source model that occupies the lowest price point in Mistral AI's hosted API offering, with a flat rate for both input and output tokens.

  • Pricing: At $0.15 per million tokens for both input and output, Mistral Nemo is priced lower than Mistral Small 4 ($0.10 input / $0.30 output). The symmetric input/output pricing makes it predictable for workloads with long completions
  • Parameter count: Mistral Nemo is a 12B parameter model, making it smaller than Mistral Small 4 (119B parameters, MoE) and far smaller than Mistral Large 3 (675B total parameters). Smaller parameter count generally means lower latency but reduced reasoning depth
  • Context window: Mistral Nemo supports a 128k token context window, which is larger than the approximately 33,000 token window of Mistral Medium and sufficient for most document processing tasks, though below the 256k windows offered by Mistral Small 4 and Mistral Large 3
  • Open weights: Mistral Nemo weights are publicly available for self-hosting, which distinguishes it from the proprietary Mistral Medium. Teams can run Nemo on their own infrastructure with no per-token API charges
  • Deprecation status: Mistral AI has marked Mistral Nemo for deprecation with a sunset date of July 31, 2026, recommending Ministral 8B as the primary successor for applications currently built on Nemo

Mistral Nemo is best suited for legacy integrations already using it or for teams that need a multilingual, self-hostable 12B model at minimal API cost before transitioning to its successors.

What models should I consider using alongside Mistral Nemo?

No single model is optimal for every task. Here are models worth pairing with Mistral Nemo depending on what your product needs:

  • Ministral 8B (Mistral AI): The recommended migration target from Mistral Nemo within the Mistral AI family. It carries similar lightweight positioning with added vision capability and is positioned as the long-term replacement for Nemo's use cases
  • Mistral Small 4 (Mistral AI): For tasks that require more reasoning depth or a longer context window, Mistral Small 4's 256k token window, multimodal input, and hybrid reasoning mode cover workloads that Mistral Nemo's 12B architecture cannot handle as reliably
  • Gemini 2.0 Flash (Google): For high-volume, low-complexity tasks like classification or extraction where per-token cost must be minimized, Gemini 2.0 Flash offers sub-cent pricing and handles multilingual inputs across a very large context window
  • Llama 3.1 8B (Meta): For teams that self-host inference, Llama 3.1 8B is a comparable open-weights 8B model with strong multilingual performance and no API dependency, making it a natural pairing or fallback when Mistral Nemo API access is unavailable
  • Claude Haiku 3.5 (Anthropic): When output quality on short-form tasks like summarization, structured extraction, or customer-facing chat matters more than raw cost, Claude Haiku 3.5 provides a stronger cross-provider option at a similarly low price tier

What are the challenges of using Mistral Nemo in my product?

Like any production LLM, Mistral Nemo comes with tradeoffs worth planning for:

  • Provider dependency: Routing all requests through Mistral AI's API creates fragility if the provider has an outage or enforces rate limits. Even though Nemo is an open-weights model, teams using the hosted API have no self-hosted fallback without prior infrastructure setup
  • Cost at scale: At $0.15 per million tokens, Mistral Nemo is inexpensive by industry standards, but high-volume applications still accumulate meaningful spend. A product generating 10 million tokens per day costs roughly $1,500 per month, making cost attribution and budget controls important even at this price tier
  • Deprecation timeline: Mistral AI has announced a July 31, 2026 sunset for Mistral Nemo. Applications built on this model require a migration plan to Ministral 8B or another successor before that date to avoid service interruption
  • No reasoning mode: Mistral Nemo does not support extended chain-of-thought reasoning. Tasks that require multi-step analysis, complex math, or structured planning will underperform compared to models like Mistral Small 4 or Magistral Medium that include native reasoning modes
  • Limited intelligence benchmarks: At 12B parameters, Mistral Nemo scores below the median on general intelligence benchmarks compared to newer Mistral models. For tasks where output quality is the primary constraint, the intelligence gap relative to Mistral Small 4 or Mistral Large 3 should be evaluated before committing to Nemo at scale

Why should I use Merge Gateway to route LLM requests with Mistral Nemo and every other model?

Using Mistral Nemo through Merge Gateway gives you access to the model itself and the infrastructure layer around it:

  • One API, every provider: Access Mistral Nemo and every other major LLM through a single endpoint and API key. Change providers by swapping the model string. No application code changes required
  • Intelligent routing and automatic failover: Merge routes around Mistral AI outages automatically. Routing policies based on cost, latency, or quality can reduce spend by 40-60% without touching your application code
  • Cost governance: Set hard or soft project budgets so Mistral Nemo spend stays within plan. Every request is attributed to a model, project, and tag in a unified billing dashboard across all providers
  • Build Your Own Router: Define what "best" means for your traffic by selecting from curated ML benchmarks or adding your own eval scores. The router scores each available model against your weights and picks the winner per request, with a plain-language explanation of every decision
  • Security and compliance controls: Apply DLP rules and prompt injection protection before every request reaches Mistral AI. Enforce per-project model and region policies without adding that logic to your application

How can I start routing requests to Mistral Nemovia Merge Gateway?

Getting Mistral Nemo running through Merge Gateway takes a few minutes:

1. Create an account and get your API key from the dashboard.

2. Install the Merge Gateway SDK: run pip install merge-gateway-sdk (Python) or npm install merge-gateway-sdk (Node). Alternatively, if you're already using the OpenAI SDK, set base_url = "https://api-gateway.merge.dev/v1/openai" and your existing code works as-is.

3. Make your first request using the provider/model format. For Mistral Nemo, the model string is mistral/open-mistral-nemo. Swap the model string to route to any other provider without changing anything else.

4. Configure a routing policy in the dashboard to set failover behavior, cost limits, and optimization strategy. Your first policy can be as simple as naming Mistral Nemo as primary with Ministral 8B or Mistral Small 4 as fallback.

Full setup instructions and SDK references are in the Merge Gateway docs.

Try Mistral NeMo through Merge Gateway

Route, observe, and control AI requests across providers from one API.