Apply your own routing policies, reduce token costs automatically, and see every routing decision in real time with Merge Gateway.

What Mistral NeMo costs to run
Test Mistral NeMo
with Gateway’s Simulator
See a prompt's output, token spend, latency, and more with Mistral NeMo.
Route requests to Mistral NeMo in minutes
1$ pip install merge-gateway-sdk1from merge_gateway import MergeGateway
2
3client = MergeGateway(api_key="YOUR_API_KEY")
4
5response = client.responses.create(
6 model="openai/gpt-5.2",
7 input=[
8 {"type": "message", "role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
9 {"type": "message", "role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
10 ],
11)
12
13print(response.output[0].content[0].text)1response = client.responses.create(
2 model="anthropic/claude-sonnet-4-20250514",
3 input=[
4 {"type": "message", "role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
5 {"type": "message", "role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
6 ],
7)1from openai import OpenAI
2
3client = OpenAI(
4 api_key="YOUR_API_KEY",
5 base_url="https://api-gateway.merge.dev/v1/openai",
6)1response = client.chat.completions.create(
2 model="gpt-5.2",
3 messages=[
4 {"role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
5 {"role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
6 ],
7)
8
9print(response.choices[0].message.content)1npm install merge-gateway-ai-sdk-provider ai1import { createMergeGateway } from "merge-gateway-ai-sdk-provider";
2
3const gateway = createMergeGateway({
4 apiKey: "YOUR_API_KEY",
5});1import { generateText } from "ai";
2
3const { text } = await generateText({
4 model: gateway("openai/gpt-4o"),
5 prompt: "Explain the concept of recursion in programming with a simple set of examples.",
6});
7
8console.log(text);1import { createOpenAI } from "@ai-sdk/openai";
2
3const gateway = createOpenAI({
4 apiKey: "YOUR_API_KEY",
5 baseURL: "https://api-gateway.merge.dev/v1/ai-sdk",
6});
7
8// All generateText/streamText calls work unchanged1from anthropic import Anthropic
2
3client = Anthropic(
4 api_key="YOUR_API_KEY",
5 base_url="https://api-gateway.merge.dev/v1/anthropic",
6)
7
8message = client.messages.create(
9 model="claude-sonnet-4-20250514",
10 max_tokens=1024,
11 messages=[
12 {"role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
13 ],
14)
15
16print(message.content[0].text)Explore other models available in Merge Gateway
Mistral NeMo FAQ
Heading
What other models does Mistral AI offer?
Mistral AI offers a catalog that spans multilingual open-source models, reasoning flagships, and specialist coding tools. Here are some other models Mistral AI supports:
- Ministral 8B: A compact 8B model designed for edge and on-device inference, priced at $0.10 per million tokens. It shares Mistral Nemo's low-cost positioning but includes vision capabilities and is the recommended replacement for Nemo in newer integrations
- Mistral Small 4: A hybrid reasoning and instruction model priced at $0.10 input / $0.30 output per million tokens, with a 256k token context window and multimodal image input. It targets teams that need reasoning capability without flagship pricing
- Mistral Large 3: The current general-purpose flagship from Mistral AI, with a 256k token context window, 675B total parameters in a mixture-of-experts architecture, and Apache 2.0 licensing at $0.50 input / $1.50 output per million tokens
- Magistral Medium: A chain-of-thought reasoning model built for domain-specific, multilingual analytical tasks. It is available at $2.00 input / $5.00 output per million tokens via
magistral-medium-latest
- Codestral: A specialist code completion and fill-in-the-middle model priced at $0.30 input / $0.90 output per million tokens via
codestral-latest. It is purpose-built for developer tooling integrations
- Devstral 2: Mistral AI's frontier agentic coding model, priced at $0.40 input / $2.00 output per million tokens, designed for autonomous software engineering tasks in agentic frameworks
How does Mistral Nemo differ from Mistral AI's other models?
Mistral Nemo (12B) is a multilingual open-source model that occupies the lowest price point in Mistral AI's hosted API offering, with a flat rate for both input and output tokens.
- Pricing: At $0.15 per million tokens for both input and output, Mistral Nemo is priced lower than Mistral Small 4 ($0.10 input / $0.30 output). The symmetric input/output pricing makes it predictable for workloads with long completions
- Parameter count: Mistral Nemo is a 12B parameter model, making it smaller than Mistral Small 4 (119B parameters, MoE) and far smaller than Mistral Large 3 (675B total parameters). Smaller parameter count generally means lower latency but reduced reasoning depth
- Context window: Mistral Nemo supports a 128k token context window, which is larger than the approximately 33,000 token window of Mistral Medium and sufficient for most document processing tasks, though below the 256k windows offered by Mistral Small 4 and Mistral Large 3
- Open weights: Mistral Nemo weights are publicly available for self-hosting, which distinguishes it from the proprietary Mistral Medium. Teams can run Nemo on their own infrastructure with no per-token API charges
- Deprecation status: Mistral AI has marked Mistral Nemo for deprecation with a sunset date of July 31, 2026, recommending Ministral 8B as the primary successor for applications currently built on Nemo
Mistral Nemo is best suited for legacy integrations already using it or for teams that need a multilingual, self-hostable 12B model at minimal API cost before transitioning to its successors.
What models should I consider using alongside Mistral Nemo?
No single model is optimal for every task. Here are models worth pairing with Mistral Nemo depending on what your product needs:
- Ministral 8B (Mistral AI): The recommended migration target from Mistral Nemo within the Mistral AI family. It carries similar lightweight positioning with added vision capability and is positioned as the long-term replacement for Nemo's use cases
- Mistral Small 4 (Mistral AI): For tasks that require more reasoning depth or a longer context window, Mistral Small 4's 256k token window, multimodal input, and hybrid reasoning mode cover workloads that Mistral Nemo's 12B architecture cannot handle as reliably
- Gemini 2.0 Flash (Google): For high-volume, low-complexity tasks like classification or extraction where per-token cost must be minimized, Gemini 2.0 Flash offers sub-cent pricing and handles multilingual inputs across a very large context window
- Llama 3.1 8B (Meta): For teams that self-host inference, Llama 3.1 8B is a comparable open-weights 8B model with strong multilingual performance and no API dependency, making it a natural pairing or fallback when Mistral Nemo API access is unavailable
- Claude Haiku 3.5 (Anthropic): When output quality on short-form tasks like summarization, structured extraction, or customer-facing chat matters more than raw cost, Claude Haiku 3.5 provides a stronger cross-provider option at a similarly low price tier
What are the challenges of using Mistral Nemo in my product?
Like any production LLM, Mistral Nemo comes with tradeoffs worth planning for:
- Provider dependency: Routing all requests through Mistral AI's API creates fragility if the provider has an outage or enforces rate limits. Even though Nemo is an open-weights model, teams using the hosted API have no self-hosted fallback without prior infrastructure setup
- Cost at scale: At $0.15 per million tokens, Mistral Nemo is inexpensive by industry standards, but high-volume applications still accumulate meaningful spend. A product generating 10 million tokens per day costs roughly $1,500 per month, making cost attribution and budget controls important even at this price tier
- Deprecation timeline: Mistral AI has announced a July 31, 2026 sunset for Mistral Nemo. Applications built on this model require a migration plan to Ministral 8B or another successor before that date to avoid service interruption
- No reasoning mode: Mistral Nemo does not support extended chain-of-thought reasoning. Tasks that require multi-step analysis, complex math, or structured planning will underperform compared to models like Mistral Small 4 or Magistral Medium that include native reasoning modes
- Limited intelligence benchmarks: At 12B parameters, Mistral Nemo scores below the median on general intelligence benchmarks compared to newer Mistral models. For tasks where output quality is the primary constraint, the intelligence gap relative to Mistral Small 4 or Mistral Large 3 should be evaluated before committing to Nemo at scale
Why should I use Merge Gateway to route LLM requests with Mistral Nemo and every other model?
Using Mistral Nemo through Merge Gateway gives you access to the model itself and the infrastructure layer around it:
- One API, every provider: Access Mistral Nemo and every other major LLM through a single endpoint and API key. Change providers by swapping the model string. No application code changes required
- Intelligent routing and automatic failover: Merge routes around Mistral AI outages automatically. Routing policies based on cost, latency, or quality can reduce spend by 40-60% without touching your application code
- Cost governance: Set hard or soft project budgets so Mistral Nemo spend stays within plan. Every request is attributed to a model, project, and tag in a unified billing dashboard across all providers
- Build Your Own Router: Define what "best" means for your traffic by selecting from curated ML benchmarks or adding your own eval scores. The router scores each available model against your weights and picks the winner per request, with a plain-language explanation of every decision
- Security and compliance controls: Apply DLP rules and prompt injection protection before every request reaches Mistral AI. Enforce per-project model and region policies without adding that logic to your application
How can I start routing requests to Mistral Nemovia Merge Gateway?
Getting Mistral Nemo running through Merge Gateway takes a few minutes:
1. Create an account and get your API key from the dashboard.
2. Install the Merge Gateway SDK: run pip install merge-gateway-sdk (Python) or npm install merge-gateway-sdk (Node). Alternatively, if you're already using the OpenAI SDK, set base_url = "https://api-gateway.merge.dev/v1/openai" and your existing code works as-is.
3. Make your first request using the provider/model format. For Mistral Nemo, the model string is mistral/open-mistral-nemo. Swap the model string to route to any other provider without changing anything else.
4. Configure a routing policy in the dashboard to set failover behavior, cost limits, and optimization strategy. Your first policy can be as simple as naming Mistral Nemo as primary with Ministral 8B or Mistral Small 4 as fallback.
Full setup instructions and SDK references are in the Merge Gateway docs.
Try Mistral NeMo through Merge Gateway
Route, observe, and control AI requests across providers from one API.





