Apply your own routing policies, reduce token costs automatically, and see every routing decision in real time with Merge Gateway.

What Mistral Large costs to run
Test Mistral Large
with Gateway’s Simulator
See a prompt's output, token spend, latency, and more with Mistral Large.
Route requests to Mistral Large in minutes
1$ pip install merge-gateway-sdk1from merge_gateway import MergeGateway
2
3client = MergeGateway(api_key="YOUR_API_KEY")
4
5response = client.responses.create(
6 model="openai/gpt-5.2",
7 input=[
8 {"type": "message", "role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
9 {"type": "message", "role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
10 ],
11)
12
13print(response.output[0].content[0].text)1response = client.responses.create(
2 model="anthropic/claude-sonnet-4-20250514",
3 input=[
4 {"type": "message", "role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
5 {"type": "message", "role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
6 ],
7)1from openai import OpenAI
2
3client = OpenAI(
4 api_key="YOUR_API_KEY",
5 base_url="https://api-gateway.merge.dev/v1/openai",
6)1response = client.chat.completions.create(
2 model="gpt-5.2",
3 messages=[
4 {"role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
5 {"role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
6 ],
7)
8
9print(response.choices[0].message.content)1npm install merge-gateway-ai-sdk-provider ai1import { createMergeGateway } from "merge-gateway-ai-sdk-provider";
2
3const gateway = createMergeGateway({
4 apiKey: "YOUR_API_KEY",
5});1import { generateText } from "ai";
2
3const { text } = await generateText({
4 model: gateway("openai/gpt-4o"),
5 prompt: "Explain the concept of recursion in programming with a simple set of examples.",
6});
7
8console.log(text);1import { createOpenAI } from "@ai-sdk/openai";
2
3const gateway = createOpenAI({
4 apiKey: "YOUR_API_KEY",
5 baseURL: "https://api-gateway.merge.dev/v1/ai-sdk",
6});
7
8// All generateText/streamText calls work unchanged1from anthropic import Anthropic
2
3client = Anthropic(
4 api_key="YOUR_API_KEY",
5 base_url="https://api-gateway.merge.dev/v1/anthropic",
6)
7
8message = client.messages.create(
9 model="claude-sonnet-4-20250514",
10 max_tokens=1024,
11 messages=[
12 {"role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
13 ],
14)
15
16print(message.content[0].text)Explore other models available in Merge Gateway
Mistral Large FAQ
Heading
What other models does Mistral AI offer?
Mistral AI maintains one of the larger model catalogs among European AI providers, with 24 models tracked across reasoning, vision, coding, and efficiency tiers. Here are some other models Mistral AI offers:
- Ministral 3B: Mistral AI's smallest model, optimized for edge and on-device inference. It reaches 191 output tokens per second at $0.10 per million tokens, making it the fastest and cheapest option in the Mistral lineup for lightweight tasks
- Mistral Small 4: A compact reasoning-capable model scoring 28 on the Artificial Analysis Intelligence Index. It is positioned for teams that need reasoning capability at a lower price point than the flagship models
- Mistral Large 2 (Nov '24): The direct successor to Mistral Large, with a 128k token context window and an Intelligence Index score of 15. It is priced at $2.00 input / $6.00 output per million tokens and is available as open weights under the Mistral Research License
- Mistral Large 3: The current generation flagship from Mistral AI, with a 256k token context window, 675B total parameters (41B active, MoE architecture), multimodal image input support, and an Intelligence Index score of 23 out of 43 comparable models. It is priced at $0.50 input / $1.50 output per million tokens under Apache 2.0
- Mistral Medium 3.5: The highest-intelligence Mistral model, scoring 39 on the Artificial Analysis Intelligence Index. It is a reasoning model suited for the most complex tasks in the Mistral portfolio, with a 262k token context window
How does Mistral Large differ from Mistral AI's other models?
Mistral Large (Feb '24) is the original large-scale flagship from Mistral AI, and it has since been superseded by two generations of successors.
- Intelligence Index: Mistral Large scores 10 on the Artificial Analysis Intelligence Index, ranking #66 out of 71 comparable models. This places it among the weakest performers in its class. Mistral Large 2 (Nov '24) scores 15 and Mistral Large 3 scores 23, showing clear generational improvement
- Pricing: At $4.00 input / $12.00 output per million tokens, Mistral Large is significantly more expensive than its successors. Mistral Large 2 costs $2.00 input / $6.00 output and Mistral Large 3 costs $0.50 input / $1.50 output per million tokens, making the original version poor value relative to what Mistral now offers
- Context window: Mistral Large provides approximately 33,000 tokens of context, far below Mistral Large 2's 128k and Mistral Large 3's 256k token windows
- Modality: Text input and output only, with no image support. Mistral Large 3 adds image input capability, which the original generation lacks
- Weights: Mistral Large is a proprietary model with weights not publicly available. Mistral Large 2 and Large 3 are open weights models, giving teams the option to self-host
Mistral Large is best suited for legacy integrations already built around it. For new development, Mistral Large 2 or Mistral Large 3 offer better performance at lower cost.
What models should I consider using alongside Mistral Large?
No single model is optimal for every task. Here are models worth pairing with Mistral Large depending on what your product needs:
- Mistral Large 3 (Mistral AI): The most direct upgrade path. For any task currently running on Mistral Large, Mistral Large 3 delivers substantially higher intelligence at $0.50 input / $1.50 output per million tokens, more than a 75% cost reduction, and adds a 256k token context window
- Claude Sonnet 4 (Anthropic): For complex multi-step reasoning, legal or financial document review, and tasks where instruction fidelity is critical, Claude Sonnet 4 benchmarks well above Mistral Large in instruction-following quality and is a reliable high-quality fallback
- Gemini 1.5 Flash (Google): For high-volume, low-complexity tasks (classification, summarization, keyword extraction), Gemini 1.5 Flash costs $0.00 per million tokens and handles 1 million token context windows, covering the bulk-processing workloads where Mistral Large's higher cost cannot be justified
- Llama 3.3 70B (Meta): At $0.58 input / $0.71 output per million tokens and an Intelligence Index rank of #13 out of 39 comparable models, Llama 3.3 70B offers better performance-per-dollar than Mistral Large for text tasks and can be self-hosted to eliminate inference provider dependency
- GPT-4o (OpenAI): When your application needs multimodal input processing (images alongside text), GPT-4o handles vision tasks that Mistral Large cannot address at all given its text-only constraint
What are the challenges of using Mistral Large in my product?
Like any production LLM, Mistral Large comes with tradeoffs worth planning for:
- Provider dependency: Mistral Large is a proprietary model without publicly available weights, so every request must route through Mistral AI's API or a third-party inference provider. An outage or rate limit event at those providers has no self-hosted fallback
- Cost at scale: At $4.00 input / $12.00 output per million tokens, Mistral Large is among the more expensive options in the Mistral portfolio. A product generating 1 million output tokens per day costs over $12,000 per month before cost optimization. Multiple lower-cost alternatives now match or exceed its quality
- Generational obsolescence: The Artificial Analysis Intelligence Index ranks Mistral Large at #66 out of 71 comparable models. New code built against this model is unlikely to meet quality requirements that newer models satisfy, and maintaining a migration plan is important
- Limited context window: At approximately 33,000 tokens, Mistral Large cannot handle tasks requiring processing of long documents, full codebases, or extended conversation histories. Mistral Large 2 and Large 3 both support 128k and 256k token windows respectively
- No reasoning capability: Mistral Large provides direct responses without chain-of-thought. For complex analytical or mathematical tasks, models with native reasoning modes (Mistral Small 4, Mistral Medium 3.5, or non-Mistral reasoning models) will produce better results
Why should I use Merge Gateway to route LLM requests with Mistral Large and every other model?
Using Mistral Large through Merge Gateway gives you access to the model itself and the infrastructure layer around it:
- Cost governance: Set hard or soft project budgets so Mistral Large spend stays within plan. Every request is attributed to a model, project, and tag in a unified billing dashboard across all providers. Given Mistral Large's high per-token cost, budget controls are especially valuable here
- One API, every provider: Access Mistral Large and every other major LLM through a single endpoint and API key. Change providers by swapping the model string. No application code changes required
- Intelligent routing and automatic failover: Merge routes around Mistral AI outages automatically. Routing policies based on cost, latency, or quality can reduce spend by 40–60% without touching your application code
- Build Your Own Router: Define what "best" means for your traffic by selecting from curated ML benchmarks or adding your own eval scores. The router scores each available model against your weights and picks the winner per request, with a plain-language explanation of every decision
- Security and compliance controls: Apply DLP rules and prompt injection protection before every request reaches Mistral AI. Enforce per-project model and region policies without adding that logic to your application
How can I start routing requests to Mistral Large via Merge Gateway?
Getting Mistral Large running through Merge Gateway takes a few minutes:
1. Create an account and get your API key from the dashboard.
2. Install the Merge Gateway SDK: run pip install merge-gateway-sdk (Python) or npm install merge-gateway-sdk (Node). Alternatively, if you're already using the OpenAI SDK, set base_url = "https://api-gateway.merge.dev/v1/openai" and your existing code works as-is.
3. Make your first request using the provider/model format. For Mistral Large, the model string is mistral/mistral-large-latest. Swap the model string to route to any other provider without changing anything else.
4. Configure a routing policy in the dashboard to set failover behavior, cost limits, and optimization strategy. Your first policy can be as simple as naming Mistral Large as primary with Mistral Large 2 or Mistral Large 3 as fallback.
Full setup instructions and SDK references are in the Merge Gateway docs.
Try Mistral Large through Merge Gateway
Route, observe, and control AI requests across providers from one API.





