Apply your own routing policies, reduce token costs automatically, and see every routing decision in real time with Merge Gateway.
What Ministral 3 8B costs to run
Test Ministral 3 8B
with Gateway’s Simulator
See a prompt's output, token spend, latency, and more with Ministral 3 8B.
Route requests to Ministral 3 8B in minutes
1$ pip install merge-gateway-sdk1from merge_gateway import MergeGateway
2
3client = MergeGateway(api_key="YOUR_API_KEY")
4
5response = client.responses.create(
6 model="openai/gpt-5.2",
7 input=[
8 {"type": "message", "role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
9 {"type": "message", "role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
10 ],
11)
12
13print(response.output[0].content[0].text)1response = client.responses.create(
2 model="anthropic/claude-sonnet-4-20250514",
3 input=[
4 {"type": "message", "role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
5 {"type": "message", "role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
6 ],
7)1from openai import OpenAI
2
3client = OpenAI(
4 api_key="YOUR_API_KEY",
5 base_url="https://api-gateway.merge.dev/v1/openai",
6)1response = client.chat.completions.create(
2 model="gpt-5.2",
3 messages=[
4 {"role": "system", "content": "You are a helpful programming tutor. Explain the concepts clearly with practical examples."},
5 {"role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
6 ],
7)
8
9print(response.choices[0].message.content)1npm install merge-gateway-ai-sdk-provider ai1import { createMergeGateway } from "merge-gateway-ai-sdk-provider";
2
3const gateway = createMergeGateway({
4 apiKey: "YOUR_API_KEY",
5});1import { generateText } from "ai";
2
3const { text } = await generateText({
4 model: gateway("openai/gpt-4o"),
5 prompt: "Explain the concept of recursion in programming with a simple set of examples.",
6});
7
8console.log(text);1import { createOpenAI } from "@ai-sdk/openai";
2
3const gateway = createOpenAI({
4 apiKey: "YOUR_API_KEY",
5 baseURL: "https://api-gateway.merge.dev/v1/ai-sdk",
6});
7
8// All generateText/streamText calls work unchanged1from anthropic import Anthropic
2
3client = Anthropic(
4 api_key="YOUR_API_KEY",
5 base_url="https://api-gateway.merge.dev/v1/anthropic",
6)
7
8message = client.messages.create(
9 model="claude-sonnet-4-20250514",
10 max_tokens=1024,
11 messages=[
12 {"role": "user", "content": "Explain the concept of recursion in programming with a simple set of examples."},
13 ],
14)
15
16print(message.content[0].text)Explore other models available in Merge Gateway
Ministral 3 8B FAQ
Heading
What other models does Mistral AI offer?
Mistral AI ships small edge models alongside general-purpose, coding, and reasoning lines. Here are some other models Mistral AI supports:
- Ministral 3 14B: the largest edge model in the same line, for on-device tasks that need more headroom
- Mistral Small: a compact, open-weight general model that sits above the Ministral edge tier
- Mistral Nemo: a small, open-weight 12B model for affordable, self-hostable inference
- Mistral Medium 3.5: the mid-tier general model, balancing quality and cost with multimodal input
How does Ministral 3 8B differ from Mistral AI's other models?
Ministral 3 8B is the mid-size model in Mistral's edge-focused line, balancing capability and footprint for on-device and low-latency use.
- Edge focus: built to run close to the user with low latency, unlike the larger hosted-first general models
- Size: the 8B tier sits between the 3B and 14B Ministral options, trading some capability for a smaller footprint than the 14B
- Capabilities: supports function calling for its class, which suits lightweight agentic tasks at the edge
- Position vs Mistral Small: narrower general-purpose breadth than Small, traded for a footprint that fits local and constrained deployments
Reach for Ministral 3 8B when you want a balanced edge model for on-device or latency-sensitive tasks without the footprint of the 14B tier.
What models should I consider using alongside Ministral 3 8B?
No single model is optimal for every task. Here are models worth pairing with Ministral 3 8B depending on what your product needs:
- Mistral Small as the step up when a task needs more general-purpose breadth than an edge model provides
- Claude Opus 4.8 for the hardest reasoning or coding tasks that need frontier quality in the cloud
- Gemini 3.5 Flash for high-volume, low-cost cloud multimodal tasks
- Ministral 3 14B when an edge task needs more headroom than the 8B tier provides
- Mistral Nemo as another small, open-weight model to benchmark against
What are the challenges of using Ministral 3 8B in my product?
Like any production LLM, Ministral 3 8B comes with tradeoffs worth planning for:
- Quality ceiling: as a small edge model, it trails larger cloud models on complex reasoning and long-form generation, so plan an escalation path
- Deployment operations: running it on-device or at the edge means owning packaging, updates, and hardware constraints
- Provider dependency: if you use the hosted version, relying only on Mistral is fragile during outages or retirements
- Cost at scale: cheap per token in the cloud, but very high volumes still compound, so budgeting stays relevant
- Task fit: best on focused edge tasks, so route heavy reasoning to a larger model rather than pushing it past its range
Why should I use Merge Gateway to route LLM requests with Ministral 3 8B and every other model?
Routing Ministral 3 8B through Merge Gateway pairs the model with the control layer around it:
- One API, every provider: Call Ministral 3 8B and every other major model from a single endpoint and key, switching models with a string change rather than a code change
- Intelligent routing and automatic failover: Merge fails over around Mistral outages on its own, and an edge-to-cloud quality ladder is easy to express as a policy that can lower spend by 40 to 60%
- Cost governance: Cap spend with project budgets, and see every request attributed by model, project, and tag in one cross-provider dashboard
- Build Your Own Router: Define "best" for your traffic with curated benchmarks or your own evals, and let the router choose per request and explain why
- Security and compliance controls: Run DLP and prompt injection checks before requests reach Mistral, and enforce per-project model and region rules centrally
How can I start routing requests to Ministral 3 8B via Merge Gateway?
Getting Ministral 3 8B running through Merge Gateway takes a few minutes:
1. Create an account and get your API key from the dashboard.
2. Install the Merge Gateway SDK: run pip install merge-gateway-sdk (Python) or npm install merge-gateway-sdk (Node). Alternatively, if you're already using the OpenAI SDK, set base_url = "https://api-gateway.merge.dev/v1/openai" and your existing code works as-is.
3. Make your first request using the provider/model format. For Ministral 3 8B, the model string is mistral/ministral-8b-2512 (confirm the exact slug in the dashboard). Swap the model string to route to any other provider without changing anything else.
4. Configure a routing policy in the dashboard to set failover behavior, cost limits, and optimization strategy. Your first policy can be as simple as naming Ministral 3 8B as primary with one fallback.
Full setup instructions and SDK references are in the Merge Gateway docs.
Try Ministral 3 8B through Merge Gateway
Route, observe, and control AI requests across providers from one API.
