Evaluation record ยท minimax-m3

MiniMax-M3

v20260601

MiniMax

Modelagenticmultimodaltool-callingopen-weight
78
Strong
About This Model

MiniMax's natively multimodal 428B MoE (23B active) with a 1M-token context via MiniMax Sparse Attention, launched June 2026 with weights on Hugging Face by 2026-06-07. Vendor reports 80.5% SWE-bench Verified; Artificial Analysis scores it 44 on Intelligence Index v4.1. Unlike MIT-licensed M2, M3 ships under a MiniMax Community License, and training code and some inference operators are withheld.

Last Evaluated: July 9, 2026
Official Website

Trust Vector Analysis

Dimension Breakdown

๐Ÿš€Performance & Reliability
+

Meaningful step over M2: 1M context, native multimodality, and independently confirmed intelligence gains (Artificial Analysis 44 vs open-weight median 25). Headline coding figures (80.5% SWE-bench Verified) are vendor-run on vendor infrastructure and drew explicit independent skepticism at launch; GLM-5.2 leads it on independent indices.

task accuracy code

Vendor benchmarks with independent scrutiny noting all launch figures were vendor-run; partial independent corroboration via Artificial Analysis

Evidence
MiniMax-M3 Model Card (vendor-reported) โ€” SWE-bench Verified 80.5%, SWE-bench Pro 59.0%, Terminal-Bench 2.1 66%, SWE-fficiency 34.8, KernelBench Hard 28.8
TechTimes launch analysis โ€” Frontier claims flagged as vendor-run on MiniMax's own infrastructure with vendor-selected baselines
mediumVerified: 2026-07-09
task accuracy reasoning

Vendor-reported reasoning benchmarks and early community evaluation

Evidence
MiniMax-M3 Model Card โ€” Reasoning modes (enabled/adaptive/disabled) via API; competitive reasoning for a 23B-active footprint
mediumVerified: 2026-07-09
task accuracy general

Independent composite benchmarking (Artificial Analysis) plus vendor multimodal benchmarks

Evidence
Artificial Analysis โ€” Intelligence Index v4.1 score of 44 โ€” well above the open-weight median (25), tied with DeepSeek V4 Pro, behind GLM-5.2 (51); roughly level with Claude Sonnet 4.6 on GDPval-AA agentic benchmark
MiniMax-M3 Model Card (multimodal) โ€” MMMU Pro 78.1, Video-MME v2 85.4 โ€” strong native multimodal understanding
mediumVerified: 2026-07-09
output consistency

Early community testing of repeated runs and agentic trajectories

Evidence
Community evaluation โ€” Early agentic evaluations report capable but mixed consistency across long workflows; limited observation window since June launch
lowVerified: 2026-07-09
latency p50

Median latency for API requests with standard prompt sizes; architecture-level efficiency verified in vendor technical report (arXiv:2606.13392)

Evidence
MiniMax-M3 Model Card (MSA) โ€” MiniMax Sparse Attention delivers 9x prefill and 15x decode speedups vs M2 at 1M context, cutting per-token compute to 1/20; 23B active keeps generation fast
mediumVerified: 2026-07-09
latency p95

95th percentile response time from early third-party measurements

Evidence
Community benchmarking โ€” p95 ~4.5s; very long multimodal or 1M-context requests run longer
lowVerified: 2026-07-09
context window

Official specification from model card

Evidence
MiniMax-M3 Model Card โ€” 1M-token context window enabled by MiniMax Sparse Attention
highVerified: 2026-07-09
uptime

Review of platform availability since launch; observation window under six weeks

Evidence
MiniMax Platform โ€” First-party API stable in first weeks, with a paid Priority tier (1.5x) for admission and latency guarantees; no long-run availability record yet
lowVerified: 2026-07-09
๐Ÿ›ก๏ธSecurity
+

Standard open-model posture without third-party audits, scored slightly below M2 for launch recency and the wider multimodal attack surface. Self-hosting shifts security responsibility to the deployer.

prompt injection resistance

Review of vendor documentation against OWASP LLM01 patterns; model too new for mature red-team coverage

Evidence
MiniMax-M3 Model Card โ€” Safety tuning described; no published third-party prompt-injection audit; multimodal inputs (image/video) widen the injection surface
lowVerified: 2026-07-09
jailbreak resistance

Early testing against adversarial prompt datasets; deployer-dependent for self-hosted use

Evidence
Community red-teaming โ€” Standard alignment tuning; open weights allow guardrail removal in derivatives; limited adversarial testing published since launch
lowVerified: 2026-07-09
data leakage prevention

Analysis of privacy policies and self-hosting data-control options

Evidence
MiniMax Privacy Policy โ€” Standard data handling on first-party API; full control when self-hosted
mediumVerified: 2026-07-09
output safety

Safety testing across harmful content categories per vendor card and early community reports

Evidence
MiniMax-M3 Model Card โ€” Safety post-training applied; refusal behavior in line with peer open models per early reports
mediumVerified: 2026-07-09
api security

Review of API security features and best practices

Evidence
MiniMax API Documentation โ€” API key authentication, HTTPS only, rate limiting; OpenAI- and Anthropic-compatible endpoints carried over from M2
mediumVerified: 2026-07-09
๐Ÿ”’Privacy & Compliance
+

First-party MiniMax API operates under Chinese jurisdiction โ€” a material caveat for Western regulated industries. Self-hosting mitigates residency, but unlike MIT-licensed M2, M3's Community License attaches attribution and revenue-threshold conditions to commercial self-hosted use.

data residency

Review of provider jurisdiction and third-party hosting options

Evidence
MiniMax Platform Documentation โ€” MiniMax is a China-based provider; first-party API data processed under Chinese jurisdiction
OpenRouter availability โ€” Open weights served by Western inference providers, enabling non-China residency (subject to Community License terms)
mediumVerified: 2026-07-09
training data optout

Analysis of privacy policy and data usage terms

Evidence
MiniMax Privacy Policy โ€” Standard API data terms; self-hosting removes the concern entirely
mediumVerified: 2026-07-09
data retention

Review of terms of service and deployment-dependent retention

Evidence
MiniMax Terms of Service โ€” First-party retention governed by Chinese data regulations; self-hosted deployments retain nothing externally
mediumVerified: 2026-07-09
pii handling

Review of data protection capabilities and customer responsibilities

Evidence
MiniMax Documentation โ€” Customer responsible for PII redaction; no managed PII tooling; multimodal inputs (images/video) add PII-handling complexity
mediumVerified: 2026-07-09
compliance certifications

Verification of compliance certifications and audit reports

Evidence
MiniMax public materials โ€” No published SOC 2 / HIPAA / GDPR attestations for the first-party API
mediumVerified: 2026-07-09
zero data retention

Review of self-hosting deployment options enabling zero retention

Evidence
Open weights on Hugging Face โ€” Self-hosting (vLLM/SGLang/Transformers/KTransformers) gives complete data control and zero external retention; Community License conditions apply to commercial deployments
mediumVerified: 2026-07-09
๐Ÿ‘๏ธTrust & Transparency
+

Good architectural documentation (MSA technical report) but reduced openness vs M2: training code, data pipelines, and some inference operators are withheld, and all launch benchmarks were vendor-run โ€” independent reviewers explicitly flagged the verification gap.

explainability

Evaluation of reasoning transparency and trajectory inspectability

Evidence
MiniMax-M3 documentation โ€” Reasoning modes (enabled/adaptive/disabled) expose or suppress thinking traces per request, aiding agent-loop auditability
mediumVerified: 2026-07-09
hallucination rate

Early testing on factual QA and tool-augmented workflows

Evidence
Community testing โ€” Early agentic evaluations report moderate hallucination; tool-grounded workflows perform better than closed-book QA
lowVerified: 2026-07-09
bias fairness

Review of published bias benchmarks and community evaluations

Evidence
MiniMax-M3 Model Card โ€” Limited published bias evaluation, including for multimodal inputs
lowVerified: 2026-07-09
uncertainty quantification

Qualitative assessment of confidence expression in outputs

Evidence
Model behavior testing โ€” Basic uncertainty expression; no calibrated confidence outputs; limited testing since launch
lowVerified: 2026-07-09
model card quality

Review of documentation completeness and clarity

Evidence
Hugging Face model card and MSA technical report โ€” Clear documentation of 428B/23B MoE, MSA architecture (arXiv:2606.13392), benchmark tables, recommended inference parameters, and deployment guidance
highVerified: 2026-07-09
training data transparency

Review of public disclosures about training data and released artifacts

Evidence
Independent launch analysis โ€” Training code, data pipelines, and specific inference operators withheld; data mixture not published โ€” a step back from full open-source transparency
Kili Technology data story โ€” Analysis of what MiniMax disclosed vs withheld about M3's training data and pipeline
mediumVerified: 2026-07-09
guardrails

Analysis of built-in safety mechanisms

Evidence
MiniMax-M3 Model Card โ€” Built-in safety tuning; deployers of open weights must layer their own guardrails, including for image/video inputs
mediumVerified: 2026-07-09
โš™๏ธOperational Excellence
+

Dual OpenAI/Anthropic compatibility and broad day-one inference support carry over from M2, but the license regression (MIT to MiniMax Community License with attribution and revenue-threshold clauses) and withheld training/inference code lower the operational score. Commercial deployers need legal review.

api design quality

Review of API design, consistency, and feature completeness

Evidence
MiniMax API Documentation โ€” OpenAI- and Anthropic-compatible endpoints with streaming, tool calling, reasoning modes, prompt caching, and a Priority service tier
highVerified: 2026-07-09
sdk quality

Review of SDK quality, documentation, and maintenance

Evidence
MiniMax GitHub โ€” Compatibility with mainstream OpenAI/Anthropic SDKs; first-party tooling adequate but M3-specific tooling still young
mediumVerified: 2026-07-09
versioning policy

Review of versioning practices, weight availability, and license continuity across releases

Evidence
MiniMax release history โ€” M3 announced 2026-06-01 with weights on Hugging Face by 2026-06-07; M2 weights remain available; license changed from MIT (M2) to MiniMax Community License (M3) between generations
mediumVerified: 2026-07-09
monitoring observability

Review of available monitoring tools and metrics

Evidence
MiniMax Platform โ€” Basic usage dashboard; self-hosted observability is deployer-built
mediumVerified: 2026-07-09
support quality

Assessment of documentation, community, and support responsiveness

Evidence
MiniMax community channels โ€” GitHub and community support; limited English-language enterprise support
mediumVerified: 2026-07-09
ecosystem maturity

Analysis of third-party hosting, integrations, and tooling; conservative given launch recency

Evidence
Inference ecosystem โ€” Day-one vLLM/SGLang/Transformers/KTransformers/unsloth support with community quantizations and OpenRouter availability; ~259K Hugging Face downloads in the first month, though the M3-specific ecosystem is only weeks old
mediumVerified: 2026-07-09
license terms

Review of licensing terms and restrictions; regression from M2's clean MIT license is trust-relevant

Evidence
MiniMax Community License โ€” Not MIT/Apache: commercial use requires a visible 'Built with MiniMax M3' notice, and products exceeding the license's yearly revenue threshold need separate authorization
Independent license analysis โ€” 'Available to download' does not mean 'free for any commercial use' โ€” reviewers advise reading the license before building commercial products on M3
highVerified: 2026-07-09
Strengths
  • +Native multimodality: mixed-modality training from step one across text, image, and video (78.1 MMMU Pro, 85.4 Video-MME v2)
  • +1M-token context with MiniMax Sparse Attention: 9x prefill / 15x decode speedups vs M2 at 1M context
  • +Efficient 23B-active footprint keeps inference fast and self-hosting relatively affordable
  • +Aggressive pricing: $0.30/$1.20 per 1M tokens (promotional 50% off list) with $0.06 cache reads
  • +Independently confirmed intelligence gain: Artificial Analysis 44, well above the open-weight median
  • +Day-one vLLM/SGLang/Transformers/KTransformers/unsloth support with community quantizations
Limitations
  • !License regression from M2: MiniMax Community License requires 'Built with MiniMax M3' attribution and separate authorization above a revenue threshold
  • !Training code, data pipelines, and some inference operators withheld despite the 'open-weight' label
  • !All launch benchmarks vendor-run on vendor infrastructure; independent reviewers flagged the verification gap
  • !First-party API processes data under Chinese jurisdiction with no published Western compliance certifications
  • !Behind GLM-5.2 on independent intelligence and agentic indices
  • !Long-context pricing doubles above 512K input tokens
  • !Launched June 2026 โ€” consistency, uptime, and security evidence still immature
Metadata
pricing
input: $0.30 per 1M tokens (โ‰ค512K input; $0.06 cache hit)
output: $1.20 per 1M tokens
notes: Promotional 'permanent 50% off' from list $0.60/$2.40. Rates double above 512K input tokens; Priority tier is 1.5x for admission/latency guarantees. Third-party host pricing varies.
last verified: 2026-07-09
context window: 1000000
languages
0: English
1: Chinese
2: Japanese
3: Korean
4: Spanish
5: French
6: German
modalities
0: text
1: image (input)
2: video (input)
api endpoint: https://api.minimax.io/v1/chat/completions
open source: true
license: MiniMax Community License (attribution notice required for commercial use; separate authorization above yearly revenue threshold)
architecture: Mixture-of-Experts: ~428B total / ~23B active parameters, MiniMax Sparse Attention (MSA), native mixed-modality training (arXiv:2606.13392)
parameters: 428B total / 23B active
release date: 2026-06-01

Use Case Ratings

code generation

Vendor-reported 80.5% SWE-bench Verified and 59.0% SWE-bench Pro at very low cost, but figures are vendor-run and GLM-5.2 leads on independent indices.

customer support

Fast (23B active), very cheap, and multimodal โ€” can handle screenshot- and image-based support tickets natively.

content creation

Good generation quality at minimal cost; image/video understanding aids content workflows.

data analysis

Good tool calling plus native chart/image understanding; weaker raw reasoning than GLM-5.2 or Kimi K2.6.

research assistant

1M context and native multimodality (text/image/video) suit long-document and mixed-media research at low cost.

legal compliance

China-jurisdiction first-party API, no Western certifications, and Community License conditions make this a poor fit without careful mitigation.

healthcare

Not recommended via first-party API; self-hosted deployment in a compliant environment is the only viable path, with license review.

financial analysis

Capable and cheap with chart/document understanding; data residency requires self-hosting for regulated firms.

education

Multimodal tutoring (diagrams, video) at very low cost suits high-volume educational platforms.

creative writing

Serviceable creative output; not its design focus.