Evaluation record ยท claude-sonnet-5

Claude Sonnet 5

v5

Anthropic

Modelcodingagenticproductionenterprise
91
Exceptional
About This Model

Anthropic's Sonnet-tier flagship (released 2026-06-30), positioned as the cheaper way to run agents: 72.7% SWE-bench Verified (vs Sonnet 4.6's 62.3%), 80.4% Terminal-Bench 2.1, 81.2% OSWorld-Verified โ€” approaching Opus 4.8 at a fraction of the cost. Same $3/$15 standard price as Sonnet 4.6 with intro $2/$10 through 2026-08-31, 1M context, effort parameter incl. xhigh, and deliberately low cyber capability with default-on safeguards.

Last Evaluated: July 9, 2026
Official Website

Trust Vector Analysis

Dimension Breakdown

๐Ÿš€Performance & Reliability
+

Biggest Sonnet-generation jump in the registry: +10.4 points SWE-bench Verified and +13.4 Terminal-Bench 2.1 over Sonnet 4.6, closing most of the gap to Opus 4.8 (and edging it on GDPval-AA v2). Scores held slightly conservative pending independent benchmark replication โ€” the model is nine days old.

task accuracy code

Provider-published coding benchmarks cross-checked against independent launch coverage; SWE-bench Verified, SWE-bench Pro, and Terminal-Bench 2.1

Evidence
Anthropic: Introducing Claude Sonnet 5 โ€” 72.7% SWE-bench Verified vs Sonnet 4.6's 62.3%; described as the most agentic Sonnet model yet with sustained coding and debugging
MarkTechPost benchmark comparison โ€” 63.2% SWE-bench Pro (vs Sonnet 4.6's 58.1%, Opus 4.8's 69.2%); 80.4% Terminal-Bench 2.1 (vs Sonnet 4.6's 67.0%)
TechCrunch โ€” Runs agentic coding workloads autonomously at a level that recently required larger, more expensive models
highVerified: 2026-07-09
task accuracy reasoning

Provider-published reasoning benchmarks; independent replication still limited nine days post-launch

Evidence
MarkTechPost benchmark comparison โ€” 57.4% Humanity's Last Exam (with tools) vs Sonnet 4.6's 46.8% and Opus 4.8's 57.9% โ€” near-Opus reasoning at Sonnet price
mediumVerified: 2026-07-09
task accuracy general

Knowledge-work and computer-use benchmark review from provider announcement and third-party comparisons

Evidence
MarkTechPost benchmark comparison โ€” GDPval-AA v2 knowledge-work score of 1,618, marginally above Opus 4.8's 1,615; 81.2% OSWorld-Verified computer use
Anthropic: Introducing Claude Sonnet 5 โ€” Substantial improvement over Sonnet 4.6 on reasoning, tool use, coding, and knowledge work; strict improvement on BrowseComp agentic search
mediumVerified: 2026-07-09
output consistency

Review of documented behavior controls; repeated-run consistency data still limited post-launch. Note the updated tokenizer maps identical input to roughly 1.0-1.35x more tokens than Sonnet 4.6

Evidence
Anthropic: Introducing Claude Sonnet 5 โ€” Self-verifies its own output without explicit prompting; effort parameter gives repeatable quality/cost control across low/medium/high/xhigh
mediumVerified: 2026-07-09
latency p50

Median latency for API requests with standard prompt sizes; limited launch-window sample

Evidence
Community benchmarking โ€” Early measurements comparable to Sonnet 4.6 at low/medium effort; launch-window sample is small
lowVerified: 2026-07-09
latency p95

95th percentile response time across diverse workloads; limited launch-window sample

Evidence
Community benchmarking โ€” Early p95 around 4s; higher at xhigh effort with deeper reasoning
lowVerified: 2026-07-09
context window

Specification review from launch documentation and coverage. Max output tokens not yet confirmed in public docs

Evidence
MarkTechPost benchmark comparison โ€” 1M token context window; API model string claude-sonnet-5
highVerified: 2026-07-09
uptime

Platform uptime from official status page; model-specific track record is only ~9 days old, so score held slightly below the platform baseline

Evidence
Anthropic Status Page โ€” Claude API uptime 99.57% (last 90 days); no Sonnet 5-specific incidents since the 2026-06-30 launch
mediumVerified: 2026-07-09
๐Ÿ›ก๏ธSecurity
+

Strong safety posture with a notable design choice: offensive-cyber capability is intentionally kept much lower than the Opus line, with cyber safeguards on by default. Anthropic reports fewer undesirable agentic behaviors than Sonnet 4.6.

prompt injection resistance

Review of provider safety evaluations against OWASP LLM01 patterns; third-party red-team data still limited at launch

Evidence
Anthropic: Introducing Claude Sonnet 5 โ€” Improved resistance to prompt injection attacks vs Sonnet 4.6; generally safer to use in agentic contexts
mediumVerified: 2026-07-09
jailbreak resistance

Testing against adversarial prompt datasets and review of provider safety documentation

Evidence
Anthropic: Introducing Claude Sonnet 5 โ€” Lower rate of undesirable behaviors than Sonnet 4.6, with improved refusal of malicious requests
Anthropic Constitutional AI โ€” Constitutional AI alignment carried forward with well-calibrated refusals
mediumVerified: 2026-07-09
data leakage prevention

Analysis of privacy policies and data handling practices

Evidence
Anthropic Privacy Statement โ€” No training on user data without explicit consent; training opt-out by default for API traffic
mediumVerified: 2026-07-09
output safety

Review of provider safety evaluations across harmful content and offensive-cyber categories

Evidence
Anthropic: Introducing Claude Sonnet 5 โ€” Cyber safeguards enabled by default (equivalent to Opus 4.7/4.8, less strict than Fable 5); deliberately not trained on cyber tasks โ€” 0.0% success on full Firefox exploit development
Anthropic Trust Center โ€” Released with safety evaluations under the Responsible Scaling Policy
highVerified: 2026-07-09
api security

Review of API security features and best practices

Evidence
Anthropic API Documentation โ€” API key authentication, HTTPS only, rate limiting, workspace scoping; same hardened API surface as the Sonnet 4.6/Opus 4.8 generation
highVerified: 2026-07-09
๐Ÿ”’Privacy & Compliance
+

Inherits Anthropic's full enterprise privacy posture from day one: ephemeral data handling, SOC 2 Type II, GDPR, HIPAA eligible.

data residency

Review of enterprise documentation and privacy policies

Evidence
Anthropic Enterprise Documentation โ€” Data residency options for US and EU enterprise customers
highVerified: 2026-07-09
training data optout

Analysis of privacy policy and data usage terms

Evidence
Anthropic Privacy Policy โ€” Opt-out available; no training on API data by default
highVerified: 2026-07-09
data retention

Review of terms of service and data retention policies

Evidence
Anthropic Terms of Service โ€” API prompts and outputs not retained (except for trust & safety)
highVerified: 2026-07-09
pii handling

Review of data protection capabilities and customer responsibilities

Evidence
Anthropic Privacy Documentation โ€” Customer responsible for PII redaction
mediumVerified: 2026-07-09
compliance certifications

Verification of compliance certifications and audit reports

Evidence
Anthropic Trust Center โ€” SOC 2 Type II, GDPR compliant, HIPAA eligible โ€” same posture as the rest of the Claude line
highVerified: 2026-07-09
zero data retention

Review of data handling practices

Evidence
Anthropic API Documentation โ€” Ephemeral data processing; zero data retention configuration available
highVerified: 2026-07-09
๐Ÿ‘๏ธTrust & Transparency
+

Transparent launch documentation, including an unusually candid cyber-capability section and a public benchmark-methodology correction. Knowledge cutoff not yet published.

explainability

Evaluation of reasoning transparency and explanation capabilities

Evidence
Anthropic: Introducing Claude Sonnet 5 โ€” Effort parameter (low/medium/high/xhigh) makes reasoning depth explicit and controllable; self-verification behavior surfaced in outputs
highVerified: 2026-07-09
hallucination rate

Review of provider evaluations; independent factual-QA measurement still limited at launch

Evidence
Anthropic: Introducing Claude Sonnet 5 โ€” Lower hallucination and sycophancy rates than Sonnet 4.6 per launch safety evaluations
mediumVerified: 2026-07-09
bias fairness

Evaluation on bias benchmarks and diverse demographic testing

Evidence
Anthropic Responsible Scaling Policy โ€” Regular bias testing and mitigation under the Responsible Scaling Policy
mediumVerified: 2026-07-09
uncertainty quantification

Qualitative assessment of confidence expression in outputs

Evidence
Anthropic: Introducing Claude Sonnet 5 โ€” Lower sycophancy and self-verification behavior suggest improved calibration over Sonnet 4.6
mediumVerified: 2026-07-09
model card quality

Review of documentation completeness and clarity

Evidence
Anthropic: Introducing Claude Sonnet 5 โ€” Detailed launch documentation covering benchmarks, safety evaluations (incl. cyber capability testing), tokenizer change, and pricing; a BrowseComp methodology correction was published transparently as a changelog entry
highVerified: 2026-07-09
training data transparency

Review of public disclosures about training data

Evidence
Anthropic Public Statements โ€” General description provided; detailed sources and knowledge cutoff not disclosed at launch
mediumVerified: 2026-07-09
guardrails

Analysis of built-in safety mechanisms

Evidence
Constitutional AI โ€” Constitutional AI guardrails plus default-on cyber safeguards and deliberately restricted offensive-cyber training
highVerified: 2026-07-09
โš™๏ธOperational Excellence
+

Drop-in adoption for existing Claude users, with one real migration caveat: the updated tokenizer maps the same input to roughly 1.0-1.35x more tokens than Sonnet 4.6, so per-request cost can rise even at identical per-token prices. Vertex AI availability still pending as of 2026-07-09.

api design quality

Review of API design, consistency, and feature completeness

Evidence
Anthropic API Documentation โ€” Same modern API surface as the Sonnet 4.6 generation: effort parameter (low/medium/high/xhigh), structured outputs, streaming, tool use; stable claude-sonnet-5 model string
highVerified: 2026-07-09
sdk quality

Review of SDK quality, documentation, and maintenance

Evidence
Anthropic SDKs โ€” Official SDKs (Python, TypeScript, Java, Go, Ruby, C#, PHP) with day-one Sonnet 5 support
highVerified: 2026-07-09
versioning policy

Review of versioning policy and historical practices

Evidence
Anthropic API Versioning โ€” Clear versioning with advance deprecation notice; Sonnet 4.6 remains Active with tentative retirement not sooner than 2027-02-17, giving a long migration runway
highVerified: 2026-07-09
monitoring observability

Review of available monitoring tools and metrics

Evidence
Anthropic Console โ€” Usage dashboard with metrics, cost tracking, and workspace controls
mediumVerified: 2026-07-09
support quality

Assessment of documentation, community, and support responsiveness

Evidence
Anthropic Support โ€” Email support, developer community, comprehensive docs and migration guidance from Sonnet 4.6
highVerified: 2026-07-09
ecosystem maturity

Analysis of availability surfaces and third-party integrations; score held below Sonnet 4.6 until Vertex AI availability lands and framework defaults migrate

Evidence
Anthropic: Introducing Claude Sonnet 5 โ€” Default model for Claude Free and Pro plans; available on Max/Team/Enterprise, Claude Code, the Claude API, Claude Platform on AWS, and Microsoft Foundry โ€” Google Vertex AI listed as coming soon
mediumVerified: 2026-07-09
license terms

Review of licensing terms and restrictions

Evidence
Anthropic Commercial Terms โ€” Standard commercial terms; enterprise agreements available
highVerified: 2026-07-09
Strengths
  • +72.7% SWE-bench Verified and 80.4% Terminal-Bench 2.1 โ€” a 10+ point generation-over-generation jump at the same standard price
  • +Near-Opus performance (57.4% HLE with tools vs Opus 4.8's 57.9%; edges Opus 4.8 on GDPval-AA v2) at $3/$15
  • +Introductory $2/$10 pricing through 2026-08-31 makes agent migration trials cheap
  • +1M token context window with effort parameter (low/medium/high/xhigh)
  • +Self-verification behavior and lower hallucination/sycophancy rates than Sonnet 4.6
  • +Deliberately low offensive-cyber capability with default-on safeguards โ€” a safety plus for most deployments
  • +HIPAA eligible with ephemeral data handling from day one
Limitations
  • !Released 2026-06-30 โ€” independent benchmark replication and production track record still limited
  • !Updated tokenizer maps identical input to roughly 1.0-1.35x more tokens than Sonnet 4.6, partially offsetting per-token price parity
  • !Google Vertex AI availability still pending at evaluation time (AWS and Microsoft Foundry live)
  • !Intentionally weak at sanctioned cybersecurity work โ€” use Opus tier for authorized cyber tasks
  • !Knowledge cutoff and max output tokens not yet published
  • !Opus 4.8 still leads on the hardest agentic coding (69.2% vs 63.2% SWE-bench Pro)
Metadata
pricing
input: $3.00 per 1M tokens
output: $15.00 per 1M tokens
notes: Introductory pricing $2/$10 per 1M through 2026-08-31, then standard $3/$15 (same as Sonnet 4.6). Prompt caching (cache reads at 0.1x input) and 50% Batch API discount apply. Note the updated tokenizer yields ~1.0-1.35x more tokens for identical input vs Sonnet 4.6.
last verified: 2026-07-09
context window: 1000000
languages
0: English
1: Spanish
2: French
3: German
4: Italian
5: Portuguese
6: Japanese
7: Korean
8: Chinese
9: Arabic
10: Hindi
modalities
0: text
1: image (input)
2: document
3: computer-use
api endpoint: https://api.anthropic.com/v1/messages
api model id: claude-sonnet-5
open source: false
architecture: Transformer-based with Constitutional AI alignment, effort parameter (low/medium/high/xhigh), self-verification, and an updated tokenizer
parameters: Not disclosed
knowledge cutoff: Not published at launch (as of 2026-07-09)
release date: 2026-06-30

Use Case Ratings

code generation

72.7% SWE-bench Verified and 80.4% Terminal-Bench 2.1 โ€” near-Opus agentic coding at Sonnet pricing. The new best default for production coding agents.

customer support

The Sonnet support sweet spot, now smarter at the same price; use effort 'low' for high-volume tiers. Intro pricing makes migration trials cheap through August.

content creation

Strong long-form and marketing content with fast turnaround; Opus/Fable tiers still lead on the most nuanced pieces.

data analysis

1M context for large datasets with GDPval-AA v2 knowledge-work performance that edges Opus 4.8, at workhorse pricing.

research assistant

1M context, strict BrowseComp improvement over Sonnet 4.6, and strong synthesis. Opus/Fable preferred for the hardest research.

legal compliance

Anthropic cites legal research and insurance workflows as target use cases; HIPAA eligible with 1M context for contract repositories.

healthcare

HIPAA eligible with strong privacy controls; real-world clinical validation is still early nine days post-launch.

financial analysis

Near-Opus reasoning (57.4% HLE with tools) at predictable cost; escalate the hardest modeling to Opus 4.8 or Fable 5.

education

Fast, patient explanations at a price point that scales; default model on Free/Pro plans broadens reach.

creative writing

Capable creative writing with good narrative flow; Opus tier produces more distinctive prose.