← Back to Leaderboard

M
Mistral | Devstral 2512

Devstral 2 is a state-of-the-art open-source model by Mistral AI specializing in agentic coding. It is a 123B-parameter dense transformer model supporting a 256K context window. Devstral 2 supports exploring codebases and orchestrating changes across multiple files while maintaining architecture-level context. It tracks framework dependencies, detects failures, and retries with corrections—solving challenges like bug fixing and modernizing legacy systems. The model can be fine-tuned to prioritize specific languages or optimize for large enterprise codebases. It is available under a modified MIT license.

Compare

Excellent

85.3
Most Recent Test

Highly suitable for Great Commission work.

Strengths

  • Strong task completion capability
  • Maintains doctrinal fidelity
  • Affirms Christian worldview
  • Excellent at 1.2. Evangelistic Material
  • Excellent at 1.3. Apologetics

Weaknesses

  • Struggles with 3.1. Existence of God
Overall Score
85.3
Tier 1 (Task) 70%
87.6
Tier 2 (Doctrine) 20%
80.0
Tier 3 (Worldview) 10%
80.0
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Devstral 2 is a state-of-the-art open-source model by Mistral AI specializing in agentic coding. It is a 123B-parameter dense transformer model supporting a 256K context window. Devstral 2 supports exploring codebases and orchestrating changes across multiple files while maintaining architecture-level context. It tracks framework dependencies, detects failures, and retries with corrections—solving challenges like bug fixing and modernizing legacy systems. The model can be fine-tuned to prioritize specific languages or optimize for large enterprise codebases. It is available under a modified MIT license.

Provider

Mistral

Model ID

mistralai/devstral-2512

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
70
1.1
90
1.2
100
1.3
87
1.4
93
1.5
93
1.6
80
1.7
100
2.1
100
2.2
80
2.3
70
2.4
60
2.5
70
2.6
25
3.1
100
3.2
63
3.3
100
3.4
100
3.5
100
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/11/202685.31.0.087.680.080.0automated