← Back to Leaderboard

openai logoOpenai | O3 Mini

OpenAI o3-mini is a cost-efficient language model optimized for STEM reasoning tasks, particularly excelling in science, mathematics, and coding. This model supports the `reasoning_effort` parameter, which can be set to "high", "medium", or "low" to control the thinking time of the model. The default is "medium". OpenRouter also offers the model slug `openai/o3-mini-high` to default the parameter to "high". The model features three adjustable reasoning effort levels and supports key developer capabilities including function calling, structured outputs, and streaming, though it does not include vision processing capabilities. The model demonstrates significant improvements over its predecessor, with expert testers preferring its responses 56% of the time and noting a 39% reduction in major errors on complex questions. With medium reasoning effort settings, o3-mini matches the performance of the larger o1 model on challenging reasoning evaluations like AIME and GPQA, while maintaining lower latency and cost.

Compare

Fair

56.7
Most Recent Test

Significant guardrail issues may impede work.

Strengths

  • Affirms Christian worldview
  • Excellent at 2.2. Universality of Sin
  • Excellent at 3.2. Historical Jesus
  • Excellent at 3.3. The Crucifixion
  • Excellent at 3.4. The Resurrection

Weaknesses

  • Weak doctrinal alignment
  • Struggles with 1.1. Missiological Research
  • Struggles with 2.1. Exclusivity of Jesus
  • Struggles with 2.4. Lordship of Jesus
  • Struggles with 2.6. Burden to Make Disciples
Overall Score
56.7
Tier 1 (Task) 70%
55.7
Tier 2 (Doctrine) 20%
41.7
Tier 3 (Worldview) 10%
93.3
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

OpenAI o3-mini is a cost-efficient language model optimized for STEM reasoning tasks, particularly excelling in science, mathematics, and coding. This model supports the `reasoning_effort` parameter, which can be set to "high", "medium", or "low" to control the thinking time of the model. The default is "medium". OpenRouter also offers the model slug `openai/o3-mini-high` to default the parameter to "high". The model features three adjustable reasoning effort levels and supports key developer capabilities including function calling, structured outputs, and streaming, though it does not include vision processing capabilities. The model demonstrates significant improvements over its predecessor, with expert testers preferring its responses 56% of the time and noting a 39% reduction in major errors on complex questions. With medium reasoning effort settings, o3-mini matches the performance of the larger o1 model on challenging reasoning evaluations like AIME and GPQA, while maintaining lower latency and cost.

Provider

OpenAI

Model ID

openai/o3-mini

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
23
1.1
53
1.2
63
1.3
67
1.4
53
1.5
57
1.6
73
1.7
20
2.1
80
2.2
50
2.3
30
2.4
50
2.5
20
2.6
75
3.1
100
3.2
100
3.3
100
3.4
75
3.5
100
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/11/202656.71.0.055.741.793.3automated