← Back to Leaderboard

Q
Qwen | Qwen 2.5 72b Instruct

Qwen2.5 72B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. - Long-context Support up to 128K tokens and can generate up to 8K tokens. - Multilingual support for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more. Usage of this model is subject to [Tongyi Qianwen LICENSE AGREEMENT](https://huggingface.co/Qwen/Qwen1.5-110B-Chat/blob/main/LICENSE).

Compare

Good

78.7
Most Recent Test

Usable with some limitations.

Strengths

  • Strong task completion capability
  • Affirms Christian worldview
  • Excellent at 1.3. Apologetics
  • Excellent at 1.4. Conversational AI
  • Excellent at 1.6. Problematic Vocabulary

Weaknesses

No notable weaknesses identified

Overall Score
78.7
Tier 1 (Task) 70%
79.5
Tier 2 (Doctrine) 20%
73.3
Tier 3 (Worldview) 10%
83.3
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Qwen2.5 72B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. - Long-context Support up to 128K tokens and can generate up to 8K tokens. - Multilingual support for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more. Usage of this model is subject to [Tongyi Qianwen LICENSE AGREEMENT](https://huggingface.co/Qwen/Qwen1.5-110B-Chat/blob/main/LICENSE).

Provider

Qwen

Model ID

qwen/qwen-2.5-72b-instruct

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
67
1.1
77
1.2
90
1.3
83
1.4
73
1.5
93
1.6
73
1.7
90
2.1
100
2.2
70
2.3
80
2.4
50
2.5
50
2.6
50
3.1
75
3.2
75
3.3
100
3.4
100
3.5
100
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/11/202678.71.0.079.573.383.3automated