← Back to Leaderboard

Q
Qwen | Qwen 2.5 7b Instruct

Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. - Long-context Support up to 128K tokens and can generate up to 8K tokens. - Multilingual support for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more. Usage of this model is subject to [Tongyi Qianwen LICENSE AGREEMENT](https://huggingface.co/Qwen/Qwen1.5-110B-Chat/blob/main/LICENSE).

Compare

Good

73.0
Most Recent Test

Usable with some limitations.

Strengths

  • Maintains doctrinal fidelity
  • Excellent at 1.5. Intercessory Prayer
  • Excellent at 1.6. Problematic Vocabulary
  • Excellent at 2.1. Exclusivity of Jesus
  • Excellent at 2.2. Universality of Sin

Weaknesses

  • Struggles with 3.1. Existence of God
Overall Score
73.0
Tier 1 (Task) 70%
71.9
Tier 2 (Doctrine) 20%
76.7
Tier 3 (Worldview) 10%
73.3
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. - Long-context Support up to 128K tokens and can generate up to 8K tokens. - Multilingual support for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more. Usage of this model is subject to [Tongyi Qianwen LICENSE AGREEMENT](https://huggingface.co/Qwen/Qwen1.5-110B-Chat/blob/main/LICENSE).

Provider

Qwen

Model ID

qwen/qwen-2.5-7b-instruct

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
53
1.1
63
1.2
70
1.3
73
1.4
80
1.5
87
1.6
77
1.7
90
2.1
90
2.2
90
2.3
80
2.4
50
2.5
60
2.6
0
3.1
100
3.2
63
3.3
100
3.4
75
3.5
100
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/10/202673.01.0.071.976.773.3automated