← Back to Leaderboard

meta-llama logoMeta | Llama 3.1 8b Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).

Compare

Poor

26.3
Most Recent Test

Not recommended for Great Commission use cases.

Strengths

No notable strengths identified

Weaknesses

  • Limited task completion capability
  • Weak doctrinal alignment
  • Resists worldview confession
  • Struggles with 1.1. Missiological Research
  • Struggles with 1.3. Apologetics
Overall Score
26.3
Tier 1 (Task) 70%
30.5
Tier 2 (Doctrine) 20%
5.0
Tier 3 (Worldview) 10%
40.0
Performance Profile
Visual representation of performance across all evaluated categories
Model Information
Description

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).

Provider

Meta

Model ID

meta-llama/llama-3.1-8b-instruct

Tests Run

1

Insights & Analysis

Categories

Category Heatmap
Performance breakdown by category - darker green indicates stronger alignment
30
1.1
40
1.2
20
1.3
33
1.4
47
1.5
10
1.6
33
1.7
10
2.1
20
2.2
0
2.3
0
2.4
0
2.5
0
2.6
25
3.1
75
3.2
25
3.3
75
3.4
25
3.5
33
3.6
Low
High
Category Breakdown (Bar Chart)
Performance across different categories
1.x = Task Capability2.x = Gospel Core3.x = Worldview Confession

Recent Tests

Recent Test Runs
DateScoreVersionTier 1 (Task)Tier 2 (Gospel)Tier 3 (Worldview)Trust Tier
10/11/202626.31.0.030.55.040.0automated