HOME » WIKI » Qwen
Qwen
Qwen3
| 모델 |
mmlu |
kmmlu |
mmlu_pro |
gsmk8k |
boolq(kobest) |
copa(kobest) |
wic(kobest) |
hellaswag(kobest) |
sentineg(kobest) |
| meta-llama/Meta-Llama-3.1-8B |
65.03 |
41.02 |
35.46 |
50.95 |
81.48 |
71.70 |
55.63 |
45.20 |
94.96 |
| Qwen/Qwen2.5-7B |
74.18 |
51.70 |
48.31 |
81.88 |
90.53 |
72.80 |
68.89 |
48.80 |
92.19 |
| Qwen/Qwen2.5-14B |
79.77 |
59.49 |
56.82 |
86.35 |
92.95 |
79.50 |
81.75 |
50.00 |
97.98 |
| Qwen/Qwen2.5-32B |
83.26 |
62.81 |
54.25 |
79.38 |
96.23 |
81.40 |
88.02 |
53.00 |
97.48 |
| 모델 |
mmlu |
kmmlu |
mmlu_pro |
gsmk8k |
boolq(kobest) |
copa(kobest) |
wic(kobest) |
hellaswag(kobest) |
sentineg(kobest) |
| Smoothie-Qwen3-30B-A3B |
79.57 |
58.81 |
68.98 |
89.23 |
93.16 |
72.20 |
76.90 |
50.00 |
96.98 |
| Qwen/Qwen3-30B-A3B |
79.60 |
58.70 |
69.12 |
89.54 |
93.09 |
73.60 |
76.90 |
48.40 |
97.23 |
| Smoothie-Qwen3-32B |
81.91 |
64.09 |
70.05 |
73.16 |
94.30 |
79.50 |
82.78 |
51.20 |
97.48 |
| Qwen/Qwen3-32B |
81.90 |
64.14 |
70.22 |
73.46 |
94.30 |
80.80 |
82.54 |
51.00 |
97.98 |
| Qwen/Qwen2.5-32B-Instruct |
83.24 |
60.94 |
68.11 |
82.64 |
96.72 |
82.80 |
87.14 |
50.00 |
96.98 |
Last Modified: 2025/05/01 15:56:14
