Qwen
Qwen3
| 모델 | mmlu | kmmlu | mmlu_pro | gsmk8k | boolq(kobest) | copa(kobest) | wic(kobest) | hellaswag(kobest) | sentineg(kobest) |
|---|---|---|---|---|---|---|---|---|---|
| meta-llama/Meta-Llama-3.1-8B | 65.03 | 41.02 | 35.46 | 50.95 | 81.48 | 71.70 | 55.63 | 45.20 | 94.96 |
| Qwen/Qwen2.5-7B | 74.18 | 51.70 | 48.31 | 81.88 | 90.53 | 72.80 | 68.89 | 48.80 | 92.19 |
| Qwen/Qwen2.5-14B | 79.77 | 59.49 | 56.82 | 86.35 | 92.95 | 79.50 | 81.75 | 50.00 | 97.98 |
| Qwen/Qwen2.5-32B | 83.26 | 62.81 | 54.25 | 79.38 | 96.23 | 81.40 | 88.02 | 53.00 | 97.48 |
| 모델 | mmlu | kmmlu | mmlu_pro | gsmk8k | boolq(kobest) | copa(kobest) | wic(kobest) | hellaswag(kobest) | sentineg(kobest) |
|---|---|---|---|---|---|---|---|---|---|
| Smoothie-Qwen3-30B-A3B | 79.57 | 58.81 | 68.98 | 89.23 | 93.16 | 72.20 | 76.90 | 50.00 | 96.98 |
| Qwen/Qwen3-30B-A3B | 79.60 | 58.70 | 69.12 | 89.54 | 93.09 | 73.60 | 76.90 | 48.40 | 97.23 |
| Smoothie-Qwen3-32B | 81.91 | 64.09 | 70.05 | 73.16 | 94.30 | 79.50 | 82.78 | 51.20 | 97.48 |
| Qwen/Qwen3-32B | 81.90 | 64.14 | 70.22 | 73.46 | 94.30 | 80.80 | 82.54 | 51.00 | 97.98 |
| Qwen/Qwen2.5-32B-Instruct | 83.24 | 60.94 | 68.11 | 82.64 | 96.72 | 82.80 | 87.14 | 50.00 | 96.98 |
Last Modified: 2025/05/01 15:56:14
이 글의 비용을 후원할 수 있으며, 후원자에게 다양한 혜택을 제공할 예정입니다.