| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | zho-sla/opus...2022-09-14 | 1.1 | facebook/nllb-200-3.3B | 11.1 | -10.0 |
| 1 | flores200-devtest | compare | mul-mul/opus...2024-08-17 | 2.3 | facebook/nllb-200-3.3B | 11.1 | -8.8 |
| 2 | tatoeba-test-v2021-03-30 | compare | zho-sla/opus...2022-09-14 | 16.4 | facebook/nllb-200-3.3B | 21.9 | -5.5 |
| 3 | tatoeba-test-v2021-08-07 | compare | zho-sla/opus...2022-09-14 | 16.5 | facebook/nllb-200-3.3B | 22 | -5.5 |
| average | 9.1 | 16.5 | -7.4 |