| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | en-is/transl...-hplt_opus | 24.6 | facebook/nllb-200-3.3B | 20.4 | 4.2 |
| 1 | flores200-devtest | compare | en-is/transl...-hplt_opus | 24.6 | facebook/nll...illed-1.3B | 20.3 | 4.3 |
| 2 | newstest2021 | compare | deu+eng+fra+...2024-05-30 | 22.3 | facebook/nll...illed-1.3B | 20.9 | 1.4 |
| 3 | ntrex128 | compare | deu+eng+fra+...2024-05-30 | 24.3 | facebook/nll...illed-1.3B | 22.3 | 2.0 |
| 4 | tatoeba-test-v2020-07-28 | compare | en-is/transl...-hplt_opus | 45.1 | facebook/m2m100_1.2B | 33.1 | 12.0 |
| 5 | tatoeba-test-v2021-03-30 | compare | en-is/transl...-hplt_opus | 45 | facebook/m2m100_1.2B | 33 | 12.0 |
| 6 | tatoeba-test-v2021-08-07 | compare | en-is/transl...-hplt_opus | 45 | facebook/m2m100_1.2B | 33.1 | 11.9 |
| average | 33.0 | 26.2 | 6.8 |