| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | hi-en/transl...-hplt_opus | 38.7 | facebook/nllb-200-3.3B | 41.6 | -2.9 |
| 1 | flores200-devtest | compare | inc-eng/opus...2024-08-17 | 40.6 | facebook/nllb-200-3.3B | 41.5 | -0.9 |
| 2 | newstest2014 | compare | inc-eng/opus...2024-08-17 | 32.2 | facebook/nll...illed-1.3B | 33.9 | -1.7 |
| 3 | ntrex128 | compare | inc-eng/opus...2024-08-17 | 34.2 | facebook/nll...illed-1.3B | 37.1 | -2.9 |
| 4 | tatoeba-test-v2021-08-07 | compare | hi-en/transl...-hplt_opus | 54.3 | facebook/nll...illed-1.3B | 56.2 | -1.9 |
| 5 | tico19-test | compare | inc-eng/opus...2024-08-17 | 50.4 | facebook/nllb-200-3.3B | 53.2 | -2.8 |
| average | 41.7 | 43.9 | -2.2 |