| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | en-hi/transl...-hplt_opus | 35.1 | facebook/nllb-200-3.3B | 32 | 3.1 |
| 1 | flores200-devtest | compare | en-hi/transl...-hplt_opus | 35.1 | facebook/nllb-200-3.3B | 32 | 3.1 |
| 2 | newstest2014 | compare | en-hi/transl...-hplt_opus | 24.5 | facebook/nllb-200-3.3B | 24.1 | 0.4 |
| 3 | ntrex128 | compare | en-hi/transl...-hplt_opus | 28.2 | facebook/nllb-200-3.3B | 26.7 | 1.5 |
| 4 | tatoeba-test-v2021-08-07 | compare | en-hi/transl...-hplt_opus | 30.4 | facebook/nllb-200-3.3B | 31.4 | -1.0 |
| 5 | tico19-test | compare | en-hi/transl...-hplt_opus | 43.7 | facebook/nllb-200-3.3B | 42.4 | 1.3 |
| average | 32.8 | 31.4 | 1.4 |