| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | en-ga/transl...-hplt_opus | 34 | facebook/nll...illed-1.3B | 26.4 | 7.6 |
| 1 | flores200-devtest | compare | en-ga/transl...-hplt_opus | 34 | facebook/nll...illed-1.3B | 26.4 | 7.6 |
| 2 | ntrex128 | compare | en-ga/transl...-hplt_opus | 26 | facebook/nll...illed-1.3B | 23 | 3.0 |
| 3 | tatoeba-test-v2020-07-28 | compare | en-ga/transl...-v1.0-hplt | 44 | facebook/nllb-200-3.3B | 43.6 | 0.4 |
| 4 | tatoeba-test-v2021-03-30 | compare | en-ga/transl...-v1.0-hplt | 44 | facebook/nllb-200-3.3B | 43.3 | 0.7 |
| 5 | tatoeba-test-v2021-08-07 | compare | en-ga/transl...-v1.0-hplt | 43.9 | facebook/nllb-200-3.3B | 43.3 | 0.6 |
| average | 37.6 | 34.3 | 3.3 |