| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | eng-hbs/opus...2021-04-20 | 31.7 | facebook/nll...illed-1.3B | 29.9 | 1.8 |
| 1 | flores200-devtest | compare | deu+eng+fra+...2024-05-30 | 35.6 | facebook/nll...illed-1.3B | 29.9 | 5.7 |
| 2 | ntrex128 | compare | deu+eng+fra+...2024-05-30 | 20.9 | facebook/nll...illed-1.3B | 19.5 | 1.4 |
| 3 | tatoeba-test-v2020-07-28 | compare | eng-hbs/opus...2021-04-20 | 44.9 | facebook/nllb-200-3.3B | 36.8 | 8.1 |
| 4 | tatoeba-test-v2021-03-30 | compare | eng-hbs/opus...2021-04-20 | 44.9 | facebook/nll...illed-1.3B | 36.5 | 8.4 |
| 5 | tatoeba-test-v2021-08-07 | compare | eng-hbs/opus...2021-04-20 | 45.1 | facebook/nllb-200-3.3B | 36.9 | 8.2 |
| average | 37.2 | 31.6 | 5.6 |