| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | eng-inc/opus...2021-04-13 | 8.3 | facebook/nllb-200-3.3B | 14.2 | -5.9 |
| 1 | flores200-devtest | compare | deu+eng+fra+...2024-05-30 | 15.4 | facebook/nllb-200-3.3B | 14.4 | 1.0 |
| 2 | ntrex128 | compare | deu+eng+fra+...2024-05-30 | 10.8 | facebook/nllb-200-3.3B | 11.2 | -0.4 |
| 3 | tatoeba-test-v2020-07-28 | compare | en-mr/opus+bt-2020-05-23 | 45.5 | facebook/nll...illed-1.3B | 33.8 | 11.7 |
| 4 | tatoeba-test-v2021-03-30 | compare | en-mr/opus+bt-2020-05-23 | 44.7 | facebook/nll...illed-1.3B | 33.7 | 11.0 |
| 5 | tatoeba-test-v2021-08-07 | compare | en-mr/opus+bt-2020-05-23 | 44.3 | facebook/nll...illed-1.3B | 33.6 | 10.7 |
| 6 | tico19-test | compare | deu+eng+fra+...2024-05-30 | 13.5 | facebook/nll...illed-1.3B | 14.1 | -0.6 |
| average | 26.1 | 22.1 | 3.9 |