| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores200-devtest | compare | mul-deu+eng+...2024-08-18 | 40 | facebook/nll...illed-1.3B | 45.4 | -5.4 |
| 1 | tatoeba-test-v2020-07-28 | compare | eo-en/opus-2019-12-18 | 71.9 | facebook/nllb-200-3.3B | 59.6 | 12.3 |
| 2 | tatoeba-test-v2021-03-30 | compare | eo-en/opus-2019-12-18 | 66.2 | facebook/nllb-200-3.3B | 60.2 | 6.0 |
| 3 | tatoeba-test-v2021-08-07 | compare | eo-en/opus-2020-05-23 | 62.1 | facebook/nllb-200-3.3B | 59.8 | 2.3 |
| average | 60.1 | 56.2 | 3.8 |