| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores200-devtest | compare | deu+eng+fra+...2024-05-29 | 4.8 | facebook/nll...illed-1.3B | 6.9 | -2.1 |
| 1 | tatoeba-test-v2020-07-28 | compare | deu+eng+fra+...2024-05-29 | 8.4 | facebook/nllb-200-3.3B | 18.7 | -10.3 |
| 2 | tatoeba-test-v2021-03-30 | compare | deu+eng+fra+...2024-05-29 | 8.2 | facebook/nllb-200-3.3B | 18.5 | -10.3 |
| 3 | tatoeba-test-v2021-08-07 | compare | deu+eng+fra+...2024-05-29 | 8.2 | facebook/nllb-200-3.3B | 18.3 | -10.1 |
| average | 7.4 | 15.6 | -8.2 |