| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | ccs-ccs/opus...2021-09-30 | 8 | facebook/nll...illed-1.3B | 12.2 | -4.2 |
| 1 | flores200-devtest | compare | deu+eng+fra+...2024-05-30 | 8.8 | facebook/nllb-200-3.3B | 12.3 | -3.5 |
| 2 | ntrex128 | compare | ccs-ccs/opus...2021-09-30 | 10.6 | facebook/nllb-200-1.3B | 14.1 | -3.5 |
| 3 | tatoeba-test-v2020-07-28 | compare | deu+eng+fra+...2024-05-30 | 18.6 | facebook/nllb-200-3.3B | 16.7 | 1.9 |
| 4 | tatoeba-test-v2021-03-30 | compare | deu+eng+fra+...2024-05-30 | 18.6 | facebook/nllb-200-3.3B | 17.1 | 1.5 |
| 5 | tatoeba-test-v2021-08-07 | compare | deu+eng+fra+...2024-05-30 | 18.6 | facebook/nllb-200-3.3B | 17.3 | 1.3 |
| average | 13.9 | 15.0 | -1.1 |