| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | sla-itc/opus...2022-09-15 | 22.5 | facebook/nllb-200-3.3B | 22.5 | 0.0 |
| 1 | flores200-devtest | compare | sla-itc/opus...2022-09-15 | 22.5 | facebook/nllb-200-3.3B | 22.5 | 0.0 |
| 2 | newssyscomb2009 | compare | sla-itc/opus...2022-09-15 | 26.5 | facebook/m2m100_1.2B | 26.3 | 0.2 |
| 3 | newstest2009 | compare | sla-itc/opus...2022-09-15 | 24.8 | facebook/nll...illed-1.3B | 25.2 | -0.4 |
| 4 | ntrex128 | compare | ces-ita/opus-2021-02-19 | 23.3 | facebook/nll...illed-1.3B | 25.5 | -2.2 |
| 5 | tatoeba-test-v2021-03-30 | compare | sla-itc/opus...2022-09-15 | 46.1 | facebook/nll...illed-1.3B | 48.6 | -2.5 |
| 6 | tatoeba-test-v2021-08-07 | compare | sla-itc/opus...2022-09-15 | 46.2 | facebook/nll...illed-1.3B | 48.7 | -2.5 |
| average | 30.3 | 31.3 | -1.1 |