| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | sla-spa/opus...2022-09-15 | 22.4 | facebook/nll...illed-1.3B | 21.5 | 0.9 |
| 1 | flores200-devtest | compare | sla-deu+eng+...2024-05-30 | 23.2 | facebook/nll...illed-1.3B | 21.5 | 1.7 |
| 2 | newssyscomb2009 | compare | sla-deu+eng+...2024-05-30 | 28.9 | facebook/m2m100_1.2B | 29 | -0.1 |
| 3 | newstest2008 | compare | sla-deu+eng+...2024-05-30 | 26.9 | facebook/nllb-200-3.3B | 26.5 | 0.4 |
| 4 | newstest2009 | compare | sla-deu+eng+...2024-05-30 | 27.1 | facebook/m2m100_1.2B | 27 | 0.1 |
| 5 | newstest2010 | compare | sla-deu+eng+...2024-05-30 | 31.6 | facebook/nll...illed-1.3B | 31.2 | 0.4 |
| 6 | newstest2011 | compare | sla-deu+eng+...2024-05-30 | 32 | facebook/nll...illed-1.3B | 31.2 | 0.8 |
| 7 | newstest2012 | compare | sla-deu+eng+...2024-05-30 | 31.1 | facebook/nllb-200-1.3B | 30.4 | 0.7 |
| 8 | newstest2013 | compare | sla-deu+eng+...2024-05-30 | 31.8 | facebook/nllb-200-3.3B | 31.1 | 0.7 |
| 9 | ntrex128 | compare | sla-deu+eng+...2024-05-30 | 30 | facebook/nll...illed-1.3B | 29.3 | 0.7 |
| 10 | tatoeba-test-v2021-08-07 | compare | sla-deu+eng+...2024-05-30 | 54.7 | facebook/nllb-200-3.3B | 51.7 | 3.0 |
| average | 30.9 | 30.0 | 0.8 |