| ID | Benchmark (spbleu) | Output | OPUS-MT | spbleu | external | spbleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | sla-spa/opus...2022-09-15 | 26.3 | facebook/nll...illed-1.3B | 25.3 | 1.000 |
| 1 | flores200-devtest | compare | sla-deu+eng+...2024-05-30 | 27.4 | facebook/nll...illed-1.3B | 25.3 | 2.100 |
| 2 | newssyscomb2009 | compare | sla-deu+eng+...2024-05-30 | 32.1 | facebook/m2m100_1.2B | 31.9 | 0.200 |
| 3 | newstest2008 | compare | sla-deu+eng+...2024-05-30 | 29.9 | facebook/nllb-200-3.3B | 29.3 | 0.600 |
| 4 | newstest2009 | compare | sla-deu+eng+...2024-05-30 | 30.6 | facebook/m2m100_1.2B | 30.4 | 0.200 |
| 5 | newstest2010 | compare | sla-deu+eng+...2024-05-30 | 35.4 | facebook/nll...illed-1.3B | 34.6 | 0.800 |
| 6 | newstest2011 | compare | sla-deu+eng+...2024-05-30 | 35.1 | facebook/m2m100_1.2B | 34.2 | 0.900 |
| 7 | newstest2012 | compare | sla-deu+eng+...2024-05-30 | 34.2 | facebook/nllb-200-3.3B | 33.2 | 1.000 |
| 8 | newstest2013 | compare | sla-deu+eng+...2024-05-30 | 34.8 | facebook/nllb-200-3.3B | 33.6 | 1.200 |
| 9 | ntrex128 | compare | sla-deu+eng+...2024-05-30 | 33.4 | facebook/nll...illed-1.3B | 32.2 | 1.200 |
| 10 | tatoeba-test-v2021-08-07 | compare | sla-deu+eng+...2024-05-30 | 57.3 | facebook/nllb-200-1.3B | 53.5 | 3.800 |
| average | 34.227 | 33.045 | 1.182 |