| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | sla-fra/opus...2022-09-15 | 34.9 | facebook/nll...illed-1.3B | 33.8 | 1.1 |
| 1 | flores200-devtest | compare | sla-deu+eng+...2024-05-30 | 35.4 | facebook/nll...illed-1.3B | 33.8 | 1.6 |
| 2 | ntrex128 | compare | sla-deu+eng+...2024-05-30 | 26.8 | facebook/nll...illed-1.3B | 25.9 | 0.9 |
| 3 | tatoeba-test-v2021-03-30 | compare | bg-fr/opus-2020-01-08 | 54.8 | facebook/nll...illed-1.3B | 52.1 | 2.7 |
| 4 | tatoeba-test-v2021-08-07 | compare | bg-fr/opus-2020-01-08 | 54.7 | facebook/nll...illed-1.3B | 52.1 | 2.6 |
| average | 41.3 | 39.5 | 1.8 |