| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | zle-itc/opus...2022-08-03 | 19.4 | facebook/nll...illed-1.3B | 22.2 | -2.8 |
| 1 | flores200-devtest | compare | sla-deu+eng+...2024-05-30 | 19.7 | facebook/nll...illed-1.3B | 22.2 | -2.5 |
| 2 | ntrex128 | compare | sla-deu+eng+...2024-05-30 | 22.9 | facebook/nll...illed-1.3B | 23.3 | -0.4 |
| 3 | tatoeba-test-v2021-03-30 | compare | sla-deu+eng+...2024-05-30 | 52.5 | facebook/nll...illed-1.3B | 56.5 | -4.0 |
| 4 | tatoeba-test-v2021-08-07 | compare | sla-deu+eng+...2024-05-30 | 52.5 | facebook/nll...illed-1.3B | 56.5 | -4.0 |
| average | 33.4 | 36.1 | -2.7 |