| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | zls-zle/opus...2022-03-16 | 22.9 | facebook/m2m100_1.2B | 22.3 | 0.6 |
| 1 | flores200-devtest | compare | zls-zle/opus...2022-03-16 | 22.9 | facebook/m2m100_1.2B | 22.3 | 0.6 |
| 2 | ntrex128 | compare | zls-zle/opus...2022-03-23 | 20.2 | facebook/nllb-200-1.3B | 18.4 | 1.8 |
| 3 | tatoeba-test-v2021-03-30 | compare | zls-zle/opus...2022-03-16 | 53.5 | facebook/nll...illed-1.3B | 52.7 | 0.8 |
| 4 | tatoeba-test-v2021-08-07 | compare | zls-zle/opus...2022-03-16 | 53.4 | facebook/nll...illed-1.3B | 52.7 | 0.7 |
| average | 34.6 | 33.7 | 0.9 |