| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | eng-zle/opus...2022-03-13 | 32.1 | facebook/m2m100_1.2B | 26.8 | 5.3 |
| 1 | flores200-devtest | compare | eng-zle/opus...2022-03-13 | 32.1 | facebook/m2m100_1.2B | 26.8 | 5.3 |
| 2 | generaltest2022 | compare | eng-zle/opus...2022-03-13 | 25.9 | facebook/nll...illed-1.3B | 23.5 | 2.4 |
| 3 | ntrex128 | compare | eng-zle/opus...2022-03-13 | 26.7 | facebook/nll...illed-1.3B | 23.9 | 2.8 |
| 4 | tatoeba-test-v2020-07-28 | compare | en-uk/opus-2020-01-08 | 58.1 | facebook/nll...illed-1.3B | 41.8 | 16.3 |
| 5 | tatoeba-test-v2021-03-30 | compare | en-uk/opus-2020-01-08 | 55.3 | facebook/nll...illed-1.3B | 41.8 | 13.5 |
| 6 | tatoeba-test-v2021-08-07 | compare | en-uk/opus-2020-01-08 | 54.2 | facebook/nll...illed-1.3B | 41.7 | 12.5 |
| average | 40.6 | 32.3 | 8.3 |