| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | eng-gmq/opus...2022-03-17 | 47.7 | facebook/m2m100_1.2B | 43.6 | 4.1 |
| 1 | flores200-devtest | compare | eng-gmq/opus...2022-03-17 | 47.7 | facebook/m2m100_1.2B | 43.6 | 4.1 |
| 2 | ntrex128 | compare | eng-gmq/opus...2022-03-17 | 37.9 | facebook/nllb-200-3.3B | 37.2 | 0.7 |
| 3 | tatoeba-test-v2020-07-28 | compare | eng-dan/opus-2021-02-19 | 61.7 | facebook/nllb-200-3.3B | 60 | 1.7 |
| 4 | tatoeba-test-v2021-03-30 | compare | eng-dan/opus-2021-02-19 | 61.8 | facebook/nllb-200-3.3B | 60.2 | 1.6 |
| 5 | tatoeba-test-v2021-08-07 | compare | eng-dan/opus-2021-02-19 | 61.8 | facebook/nllb-200-3.3B | 60.3 | 1.5 |
| average | 53.1 | 50.8 | 2.3 |