| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | eng-kor/opus...2022-07-28 | 13.7 | facebook/nllb-200-3.3B | 26.7 | -13.0 |
| 1 | flores200-devtest | compare | eng-kor/opus...2022-07-28 | 13.7 | facebook/m2m100_1.2B | 26 | -12.3 |
| 2 | ntrex128 | compare | eng-kor/opus...2021-11-10 | 11.4 | facebook/nllb-200-1.3B | 9.4 | 2.0 |
| 3 | tatoeba-test-v2020-07-28 | compare | eng-kor/opus...2021-11-10 | 13.4 | facebook/m2m100_1.2B | 25 | -11.6 |
| 4 | tatoeba-test-v2021-03-30 | compare | eng-kor/opus...2021-11-10 | 13.4 | facebook/m2m100_1.2B | 25 | -11.6 |
| 5 | tatoeba-test-v2021-08-07 | compare | eng-kor/opus...2021-11-10 | 13.4 | facebook/m2m100_1.2B | 24.9 | -11.5 |
| average | 13.2 | 22.8 | -9.7 |