| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | zho-bul/opus-2020-07-03 | 9.1 | facebook/nll...illed-1.3B | 18.1 | -9.0 |
| 1 | flores200-devtest | compare | zho-bul/opus-2020-07-03 | 9.2 | facebook/nll...illed-1.3B | 18.1 | -8.9 |
| 2 | tatoeba-test-v2020-07-28 | show | zho-bul/opus-2020-07-03 | 30.4 | 30.4 | ||
| 3 | tatoeba-test-v2021-03-30 | compare | zho-bul/opus-2020-07-03 | 30 | facebook/nllb-200-3.3B | 28.1 | 1.9 |
| 4 | tatoeba-test-v2021-08-07 | compare | zho-bul/opus-2020-07-03 | 30.4 | facebook/nllb-200-3.3B | 28.1 | 2.3 |
| average | 21.8 | 23.1 | -1.3 |