| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | zho-eng/opus-2020-07-17 | 20.1 | facebook/nll...illed-1.3B | 22.9 | -2.8 |
| 1 | flores200-devtest | compare | zho-eng/opus-2020-07-17 | 20.2 | facebook/nll...illed-1.3B | 22.9 | -2.7 |
| 2 | tatoeba-test-v2020-07-28 | compare | zho-eng/opus-2020-07-17 | 39.6 | facebook/nllb-200-3.3B | 36.9 | 2.7 |
| 3 | tatoeba-test-v2021-03-30 | compare | zho-eng/opus-2020-07-17 | 39.7 | facebook/nllb-200-3.3B | 37.7 | 2.0 |
| 4 | tatoeba-test-v2021-08-07 | compare | zho-eng/opus-2020-07-17 | 39.7 | facebook/nllb-200-3.3B | 37.1 | 2.6 |
| average | 31.9 | 31.5 | 0.4 |