| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores200-devtest | compare | afa-art/opus...2021-09-30 | 14.6 | facebook/nllb-200-1.3B | 20.1 | -5.5 |
| 1 | tatoeba-test-v2020-07-28 | compare | afa-art/opus...2021-09-30 | 36.6 | facebook/nllb-200-3.3B | 51.4 | -14.8 |
| 2 | tatoeba-test-v2021-03-30 | compare | afa-art/opus...2021-09-30 | 37 | facebook/nllb-200-3.3B | 51.1 | -14.1 |
| 3 | tatoeba-test-v2021-08-07 | compare | afa-art/opus...2021-09-30 | 36.8 | facebook/nllb-200-3.3B | 50.9 | -14.1 |
| average | 31.2 | 43.4 | -12.1 |