| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | ell-eng/opus...2022-02-25 | 33.9 | facebook/nllb-200-3.3B | 37.1 | -3.2 |
| 1 | flores200-devtest | compare | ell-eng/opus...2022-02-25 | 33.9 | facebook/nllb-200-3.3B | 36.8 | -2.9 |
| 2 | ntrex128 | compare | ell-eng/opus...2022-02-25 | 38.6 | facebook/nllb-200-3.3B | 41.4 | -2.8 |
| 3 | tatoeba-test-v2020-07-28 | compare | ell-eng/opus...2022-02-25 | 70.8 | facebook/nllb-200-1.3B | 68.3 | 2.5 |
| 4 | tatoeba-test-v2021-03-30 | compare | ell-eng/opus...2022-02-25 | 69.6 | facebook/nllb-200-3.3B | 67.2 | 2.4 |
| 5 | tatoeba-test-v2021-08-07 | compare | ell-eng/opus...2022-02-25 | 68.8 | facebook/nllb-200-1.3B | 66.1 | 2.7 |
| average | 52.6 | 52.8 | -0.2 |