| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | ara-ell/opus-2021-02-24 | 16.1 | facebook/nll...illed-1.3B | 19.1 | -3.0 |
| 1 | flores200-devtest | compare | ara-ell/opus-2021-02-24 | 16.1 | facebook/nll...illed-1.3B | 19.2 | -3.1 |
| 2 | tatoeba-test-v2020-07-28 | compare | ara-ell/opus-2021-02-24 | 44.9 | facebook/nllb-200-1.3B | 41.6 | 3.3 |
| 3 | tatoeba-test-v2021-03-30 | compare | ara-ell/opus-2021-02-24 | 44.7 | facebook/nllb-200-1.3B | 41.3 | 3.4 |
| 4 | tatoeba-test-v2021-08-07 | compare | ara-ell/opus-2021-02-24 | 45.1 | facebook/nllb-200-1.3B | 41.6 | 3.5 |
| average | 33.4 | 32.6 | 0.8 |