| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | bul-tur/opus-2020-07-03 | 14.9 | facebook/nll...illed-1.3B | 16.2 | -1.3 |
| 1 | flores200-devtest | compare | bul-tur/opus-2020-07-03 | 14.9 | facebook/nll...illed-1.3B | 16.2 | -1.3 |
| 2 | ntrex128 | compare | bul-tur/opus-2021-02-19 | 12.4 | facebook/nll...illed-1.3B | 12.6 | -0.2 |
| 3 | tatoeba-test-v2020-07-28 | compare | bul-tur/opus-2020-07-03 | 40.7 | facebook/nll...illed-1.3B | 41.1 | -0.4 |
| 4 | tatoeba-test-v2021-03-30 | compare | bul-tur/opus-2020-07-03 | 40.7 | facebook/nll...illed-1.3B | 41.1 | -0.4 |
| 5 | tatoeba-test-v2021-08-07 | compare | bul-tur/opus-2020-07-03 | 40.7 | facebook/nll...illed-1.3B | 41.1 | -0.4 |
| average | 27.4 | 28.0 | -0.7 |