| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores200-devtest | compare | mul-mul/opus...2024-08-17 | 19.2 | facebook/nll...illed-600M | 22.8 | -3.6 |
| 1 | tatoeba-test-v2021-03-30 | compare | mul-mul/opus...2024-08-17 | 41.1 | facebook/nll...illed-1.3B | 52.8 | -11.7 |
| 2 | tatoeba-test-v2021-08-07 | compare | mul-mul/opus...2024-08-17 | 41.1 | facebook/nll...illed-1.3B | 52.9 | -11.8 |
| average | 33.8 | 42.8 | -9.0 |