| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | itc-itc/opus...2022-08-10 | 38.4 | facebook/nllb-200-1.3B | 38.4 | 0.0 |
| 1 | flores200-devtest | compare | itc-fra+ita+...2024-08-17 | 40.3 | facebook/nllb-200-1.3B | 38.4 | 1.9 |
| 2 | ntrex128 | compare | itc-fra+ita+...2024-08-17 | 28.4 | facebook/nll...illed-1.3B | 28.1 | 0.3 |
| 3 | tatoeba-test-v2020-07-28 | compare | itc-fra+ita+...2024-08-17 | 56.6 | facebook/nll...illed-1.3B | 57.2 | -0.6 |
| 4 | tatoeba-test-v2021-03-30 | compare | itc-fra+ita+...2024-08-17 | 56.4 | facebook/nll...illed-1.3B | 56.7 | -0.3 |
| 5 | tatoeba-test-v2021-08-07 | compare | itc-fra+ita+...2024-08-17 | 56.5 | facebook/nll...illed-1.3B | 56.7 | -0.2 |
| average | 46.1 | 45.9 | 0.2 |