| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | gmw-gmw/opus...2022-08-11 | 26.8 | yhavinga/ul2...nl36-en-nl | 26.9 | -0.1 |
| 1 | flores200-devtest | compare | deu+eng+fra+...2024-05-30 | 27.1 | yhavinga/ul2...nl36-en-nl | 26.9 | 0.2 |
| 2 | ntrex128 | compare | gmw-gmw/opus...2022-08-11 | 34.1 | facebook/nllb-200-1.3B | 33.8 | 0.3 |
| 3 | tatoeba-test-v2020-07-28 | compare | eng-nld/opus-2021-02-18 | 57.4 | gsarti/opus-...base-en-nl | 57.5 | -0.1 |
| 4 | tatoeba-test-v2021-03-30 | compare | eng-nld/opus-2021-02-18 | 56.9 | gsarti/opus-...base-en-nl | 56.9 | 0.0 |
| 5 | tatoeba-test-v2021-08-07 | compare | eng-nld/opus-2021-02-18 | 56.3 | gsarti/opus-...base-en-nl | 56.4 | -0.1 |
| average | 43.1 | 43.1 | 0.0 |