| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | eng-hun/opus...2022-02-25 | 29.6 | facebook/m2m100_1.2B | 25.9 | 3.7 |
| 1 | flores200-devtest | compare | eng-hun/opus...2022-02-25 | 29.6 | facebook/m2m100_1.2B | 25.9 | 3.7 |
| 2 | newssyscomb2009 | compare | eng-hun/opus...2022-02-25 | 20.6 | facebook/m2m100_1.2B | 17.9 | 2.7 |
| 3 | newstest2008 | compare | eng-hun/opus...2022-02-25 | 17.9 | facebook/nll...illed-1.3B | 15.7 | 2.2 |
| 4 | newstest2009 | compare | eng-hun/opus...2022-02-25 | 20.3 | NYTK/transla...-128-en-hu | 18.1 | 2.2 |
| 5 | ntrex128 | compare | eng-hun/opus...2022-02-25 | 18.5 | facebook/nllb-200-3.3B | 16.1 | 2.4 |
| 6 | tatoeba-test-v2020-07-28 | compare | eng-hun/opus...2022-02-25 | 40.4 | NYTK/transla...-128-en-hu | 41.3 | -0.9 |
| 7 | tatoeba-test-v2021-03-30 | compare | eng-hun/opus...2022-02-25 | 38.9 | NYTK/transla...-128-en-hu | 39.7 | -0.8 |
| 8 | tatoeba-test-v2021-08-07 | compare | eng-hun/opus...2022-02-25 | 38.7 | NYTK/transla...-128-en-hu | 39.3 | -0.6 |
| average | 28.3 | 26.7 | 1.6 |