| ID | Benchmark (bleu) | Output | OPUS-MT | bleu | external | bleu | Diff |
|---|---|---|---|---|---|---|---|
| 0 | flores101-devtest | compare | eng-tha/opus...2021-11-06 | 8.8 | facebook/m2m100_1.2B | 8.5 | 0.3 |
| 1 | flores200-devtest | compare | eng-tha/opus...2021-11-06 | 8.8 | facebook/m2m100_1.2B | 8.5 | 0.3 |
| 2 | ntrex128 | compare | eng-tha/opus...2021-11-06 | 10.5 | facebook/nllb-200-3.3B | 6.6 | 3.9 |
| 3 | tatoeba-test-v2020-07-28 | compare | eng-tha/opus...2021-11-06 | 4.8 | facebook/nll...illed-1.3B | 9.3 | -4.5 |
| 4 | tatoeba-test-v2021-03-30 | compare | eng-tha/opus...2021-11-06 | 4.8 | facebook/nll...illed-1.3B | 9.3 | -4.5 |
| 5 | tatoeba-test-v2021-08-07 | compare | eng-tha/opus...2021-11-06 | 4.8 | facebook/nll...illed-1.3B | 9.3 | -4.5 |
| average | 7.1 | 8.6 | -1.5 |