[restart] [share link] select language: [swap] [compare scores] [compare models] [map] [release history] [uploads]

OPUS-MT Dashboard

Model Scores (comparing between OPUS-MT and external models)

IDBenchmark (bleu)OutputOPUS-MTbleuexternalbleuDiff
0flores101-devtestcompareeng-zle/opus..2022-03-1332.7facebook/wmt19-en-ru30.4 2.3
1flores200-devtestcompareeng-zle/opus..2022-03-1332.7facebook/wmt19-en-ru30.4 2.3
2generaltest2022compareeng-zle/opus..2022-03-1331.1facebook/nll..illed-1.3B28.6 2.5
3newstest2012compareeng-zle/opus..2022-03-1336.8facebook/nllb-200-3.3B36.7 0.1
4newstest2013compareeng-zle/opus..2022-03-1326.9facebook/wmt19-en-ru29.7-2.8
5newstest2014compareeng-zle/opus..2022-03-1343.5facebook/wmt19-en-ru43.1 0.4
6newstest2015compareeng-zle/opus..2022-03-1334.9facebook/wmt19-en-ru40.3-5.4
7newstest2016compareeng-zle/opus..2022-03-1333.1facebook/wmt19-en-ru35.8-2.7
8newstest2017compareeng-zle/opus..2022-03-1337.3facebook/wmt19-en-ru42.2-4.9
9newstest2018compareeng-zle/opus..2022-03-1332.9facebook/wmt19-en-ru34.9-2.0
10newstest2019compareeng-zle/opus..2022-03-1331.8facebook/wmt19-en-ru33.4-1.6
11newstest2020compareeng-zle/opus..2022-03-1325.5facebook/wmt19-en-ru23.8 1.7
12newstest2021compareeng-zle/opus..2022-03-1339.8facebook/nllb-200-3.3B37.5 2.3
13ntrex128compareeng-zle/opus..2022-03-1334.6facebook/nll..illed-1.3B29.2 5.4
14tatoeba-test-v2020-07-28compareen-ru/opus-2020-02-1148.8facebook/nllb-200-3.3B47.2 1.6
15tatoeba-test-v2021-03-30compareen-ru/opus-2020-02-1147.6facebook/nllb-200-3.3B46.6 1.0
16tatoeba-test-v2021-08-07compareen-ru/opus-2020-02-1146.8facebook/nllb-200-3.3B46.2 0.6
17tico19-testcompareeng-zle/opus..2022-03-1333.7facebook/nllb-200-3.3B32 1.7
average36.136.0 0.1

GitHub: [OPUS] [OPUS-MT] [benchmarks] [leaderboards] [dashboard]