[restart] [share link] select language: [swap] [compare scores] [compare models] [map] [release history] [uploads]

OPUS-MT Dashboard

barchart

Model Scores (comparing between OPUS-MT and external models)

IDBenchmark (bleu)OutputOPUS-MTbleuexternalbleuDiff
0flores101-devtestcompareeng-fra/opus..2022-03-0952.2facebook/nllb-200-3.3B48 4.2
1flores200-devtestcompareeng-fra/opus..2022-03-0952.2facebook/nllb-200-3.3B47.8 4.4
2multi30k_test_2016_flickrcompareeng-fra/opus..2022-03-0952.4facebook/nllb-200-3.3B51.3 1.1
3multi30k_test_2017_flickrcompareeng-fra/opus..2022-03-0952.8facebook/nll..illed-1.3B51.1 1.7
4multi30k_test_2017_mscococompareeng-fra/opus..2022-03-0954.7facebook/nll..illed-1.3B52.3 2.4
5multi30k_test_2018_flickrcompareeng-fra/opus..2022-03-0943.7facebook/nll..illed-1.3B44.2-0.5
6newsdiscusstest2015compareeng-fra/opus..2022-03-0940.3facebook/nll..illed-1.3B38.8 1.5
7newssyscomb2009compareeng-fra/opus..2022-03-0930.7facebook/nllb-200-3.3B32.6-1.9
8newstest2008compareeng-fra/opus..2022-03-0927.6facebook/nllb-200-1.3B28.3-0.7
9newstest2009compareen-fr/opus-2019-12-0430facebook/nllb-200-3.3B30.9-0.9
10newstest2010compareeng-fra/opus..2022-03-0933.5facebook/nll..illed-1.3B33.9-0.4
11newstest2011compareeng-fra/opus..2022-03-0935facebook/nllb-200-3.3B35.8-0.8
12newstest2012compareeng-fra/opus..2022-03-0932.8facebook/nllb-200-3.3B33.4-0.6
13newstest2013compareeng-fra/opus..2022-03-0934.6facebook/nllb-200-3.3B35.2-0.6
14newstest2014compareeng-fra/opus..2022-03-0941.9facebook/nllb-200-3.3B41.6 0.3
15ntrex128showeng-fra/opus..2022-03-0937.337.3
16tatoeba-test-v2020-07-28compareeng-fra/opus..2022-03-0951.7facebook/nll..illed-1.3B50 1.7
17tatoeba-test-v2021-03-30compareeng-fra/opus..2022-03-0952.5facebook/nll..illed-1.3B50.7 1.8
18tatoeba-test-v2021-08-07compareeng-fra/opus..2022-03-0953.2facebook/nllb-200-3.3B51.3 1.9
19tico19-testcompareeng-fra/opus..2022-03-0940.6facebook/nllb-200-3.3B40.5 0.1
average42.542.0 0.5