[restart] [share link] [json] select language: [swap] [compare scores] [compare models] [map] [release history] [uploads]

OPUS-MT Dashboard

Model Scores (comparing between OPUS-MT and external models)

IDBenchmark (chrf++)OutputOPUS-MTchrf++externalchrf++Diff
0flores101-devtestcompareeng-fra/opus...2022-03-090.70683facebook/nllb-200-3.3B0.673640.033
1flores200-devtestcompareeng-fra/opus...2022-03-090.70683facebook/nllb-200-3.3B0.672220.035
2multi30k_test_2016_flickrcompareeng-fra/opus...2022-03-090.71176facebook/nllb-200-3.3B0.697230.015
3multi30k_test_2017_flickrcompareeng-fra/opus...2022-03-090.71356facebook/nll...illed-1.3B0.70110.012
4multi30k_test_2017_mscococomparegem-fra+ita+...2024-08-170.73235facebook/nll...illed-1.3B0.70610.026
5multi30k_test_2018_flickrcompareeng-fra/opus...2022-03-090.64932facebook/nll...illed-1.3B0.645390.004
6newsdiscusstest2015compareeng-fra/opus...2022-03-090.6263facebook/nll...illed-1.3B0.612070.014
7newssyscomb2009compareeng-fra/opus...2022-03-090.56209facebook/nllb-200-3.3B0.56756-0.005
8newstest2008comparegem-fra+ita+...2024-08-170.53021facebook/nllb-200-1.3B0.528960.001
9newstest2009comparegmw-deu+eng+...2024-05-300.5531facebook/nllb-200-3.3B0.5537-0.001
10newstest2010compareeng-fra/opus...2022-03-090.5771facebook/nll...illed-1.3B0.575850.001
11newstest2011compareeng-fra/opus...2022-03-090.59055facebook/nllb-200-3.3B0.59064-0.000
12newstest2012compareeng-fra/opus...2022-03-090.57134facebook/nllb-200-3.3B0.570690.001
13newstest2013compareeng-fra/opus...2022-03-090.57459facebook/nllb-200-3.3B0.57461-0.000
14newstest2014compareeng-fra/opus...2022-03-090.64497facebook/nllb-200-3.3B0.638040.007
15ntrex128compareeng-fra/opus...2022-03-090.6055facebook/nll...illed-1.3B0.587680.018
16tatoeba-test-v2020-07-28compareeng-fra/opus...2022-03-090.67298facebook/nll...illed-1.3B0.656840.016
17tatoeba-test-v2021-03-30compareeng-fra/opus...2022-03-090.67987facebook/nll...illed-1.3B0.662620.017
18tatoeba-test-v2021-08-07compareeng-fra/opus...2022-03-090.68676facebook/nllb-200-3.3B0.665930.021
19tico19-testcompareeng-fra/opus...2022-03-090.6069facebook/nllb-200-3.3B0.61946-0.013
average0.6350.6250.010