OPUS-MT Dashboard

Language pair: fra-eng
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: all benchmarks [average score]
Evaluation metric: [bleu][spbleu] chrf [chrf++][comet]
Chart Type: [standard][diff]

blue = OPUS-MT / Tatoeba-MT models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]

Model Scores (comparing between OPUS-MT and external models)

ID	Benchmark (chrf)	Output	OPUS-MT	chrf	external	chrf	Diff
0	flores101-devtest	compare	fra-eng/opus..2022-03-09	0.6935	facebook/nllb-200-3.3B	0.68758	0.006
1	flores200-devtest	compare	fra-eng/opus..2022-03-09	0.6935	facebook/nllb-200-3.3B	0.6897	0.004
2	multi30k_test_2016_flickr	compare	fra-eng/opus..2022-03-09	0.68005	facebook/nll..illed-1.3B	0.68136	-0.001
3	multi30k_test_2017_flickr	compare	fra-eng/opus..2022-03-09	0.70596	facebook/nllb-200-1.3B	0.69104	0.015
4	multi30k_test_2017_mscoco	compare	fra-eng/opus..2022-03-09	0.69356	facebook/nllb-200-3.3B	0.69966	-0.006
5	multi30k_test_2018_flickr	compare	fra-eng/opus..2022-03-09	0.65751	facebook/nllb-200-3.3B	0.65264	0.005
6	newsdiscusstest2015	compare	fra-eng/opus..2022-03-09	0.62603	facebook/nllb-200-3.3B	0.59909	0.027
7	newssyscomb2009	compare	fra-eng/opus..2022-03-09	0.57488	facebook/nllb-200-1.3B	0.56847	0.006
8	newstest2008	compare	fra-eng/opus..2022-03-09	0.5431	facebook/nllb-200-1.3B	0.54295	0.000
9	newstest2009	compare	fra-eng/opus-2021-02-19	0.57119	facebook/nllb-200-3.3B	0.56412	0.007
10	newstest2010	compare	fra-eng/opus..2022-03-09	0.59561	facebook/nllb-200-1.3B	0.59709	-0.001
11	newstest2011	compare	fra-eng/opus..2022-03-09	0.60271	facebook/nllb-200-3.3B	0.59732	0.005
12	newstest2012	compare	fra-eng/opus..2022-03-09	0.59507	facebook/nllb-200-1.3B	0.59323	0.002
13	newstest2013	compare	fra-eng/opus..2022-03-09	0.59691	facebook/nllb-200-1.3B	0.59108	0.006
14	newstest2014	compare	fra-eng/opus..2022-03-09	0.64533	facebook/nllb-200-3.3B	0.64511	0.000
15	tatoeba-test-v2020-07-28	compare	fra-eng/opus..2022-03-09	0.73088	facebook/nllb-200-3.3B	0.73776	-0.007
16	tatoeba-test-v2021-03-30	compare	fra-eng/opus..2022-03-09	0.73444	facebook/nllb-200-3.3B	0.74179	-0.007
17	tatoeba-test-v2021-08-07	compare	fra-eng/opus..2022-03-09	0.73772	facebook/nllb-200-3.3B	0.73885	-0.001
18	tico19-test	compare	fra-eng/opus..2022-03-09	0.63326	facebook/nllb-200-3.3B	0.65213	-0.019
		average		0.648		0.646	0.002