OPUS-MT Dashboard

Language pair: fra-deu
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: all benchmarks [average score]
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart][diff]

blue = OPUS-MT / Tatoeba-MT models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]

Model Scores (comparing between OPUS-MT and external models)

ID	Benchmark (bleu)	Output	OPUS-MT	bleu	external	bleu	Diff
0	flores101-devtest	compare	fra-deu/opus...2022-07-22	31.5	facebook/nllb-200-3.3B	26.8	4.7
1	flores200-devtest	compare	fra-deu/opus...2022-07-22	31.5	facebook/nllb-200-3.3B	26.8	4.7
2	generaltest2022	compare	fra-deu/opus...2022-07-22	45.6	facebook/nll...illed-1.3B	38.2	7.4
3	multi30k_test_2016_flickr	compare	fra-deu/opus...2022-07-22	33.1	facebook/nll...illed-1.3B	34.6	-1.5
4	multi30k_test_2017_flickr	compare	fra-deu/opus...2022-07-22	31.5	facebook/nll...illed-1.3B	30	1.5
5	multi30k_test_2017_mscoco	compare	roa-deu+eng+...2024-05-30	26.6	facebook/nllb-200-1.3B	27.5	-0.9
6	multi30k_test_2018_flickr	compare	fra-deu/opus...2022-07-22	25	facebook/nll...illed-1.3B	25.6	-0.6
7	newssyscomb2009	compare	fra-deu/opus...2022-07-22	24.2	facebook/nllb-200-3.3B	21.5	2.7
8	newstest2008	compare	fra-deu/opus...2022-07-22	24.2	facebook/nllb-200-1.3B	21.2	3.0
9	newstest2009	compare	fra-deu/opus...2022-07-22	23.7	facebook/nllb-200-1.3B	21	2.7
10	newstest2010	compare	fra-deu/opus...2022-07-22	24.8	facebook/nllb-200-3.3B	21.5	3.3
11	newstest2011	compare	fra-deu/opus...2022-07-22	24	facebook/nllb-200-3.3B	21.4	2.6
12	newstest2012	compare	fra-deu/opus...2022-07-22	24.9	facebook/nllb-200-3.3B	22.5	2.4
13	newstest2013	compare	fra-deu/opus...2022-07-22	27	facebook/nllb-200-3.3B	24.1	2.9
14	newstest2019	compare	fra-deu/opus...2022-07-22	31.8	facebook/nll...illed-1.3B	26.1	5.7
15	newstest2020	compare	fra-deu/opus...2022-07-22	31.7	facebook/nll...illed-1.3B	26	5.7
16	newstest2021	compare	fra-deu/opus...2022-07-22	41.8	facebook/nllb-200-3.3B	33.8	8.0
17	ntrex128	compare	fra-deu/opus...2022-07-22	24.5	facebook/nllb-200-1.3B	22.4	2.1
18	tatoeba-test-v2020-07-28	compare	fra-deu/opus...2022-07-22	51.8	facebook/nll...illed-1.3B	48.7	3.1
19	tatoeba-test-v2021-03-30	compare	fra-deu/opus...2022-07-22	52	facebook/nll...illed-1.3B	48.9	3.1
20	tatoeba-test-v2021-08-07	compare	fra-deu/opus...2022-07-22	52.1	facebook/nll...illed-1.3B	49.4	2.7
		average		32.5		29.4	3.1