OPUS-MT Dashboard

Language pair: deu-eng [all languages]
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: [all benchmarks] [average score] newstest2021
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart][scatterplot] [size] [type]

orange = OPUS-MT, blue = Tatoeba-MT models, red = HPLT-MT models
green = student models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]

Model Scores (bleu scores on the "newstest2021" testset)

ID	bleu	Output	Model	Size	Link
59	49.3	show	gmw-eng/opus...2024-08-17	232.4M	zip-file
58	49.1	show	gmw-deu+eng+...2024-05-30	225.5M	zip-file
57	48.5	show	gmw-gmw/opus...2022-08-11	212.9M	zip-file
56	48.2	show	deu+eng+fra+...2024-05-30	225.7M	zip-file
55	48.2	show	gmw-deu+eng+...2024-08-18	216.8M	zip-file
54	47.9	show	deu+eng+fra+...2024-05-30	226.6M	zip-file
53	47.9	show	gem-deu+eng+...2024-05-30	226.4M	zip-file
52	47.5	show	deu-eng/opus-2021-02-12	77.5M	zip-file
51	47.2	show	deu-eng/opus-2020-07-03	77.5M	zip-file
50	47.0	show	deu-eng/opus-2021-02-22	77.5M	zip-file
49	46.9	show	deu-eng/opus-2021-02-19	77.5M	zip-file
48	46.9	show	ine-deu+eng+...2024-05-30	230.5M	zip-file
47	46.9	show	ine-deu+eng+...2024-08-18	232.9M	zip-file
46	46.3	show	ine-eng/opus...2024-08-17	235.7M	zip-file
45	46.0	show	gem-eng/opus...2024-08-17	233M	zip-file
44	45.9	show	deu-eng/opus...2021-04-30	77.5M	zip-file
43	45.5	show	mul-deu+eng+...2024-08-18	236.3M	zip-file
42	45.2	show	deu+eng+fra+...2024-05-30	231M	zip-file
41	44.2	show	facebook/nllb-200-1.3B	1331.2M	URL
40	44.1	show	facebook/nll...illed-1.3B	1331.2M	URL
39	43.9	show	mul-eng/opus...2024-08-17	237.2M	zip-file
38	43.7	show	gem-eng/opus4m-2020-08-12	73.2M	zip-file
37	43.7	show	facebook/nllb-200-3.3B	3379.2M	URL
36	43.6	show	gem-eng/opus2m-2020-08-01	73.2M	zip-file
35	43.4	show	mul-deu+eng+...2024-05-30	235.1M	zip-file
34	43.1	show	gmw-eng/opus4m-2020-08-12	72.6M	zip-file
33	42.6	show	facebook/nll...illed-600M	600M	URL
32	42.6	show	gem-eng/opus-2020-07-26	73.2M	zip-file
31	42.5	show	gmw-eng/opus2m-2020-08-01	72.6M	zip-file
30	42.3	show	deu+eng+fin+...2021-02-22	75.8M	zip-file
29	42.3	show	gem-eng/opus-2020-07-14	73.2M	zip-file
28	42.2	show	gmw-eng/opus...2021-05-01	72.5M	zip-file
27	41.7	show	gem-eng/opus-2020-07-04	72.9M	zip-file
26	41.5	show	gmw-eng/opus...2021-09-30	72.5M	zip-file
25	41.4	show	gmw-eng/opus-2020-07-26	72.6M	zip-file
24	41.4	show	gmw-eng/opus-2020-06-27	72.6M	zip-file
23	40.4	show	deu+eng+fra+...2024-05-30	240.9M	zip-file
22	40.1	show	deu+eng+fin+...2021-02-22	66.2M	zip-file
21	40.0	show	gmw-gmw/opus-2021-02-23	62.3M	zip-file
20	40.0	show	gmw-gmw/opus-2020-10-04	62.3M	zip-file
19	39.8	show	gmw-gmw/opus-2020-09-26	62.3M	zip-file
18	39.3	show	ine-eng/opus4m-2020-08-12	75.4M	zip-file
17	39.2	show	gmw-gmw/opus-2020-07-27	62.3M	zip-file
16	38.9	show	mul-mul/opus...2024-08-17	247.8M	zip-file
15	38.7	show	gmw-gmw/opus-2020-07-06	62.3M	zip-file
14	38.4	show	ine-eng/opus-2020-07-26	75.4M	zip-file
13	38.4	show	ine-eng/opus2m-2020-08-01	75.4M	zip-file
12	38.0	show	ine-eng/opus-2020-07-19	75.4M	zip-file
11	37.7	show	gem-gem/opus-2020-07-06	63.4M	zip-file
10	37.6	show	gem-gem/opus-2020-10-04	63.5M	zip-file
9	37.6	show	gem-gem/opus-2021-02-24	63.5M	zip-file
8	37.4	show	ine-eng/opus-2020-07-14	75.4M	zip-file
7	37.0	show	gem-gem/opus-2020-09-26	63.5M	zip-file
6	36.8	show	gem-gem/opus-2020-07-27	63.5M	zip-file
5	35.9	show	gem-gem/opus-2020-07-21	63.5M	zip-file
4	33.4	show	westgermanic...2020-06-21	61.3M	zip-file
3	32.5	show	mul-eng/opus2m-2020-08-12	77.1M	zip-file
2	32.4	show	mul-eng/opus-2020-07-20	77.1M	zip-file
1	31.9	show	mul-eng/opus-2020-07-14	77.1M	zip-file
0	24.2	show	tatoeba-lowe...2020-06-15	61.3M	zip-file