OPUS-MT Dashboard

Language pair: eng-deu
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: [all benchmarks] average score
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart][scatterplot] [size] [type]

color:
#params:	24M	36M	54M	81M	122M	183M	275M	413M	620M	930M	unknown

orange = OPUS-MT, blue = Tatoeba-MT models, red = HPLT-MT models
green = student models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]

Model Scores (averaged over testsets)

ID	bleu	Model	Size	Link
73	35.5	facebook/wmt19-en-de	?	URL
72	34.6	eng-deu/opus...2021-12-08	243M	zip-file
71	33.1	gsarti/opus-...-big-en-de	?	URL
70	33.1	Rahulrr/lang...odel_en_de	?	URL
69	33.1	gmw-gmw/opus...2022-08-11	212.9M	zip-file
68	33.0	deu+eng+fra+...2024-05-30	225.7M	zip-file
67	33.0	eng-deu/opus-2021-02-22	77.5M	zip-file
66	32.9	eng-deu/opus...2021-04-13	77.5M	zip-file
65	32.9	gmw-deu+eng+...2024-05-30	225.5M	zip-file
64	32.8	gem-deu+eng+...2024-05-30	226.4M	zip-file
63	32.8	facebook/nll...illed-1.3B	1331.2M	URL
62	32.7	eng-deu/opus-2021-02-19	77.5M	zip-file
61	32.6	gmw-deu+eng+...2024-08-18	216.8M	zip-file
60	32.6	facebook/nllb-200-3.3B	3379.2M	URL
59	32.5	deu+eng+fra+...2024-05-30	226.6M	zip-file
58	32.3	facebook/nllb-200-1.3B	1331.2M	URL
57	32.1	teelinsan/opus-mt-eng-deu	?	URL
56	32.0	ine-deu+eng+...2024-08-18	232.9M	zip-file
55	31.9	silsever/opu...lign-en-de	?	URL
54	31.8	ine-deu+eng+...2024-05-30	230.5M	zip-file
53	31.4	en-de/opus-2020-02-26	73.9M	zip-file
52	30.9	en-de/opus-2019-12-18	92.4M	zip-file
51	30.7	deu+eng+fra+...2024-05-30	231M	zip-file
50	30.6	mul-deu+eng+...2024-08-18	236.3M	zip-file
49	30.0	facebook/nll...illed-600M	600M	URL
48	29.9	facebook/m2m100_1.2B	1331.2M	URL
47	29.4	en-de/opus-2019-12-04	92.2M	zip-file
46	28.8	eng-deu+eng+...2021-02-22	75.8M	zip-file
45	28.7	eng-gmw/opus2m-2020-08-01	72.6M	zip-file
44	28.6	eng-gem/opus2m-2020-08-01	73.2M	zip-file
43	28.1	en-de+nl+af+...2019-12-04	77.5M	zip-file
42	27.9	eng-gem/opus-2020-07-26	73.2M	zip-file
41	27.9	en-de+af+fy+...2019-12-04	77.5M	zip-file
40	27.8	eng-gem/opus-2020-07-19	73.2M	zip-file
39	27.7	eng-gem/opus-2020-07-14	73.2M	zip-file
38	27.6	eng-gmw/opus-2020-06-28	72.6M	zip-file
37	27.5	eng-gmw/opus-2020-07-26	72.6M	zip-file
36	27.5	eng-gem/opus-2020-07-06	73M	zip-file
35	27.4	gmw-deu/opus1m-2021-05-16	72M	zip-file
34	27.0	deu+eng+fin+...2021-02-22	66.2M	zip-file
33	26.4	en+de+nl+fy+...2019-12-04	67M	zip-file
32	26.1	gmw-gmw/opus-2021-02-23	62.3M	zip-file
31	26.1	gmw-gmw/opus-2020-10-04	62.3M	zip-file
30	26.1	gmw-gmw/opus-2020-09-26	62.3M	zip-file
29	26.0	eng-gmw/opus...2021-04-10	70.1M	zip-file
28	26.0	mul-deu+eng+...2024-05-30	235.1M	zip-file
27	25.5	gmw-gmw/opus-2020-07-27	62.3M	zip-file
26	25.2	gmw-gmw/opus-2020-07-06	62.3M	zip-file
25	24.8	gem-gem/opus-2021-02-24	63.5M	zip-file
24	24.8	gem-gem/opus-2020-10-04	63.5M	zip-file
23	24.7	gem-gem/opus-2020-09-26	63.5M	zip-file
22	24.5	mul-mul/opus...2024-08-17	247.8M	zip-file
21	24.3	gem-gem/opus-2020-07-06	63.4M	zip-file
20	24.3	gem-gem/opus-2020-07-27	63.5M	zip-file
19	24.0	facebook/m2m100_418M	418M	URL
18	23.6	gem-gem/opus-2020-07-21	63.5M	zip-file
17	23.4	deu+eng+fra+...2024-05-30	240.9M	zip-file
16	23.0	allenai/wmt1...-dist-12-1	?	URL
15	22.4	allenai/wmt1...e-dist-6-1	?	URL
14	22.3	eng-ine/opus2m-2020-08-01	75.5M	zip-file
13	21.9	eng-ine/opus-2020-07-27	75.5M	zip-file
12	21.8	westgermanic...2020-06-21	61.3M	zip-file
11	21.7	eng-ine/opus-2020-07-19	75.5M	zip-file
10	21.2	eng-ine/opus-2020-07-14	75.5M	zip-file
9	21.0	allenai/wmt16-en-de-12-1	?	URL
8	17.7	eng-mul/opus2m-2020-08-01	77M	zip-file
7	17.4	ine-ine/opus-2020-07-27	66.1M	zip-file
6	16.9	eng-mul/opus-2020-07-27	77M	zip-file
5	16.7	ine-ine/opus-2020-07-21	66.1M	zip-file
4	16.4	eng-mul/opus-2020-07-20	77M	zip-file
3	16.0	tatoeba-zero...2020-06-21	63M	zip-file
2	15.9	tatoeba-zero...2020-06-19	63M	zip-file
1	15.6	tatoeba-lowe...2020-06-15	61.3M	zip-file
0	15.3	eng-mul/opus-2020-07-14	77M	zip-file