OPUS-MT Dashboard

Language pair: deu-eng [all languages]
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: [all benchmarks] [average score] multi30k_test_2017_mscoco
Evaluation metric: [bleu][spbleu] chrf [chrf++][comet]
Chart Type: [barchart][scatterplot] [size] [type]

orange = OPUS-MT, blue = Tatoeba-MT models, red = HPLT-MT models
green = student models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]

Model Scores (chrf scores on the "multi30k_test_2017_mscoco" testset)

ID	chrf	Output	Model	Size	Link
74	0.601	show	facebook/nllb-200-3.3B	3379.2M	URL
73	0.600	show	facebook/nllb-200-1.3B	1331.2M	URL
72	0.597	show	facebook/nll...illed-1.3B	1331.2M	URL
71	0.593	show	facebook/wmt19-de-en	?	URL
70	0.580	show	gmw-eng/opus...2024-08-17	232.4M	zip-file
69	0.574	show	allenai/wmt1...en-6-6-big	?	URL
68	0.569	show	gmw-deu+eng+...2024-05-30	225.5M	zip-file
67	0.567	show	deu-eng/opus-2021-02-22	77.5M	zip-file
66	0.566	show	deu-eng/opus-2021-02-19	77.5M	zip-file
65	0.566	show	gem-deu+eng+...2024-05-30	226.4M	zip-file
64	0.565	show	facebook/nll...illed-600M	600M	URL
63	0.564	show	deu-eng/opus...2021-04-30	77.5M	zip-file
62	0.563	show	deu-eng/opus-2020-07-03	77.5M	zip-file
61	0.562	show	deu+eng+fra+...2024-05-30	225.7M	zip-file
60	0.562	show	deu-eng/opus-2021-02-12	77.5M	zip-file
59	0.560	show	de-en/opus-2020-02-26	73.9M	zip-file
58	0.559	show	gmw-deu+eng+...2024-08-18	216.8M	zip-file
57	0.558	show	ine-deu+eng+...2024-05-30	230.5M	zip-file
56	0.557	show	gmw-gmw/opus...2022-08-11	212.9M	zip-file
55	0.556	show	deu+eng+fra+...2024-05-30	226.6M	zip-file
54	0.554	show	ine-eng/opus...2024-08-17	235.7M	zip-file
53	0.554	show	de-en/opus-2019-12-18	92.4M	zip-file
52	0.553	show	ine-deu+eng+...2024-08-18	232.9M	zip-file
51	0.551	show	gem-eng/opus...2024-08-17	233M	zip-file
50	0.540	show	mul-deu+eng+...2024-08-18	236.3M	zip-file
49	0.536	show	deu+eng+fra+...2024-05-30	231M	zip-file
48	0.535	show	allenai/wmt1...n-6-6-base	?	URL
47	0.533	show	facebook/m2m100_1.2B	1331.2M	URL
46	0.532	show	mul-eng/opus...2024-08-17	237.2M	zip-file
45	0.532	show	de-en/opus-2019-12-04	77.5M	zip-file
44	0.530	show	gem-eng/opus4m-2020-08-12	73.2M	zip-file
43	0.529	show	de+af+fy+nl-...2019-12-04	77.5M	zip-file
42	0.528	show	de+nl+af+fy-...2019-12-04	77.5M	zip-file
41	0.527	show	gmw-eng/opus2m-2020-08-01	72.6M	zip-file
40	0.527	show	gem-eng/opus2m-2020-08-01	73.2M	zip-file
39	0.526	show	gmw-eng/opus4m-2020-08-12	72.6M	zip-file
38	0.525	show	mul-deu+eng+...2024-05-30	235.1M	zip-file
37	0.524	show	gem-eng/opus-2020-07-04	72.9M	zip-file
36	0.522	show	deu+eng+fin+...2021-02-22	75.8M	zip-file
35	0.521	show	gem-eng/opus-2020-07-14	73.2M	zip-file
34	0.520	show	gem-eng/opus-2020-07-26	73.2M	zip-file
33	0.519	show	gmw-eng/opus...2021-05-01	72.5M	zip-file
32	0.517	show	gmw-eng/opus-2020-06-27	72.6M	zip-file
31	0.517	show	gmw-eng/opus-2020-07-26	72.6M	zip-file
30	0.508	show	en+de+nl+fy+...2019-12-04	67M	zip-file
29	0.504	show	gmw-eng/opus...2021-09-30	72.5M	zip-file
28	0.500	show	gmw-gmw/opus-2020-09-26	62.3M	zip-file
27	0.499	show	gmw-gmw/opus-2020-10-04	62.3M	zip-file
26	0.499	show	gmw-gmw/opus-2021-02-23	62.3M	zip-file
25	0.499	show	deu+eng+fra+...2024-05-30	240.9M	zip-file
24	0.497	show	deu+eng+fin+...2021-02-22	66.2M	zip-file
23	0.488	show	gmw-gmw/opus-2020-07-27	62.3M	zip-file
22	0.488	show	ine-eng/opus4m-2020-08-12	75.4M	zip-file
21	0.487	show	ine-eng/opus2m-2020-08-01	75.4M	zip-file
20	0.486	show	gmw-gmw/opus-2020-07-06	62.3M	zip-file
19	0.485	show	gem-gem/opus-2021-02-24	63.5M	zip-file
18	0.485	show	gem-gem/opus-2020-10-04	63.5M	zip-file
17	0.480	show	gem-gem/opus-2020-09-26	63.5M	zip-file
16	0.480	show	ine-eng/opus-2020-07-19	75.4M	zip-file
15	0.478	show	ine-eng/opus-2020-07-26	75.4M	zip-file
14	0.478	show	gem-gem/opus-2020-07-27	63.5M	zip-file
13	0.472	show	gem-gem/opus-2020-07-06	63.4M	zip-file
12	0.472	show	ine-eng/opus-2020-07-14	75.4M	zip-file
11	0.469	show	facebook/m2m100_418M	418M	URL
10	0.469	show	mul-mul/opus...2024-08-17	247.8M	zip-file
9	0.468	show	gem-gem/opus-2020-07-21	63.5M	zip-file
8	0.459	show	westgermanic...2020-06-21	61.3M	zip-file
7	0.443	show	mul-eng/opus2m-2020-08-12	77.1M	zip-file
6	0.439	show	mul-eng/opus-2020-07-20	77.1M	zip-file
5	0.432	show	mul-eng/opus-2020-07-14	77.1M	zip-file
4	0.397	show	ine-ine/opus-2020-07-27	66.1M	zip-file
3	0.384	show	ine-ine/opus-2020-07-21	66.1M	zip-file
2	0.380	show	tatoeba-zero...2020-06-21	63M	zip-file
1	0.379	show	tatoeba-zero...2020-06-19	63M	zip-file
0	0.364	show	tatoeba-lowe...2020-06-15	61.3M	zip-file