OPUS-MT Dashboard

Language pair: deu-eng
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: [all benchmarks] average score
Evaluation metric: [bleu] spbleu [chrf][chrf++][comet]
Highlighting colors: [model score] [model type] [model size] [model diff]

orange = OPUS-MT, blue = Tatoeba-MT models, red = HPLT-MT models
green = student models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]
include scores of user-contributed translations

Model Scores (averaged over testsets)

ID	spbleu	Model	Size	Link
64	42.725	facebook/wmt19-de-en	?	URL
63	41.293	gmw-eng/opus...2024-08-17	232.4M	zip-file
62	41.097	deu-eng/opus-2021-02-22	77.5M	zip-file
61	41.093	deu-eng/opus-2021-02-12	77.5M	zip-file
60	40.962	deu-eng/opus-2021-02-19	77.5M	zip-file
59	40.803	deu-eng/opus...2021-04-30	77.5M	zip-file
58	40.783	deu-eng/opus-2020-07-03	77.5M	zip-file
57	40.510	facebook/nllb-200-1.3B	1331.2M	URL
56	40.493	facebook/nllb-200-3.3B	3379.2M	URL
55	40.445	facebook/nll...illed-1.3B	1331.2M	URL
54	40.325	gmw-deu+eng+...2024-05-30	225.5M	zip-file
53	40.029	gem-deu+eng+...2024-05-30	226.4M	zip-file
52	39.739	deu+eng+fra+...2024-05-30	225.7M	zip-file
51	39.666	gmw-gmw/opus...2022-08-11	212.9M	zip-file
50	39.650	gmw-deu+eng+...2024-08-18	216.8M	zip-file
49	39.613	allenai/wmt1...en-6-6-big	?	URL
48	39.293	deu+eng+fra+...2024-05-30	226.6M	zip-file
47	39.089	ine-eng/opus...2024-08-17	235.7M	zip-file
46	38.818	ine-deu+eng+...2024-08-18	232.9M	zip-file
45	38.754	ine-deu+eng+...2024-05-30	230.5M	zip-file
44	38.682	gem-eng/opus...2024-08-17	233M	zip-file
43	37.972	facebook/nll...illed-600M	600M	URL
42	37.872	gem-eng/opus4m-2020-08-12	73.2M	zip-file
41	37.479	gem-eng/opus2m-2020-08-01	73.2M	zip-file
40	37.421	deu+eng+fra+...2024-05-30	231M	zip-file
39	37.186	gmw-eng/opus4m-2020-08-12	72.6M	zip-file
38	37.052	deu+eng+fin+...2021-02-22	75.8M	zip-file
37	36.936	mul-deu+eng+...2024-08-18	236.3M	zip-file
36	36.838	gmw-eng/opus2m-2020-08-01	72.6M	zip-file
35	36.662	allenai/wmt1...n-6-6-base	?	URL
34	36.621	gem-eng/opus-2020-07-14	73.2M	zip-file
33	36.607	gem-eng/opus-2020-07-26	73.2M	zip-file
32	36.597	gem-eng/opus-2020-07-04	72.9M	zip-file
31	36.582	mul-eng/opus...2024-08-17	237.2M	zip-file
30	36.133	facebook/m2m100_1.2B	1331.2M	URL
29	36.028	gmw-eng/opus-2020-07-26	72.6M	zip-file
28	35.868	mul-deu+eng+...2024-05-30	235.1M	zip-file
27	35.776	gmw-eng/opus-2020-06-27	72.6M	zip-file
26	35.503	gmw-eng/opus...2021-05-01	72.5M	zip-file
25	34.872	deu+eng+fin+...2021-02-22	66.2M	zip-file
24	33.845	gmw-eng/opus...2021-09-30	72.5M	zip-file
23	33.617	gmw-gmw/opus-2020-10-04	62.3M	zip-file
22	33.617	gmw-gmw/opus-2021-02-23	62.3M	zip-file
21	33.607	gmw-gmw/opus-2020-09-26	62.3M	zip-file
20	33.579	ine-eng/opus4m-2020-08-12	75.4M	zip-file
19	33.224	ine-eng/opus2m-2020-08-01	75.4M	zip-file
18	32.969	gmw-gmw/opus-2020-07-27	62.3M	zip-file
17	32.786	ine-eng/opus-2020-07-26	75.4M	zip-file
16	32.710	ine-eng/opus-2020-07-19	75.4M	zip-file
15	32.624	gmw-gmw/opus-2020-07-06	62.3M	zip-file
14	32.611	deu+eng+fra+...2024-05-30	240.9M	zip-file
13	32.328	ine-eng/opus-2020-07-14	75.4M	zip-file
12	32.124	gem-gem/opus-2020-10-04	63.5M	zip-file
11	32.124	gem-gem/opus-2021-02-24	63.5M	zip-file
10	31.862	gem-gem/opus-2020-09-26	63.5M	zip-file
9	31.590	gem-gem/opus-2020-07-27	63.5M	zip-file
8	31.572	gem-gem/opus-2020-07-06	63.4M	zip-file
7	31.496	facebook/m2m100_418M	418M	URL
6	31.161	mul-mul/opus...2024-08-17	247.8M	zip-file
5	30.662	gem-gem/opus-2020-07-21	63.5M	zip-file
4	28.672	mul-eng/opus2m-2020-08-12	77.1M	zip-file
3	28.648	westgermanic...2020-06-21	61.3M	zip-file
2	28.421	mul-eng/opus-2020-07-20	77.1M	zip-file
1	27.848	mul-eng/opus-2020-07-14	77.1M	zip-file
0	20.657	tatoeba-lowe...2020-06-15	61.3M	zip-file