OPUS-MT Dashboard

Language pair: eng-fra [all languages]
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: [all benchmarks] [average score] multi30k_test_2016_flickr
Evaluation metric: [bleu][spbleu][chrf][chrf++] comet
Chart Type: [barchart][scatterplot] [size] [type]

orange = OPUS-MT, blue = Tatoeba-MT models, red = HPLT-MT models
green = student models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]

Model Scores (comet scores on the "multi30k_test_2016_flickr" testset)

ID	comet	Output	Model	Size	Link
39	0.858	show	gmw-fra+ita+...2024-08-17	234.1M	zip-file
38	0.858	show	deu+eng+fra+...2024-05-30	222.9M	zip-file
37	0.856	show	gem-fra+ita+...2024-08-17	234.6M	zip-file
36	0.855	show	deu+eng+fra+...2024-05-30	222.9M	zip-file
35	0.851	show	gmw-deu+eng+...2024-05-30	225.5M	zip-file
34	0.846	show	gem-deu+eng+...2024-05-30	226.4M	zip-file
33	0.837	show	ine-deu+eng+...2024-05-30	230.5M	zip-file
32	0.836	show	deu+eng+fra+...2024-05-30	231M	zip-file
31	0.819	show	facebook/nll...illed-1.3B	1331.2M	URL
30	0.815	show	mul-deu+eng+...2024-05-30	235.1M	zip-file
29	0.805	show	eng-fra/opus...2022-03-09	230.7M	zip-file
28	0.804	show	facebook/nllb-200-3.3B	3379.2M	URL
27	0.800	show	facebook/nllb-200-1.3B	1331.2M	URL
26	0.793	show	deu+eng+fra+...2024-05-30	240.9M	zip-file
25	0.744	show	eng-fra/opus-2021-02-19	77.5M	zip-file
24	0.744	show	eng-fra/opus-2021-02-22	77.5M	zip-file
23	0.733	show	eng-fra/opus-2021-02-15	77.5M	zip-file
22	0.728	show	facebook/nll...illed-600M	600M	URL
21	0.671	show	facebook/m2m100_1.2B	1331.2M	URL
20	0.564	show	eng-deu+eng+...2021-02-22	75.8M	zip-file
19	0.530	show	eng-itc/opus2m-2020-08-01	73.5M	zip-file
18	0.496	show	eng-itc/opus-2020-07-27	73.5M	zip-file
17	0.489	show	eng-roa/opus-2020-07-27	73.2M	zip-file
16	0.487	show	eng-itc/opus-2020-07-20	73.5M	zip-file
15	0.466	show	deu+eng+fin+...2021-02-22	66.2M	zip-file
14	0.464	show	eng-itc/opus-2020-07-14	73.5M	zip-file
13	0.381	show	facebook/m2m100_418M	418M	URL
12	0.291	show	eng-itc/opus...2021-04-10	71.9M	zip-file
11	0.246	show	eng-ine/opus2m-2020-08-01	75.5M	zip-file
10	0.181	show	eng-ine/opus-2020-07-27	75.5M	zip-file
9	0.160	show	eng-ine/opus-2020-07-19	75.5M	zip-file
8	0.101	show	eng-ine/opus-2020-07-14	75.5M	zip-file
7	-0.169	show	eng-mul/opus2m-2020-08-01	77M	zip-file
6	-0.275	show	eng-mul/opus-2020-07-27	77M	zip-file
5	-0.330	show	JamesH/Trans...fr_project	?	URL
4	-0.343	show	eng-mul/opus-2020-07-20	77M	zip-file
3	-0.473	show	tatoeba-zero...2020-06-21	63M	zip-file
2	-0.479	show	tatoeba-zero...2020-06-19	63M	zip-file
1	-0.491	show	eng-mul/opus-2020-07-14	77M	zip-file
0	-0.556	show	tatoeba-lowe...2020-06-15	61.3M	zip-file