OPUS-MT Dashboard

Language pair: eng-ita [all languages]
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: [all benchmarks] [average score] flores200-devtest
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart][scatterplot] [size] [type]

orange = OPUS-MT, blue = Tatoeba-MT models, red = HPLT-MT models
green = student models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]

Model Scores (bleu scores on the "flores200-devtest" testset)

ID	bleu	Output	Model	Size	Link
38	30.6	show	deu+eng+fra+...2024-05-30	222.9M	zip-file
37	30.2	show	deu+eng+fra+...2024-05-30	222.9M	zip-file
36	30.1	show	gmw-fra+ita+...2024-08-17	234.1M	zip-file
35	30.0	show	gem-fra+ita+...2024-08-17	234.6M	zip-file
34	29.6	show	eng-ita/opus...2022-03-13	232.1M	zip-file
33	29.4	show	facebook/nllb-200-3.3B	3379.2M	URL
32	29.3	show	facebook/nll...illed-1.3B	1331.2M	URL
31	28.7	show	eng-ita/opus...2021-04-14	71.7M	zip-file
30	28.7	show	facebook/nllb-200-1.3B	1331.2M	URL
29	28.3	show	deu+eng+fra+...2024-05-30	231M	zip-file
28	26.9	show	facebook/nll...illed-600M	600M	URL
27	26.8	show	facebook/m2m100_1.2B	1331.2M	URL
26	24.8	show	eng-roa/opus-2020-06-28	72.6M	zip-file
25	24.4	show	eng-roa/opus2m-2020-08-01	73.2M	zip-file
24	24.3	show	eng-roa/opus-2020-07-27	73.2M	zip-file
23	24.3	show	deu+eng+fra+...2024-05-30	240.9M	zip-file
22	24.3	show	eng-roa/opus-2020-07-20	73.2M	zip-file
21	23.9	show	eng-itc/opus-2020-07-20	73.5M	zip-file
20	23.9	show	eng-itc/opus2m-2020-08-01	73.5M	zip-file
19	23.8	show	eng-roa/opus-2020-07-14	73.2M	zip-file
18	23.7	show	eng-itc/opus-2020-07-27	73.5M	zip-file
17	23.6	show	facebook/m2m100_418M	418M	URL
16	23.6	show	eng-itc/opus-2020-07-14	73.5M	zip-file
15	23.2	show	eng-roa/opus...2021-04-10	71.7M	zip-file
14	23.1	show	eng-roa/opus...2021-03-23	72.4M	zip-file
13	22.5	show	eng-itc/opus...2021-04-10	71.9M	zip-file
12	22.3	show	eng-roa/opus...2021-03-24	72M	zip-file
11	22.1	show	mul-mul/opus...2024-08-17	247.8M	zip-file
10	19.9	show	eng-ine/opus2m-2020-08-01	75.5M	zip-file
9	19.8	show	eng-ine/opus-2020-07-27	75.5M	zip-file
8	19.3	show	eng-ine/opus-2020-07-19	75.5M	zip-file
7	19.3	show	eng-ine/opus-2020-07-14	75.5M	zip-file
6	16.7	show	eng-mul/opus2m-2020-08-01	77M	zip-file
5	16.2	show	eng-mul/opus-2020-07-27	77M	zip-file
4	15.7	show	tatoeba-zero...2020-06-19	63M	zip-file
3	15.7	show	eng-mul/opus-2020-07-20	77M	zip-file
2	15.6	show	tatoeba-zero...2020-06-21	63M	zip-file
1	14.7	show	eng-mul/opus-2020-07-14	77M	zip-file
0	13.9	show	tatoeba-lowe...2020-06-15	61.3M	zip-file