OPUS-MT Dashboard

Language pair: eng-fra
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: [all benchmarks] average score
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart][scatterplot] [size] [type]

orange = OPUS-MT, blue = Tatoeba-MT models, red = HPLT-MT models
green = student models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]

Model Scores (averaged over testsets)

ID	bleu	Model	Size	Link
54	42.5	eng-fra/opus...2022-03-09	230.7M	zip-file
53	41.5	facebook/nllb-200-3.3B	3379.2M	URL
52	41.4	facebook/nll...illed-1.3B	1331.2M	URL
51	41.2	gem-fra+ita+...2024-08-17	234.6M	zip-file
50	41.2	deu+eng+fra+...2024-05-30	222.9M	zip-file
49	41.1	en-fr/opus-2020-02-26	74.7M	zip-file
48	41.1	deu+eng+fra+...2024-05-30	222.9M	zip-file
47	41.0	en-fr/opus-2019-12-04	77M	zip-file
46	41.0	eng-fra/opus-2021-02-22	77.5M	zip-file
45	41.0	facebook/nllb-200-1.3B	1331.2M	URL
44	40.9	gmw-deu+eng+...2024-05-30	225.5M	zip-file
43	40.9	gmw-fra+ita+...2024-08-17	234.1M	zip-file
42	40.9	en-fr+fr_BE+...2020-04-17	77.5M	zip-file
41	40.8	en-fr+fr_BE+...2020-04-21	77.5M	zip-file
40	40.8	eng-fra/opus-2021-02-19	77.5M	zip-file
39	40.5	eng-fra/opus-2021-02-15	77.5M	zip-file
38	40.3	gem-deu+eng+...2024-05-30	226.4M	zip-file
37	39.1	facebook/nll...illed-600M	600M	URL
36	38.3	deu+eng+fra+...2024-05-30	231M	zip-file
35	38.0	facebook/m2m100_1.2B	1331.2M	URL
34	37.5	ine-deu+eng+...2024-05-30	230.5M	zip-file
33	37.0	en+fr-en+fr/...2019-12-04	66.4M	zip-file
32	36.1	eng-deu+eng+...2021-02-22	75.8M	zip-file
31	36.1	eng-roa/opus-2020-06-28	72.6M	zip-file
30	35.6	eng-roa/opus2m-2020-08-01	73.2M	zip-file
29	35.3	mul-deu+eng+...2024-05-30	235.1M	zip-file
28	35.0	eng-itc/opus2m-2020-08-01	73.5M	zip-file
27	34.9	eng-roa/opus-2020-07-27	73.2M	zip-file
26	34.8	eng-roa/opus-2020-07-20	73.2M	zip-file
25	34.6	eng-itc/opus-2020-07-27	73.5M	zip-file
24	34.5	eng-itc/opus-2020-07-20	73.5M	zip-file
23	34.4	eng-roa/opus-2020-07-14	73.2M	zip-file
22	34.3	eng-itc/opus-2020-07-14	73.5M	zip-file
21	34.0	deu+eng+fin+...2021-02-22	66.2M	zip-file
20	33.7	deu+eng+fra+...2024-05-30	240.9M	zip-file
19	32.9	facebook/m2m100_418M	418M	URL
18	32.6	eng-roa/opus...2021-04-10	71.7M	zip-file
17	32.4	eng-roa/opus...2021-03-23	72.4M	zip-file
16	31.7	mul-mul/opus...2024-08-17	247.8M	zip-file
15	31.7	eng-itc/opus...2021-04-10	71.9M	zip-file
14	31.4	eng-roa/opus...2021-03-24	72M	zip-file
13	29.7	eng-ine/opus2m-2020-08-01	75.5M	zip-file
12	29.3	eng-ine/opus-2020-07-27	75.5M	zip-file
11	29.1	eng-ine/opus-2020-07-19	75.5M	zip-file
10	28.5	eng-ine/opus-2020-07-14	75.5M	zip-file
9	24.6	ine-ine/opus-2020-07-27	66.1M	zip-file
8	24.6	eng-mul/opus2m-2020-08-01	77M	zip-file
7	23.7	ine-ine/opus-2020-07-21	66.1M	zip-file
6	23.7	eng-mul/opus-2020-07-27	77M	zip-file
5	23.4	tatoeba-zero...2020-06-21	63M	zip-file
4	23.3	tatoeba-zero...2020-06-19	63M	zip-file
3	23.1	eng-mul/opus-2020-07-20	77M	zip-file
2	21.8	tatoeba-lowe...2020-06-15	61.3M	zip-file
1	21.7	eng-mul/opus-2020-07-14	77M	zip-file
0	1.4	JamesH/Trans...fr_project	?	URL