OPUS-MT Dashboard

Language pair: fra-eng
Models: [all models] [OPUS-MT] [external] [contributed] [compare]
Benchmark: [all benchmarks] average score
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Highlighting colors: [model score] [model type] [model size] [model diff]

orange = OPUS-MT, blue = Tatoeba-MT models, red = HPLT-MT models
green = student models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]

Model Scores (averaged over testsets)

ID	bleu	Model	Size	Link
57	47.9	nllb-200-54.5B	?	URL
56	42.5	roa-eng/opus...2024-08-17	233.3M	zip-file
55	42.4	facebook/nllb-200-3.3B	3379.2M	URL
54	42.4	fra-eng/opus...2022-03-09	230.7M	zip-file
53	42.1	facebook/nllb-200-1.3B	1331.2M	URL
52	42.0	facebook/nll...illed-1.3B	1331.2M	URL
51	41.9	roa-deu+eng+...2024-05-30	222.7M	zip-file
50	41.8	fr-en/opus-2019-12-05	77M	zip-file
49	41.6	fr-en/opus-2020-02-26	74.7M	zip-file
48	41.5	itc-deu+eng+...2024-08-18	234M	zip-file
47	41.4	deu+eng+fra+...2024-05-30	225.7M	zip-file
46	41.3	fr+fr_BE+fr_...2020-04-01	77.5M	zip-file
45	41.0	itc-gmw/opus...2022-08-23	234.4M	zip-file
44	40.9	fra-eng/opus-2021-02-22	77.5M	zip-file
43	40.7	deu+eng+fra+...2024-05-30	226.6M	zip-file
42	40.7	fra-eng/opus...2021-04-30	77.5M	zip-file
41	40.7	fra-eng/opus-2021-02-19	77.5M	zip-file
40	40.5	fra-eng/opus-2021-02-16	77.5M	zip-file
39	40.4	fr+fr_BE+fr_...2020-03-26	77.5M	zip-file
38	39.8	facebook/nll...illed-600M	600M	URL
37	39.5	itc-deu+eng+...2024-05-30	222.8M	zip-file
36	38.9	facebook/m2m100_1.2B	1331.2M	URL
35	38.6	ine-eng/opus...2024-08-17	235.7M	zip-file
34	38.2	en+fr-en+fr/...2019-12-04	66.4M	zip-file
33	38.2	ine-deu+eng+...2024-08-18	232.9M	zip-file
32	38.1	ine-deu+eng+...2024-05-30	230.5M	zip-file
31	37.6	roa-eng/opus-2020-06-28	72.5M	zip-file
30	37.4	roa-eng/opus2m-2020-08-01	73.3M	zip-file
29	37.3	roa-eng/opus4m-2020-08-12	73.3M	zip-file
28	37.1	deu+eng+fin+...2021-02-22	75.8M	zip-file
27	37.0	deu+eng+fra+...2024-05-30	231M	zip-file
26	37.0	itc-eng/opus4m-2020-08-12	73.4M	zip-file
25	36.9	itc-eng/opus2m-2020-08-01	73.4M	zip-file
24	36.9	roa-eng/opus-2020-07-27	73.3M	zip-file
23	36.9	mul-deu+eng+...2024-08-18	236.3M	zip-file
22	36.7	itc-eng/opus-2020-07-27	73.4M	zip-file
21	36.6	mul-eng/opus...2024-08-17	237.2M	zip-file
20	36.5	itc-eng/opus-2020-07-19	73.4M	zip-file
19	36.4	itc-eng/opus-2020-07-14	73.4M	zip-file
18	36.3	roa-eng/opus...2021-05-01	73M	zip-file
17	35.8	mul-deu+eng+...2024-05-30	235.1M	zip-file
16	35.3	deu+eng+fin+...2021-02-22	66.2M	zip-file
15	34.9	facebook/m2m100_418M	418M	URL
14	34.9	ine-eng/opus4m-2020-08-12	75.4M	zip-file
13	34.6	ine-eng/opus2m-2020-08-01	75.4M	zip-file
12	34.3	ine-eng/opus-2020-07-26	75.4M	zip-file
11	34.2	ine-eng/opus-2020-07-19	75.4M	zip-file
10	33.9	ine-eng/opus-2020-07-14	75.4M	zip-file
9	33.4	mul-mul/opus...2024-08-17	247.8M	zip-file
8	33.3	deu+eng+fra+...2024-05-30	240.9M	zip-file
7	31.0	mul-eng/opus2m-2020-08-12	77.1M	zip-file
6	30.8	mul-eng/opus-2020-07-20	77.1M	zip-file
5	30.3	mul-eng/opus-2020-07-14	77.1M	zip-file
4	27.2	ine-ine/opus-2020-07-27	66.1M	zip-file
3	26.0	ine-ine/opus-2020-07-21	66.1M	zip-file
2	25.5	tatoeba-zero...2020-06-21	63M	zip-file
1	25.4	tatoeba-zero...2020-06-19	63M	zip-file
0	23.7	tatoeba-lowe...2020-06-15	61.3M	zip-file