OPUS-MT Dashboard

Language pair: eng-fra
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: [all benchmarks] average score
Evaluation metric: [bleu] spbleu [chrf][chrf++][comet]
Chart Type: [barchart][scatterplot] [size] [type]

color:
#params:	24M	36M	54M	81M	122M	183M	275M	413M	620M	930M	unknown

orange = OPUS-MT, blue = Tatoeba-MT models, red = HPLT-MT models
green = student models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]

Model Scores (averaged over testsets)

ID	spbleu	Model	Size	Link
45	47.250	eng-fra/opus...2022-03-09	230.7M	zip-file
44	46.105	gem-fra+ita+...2024-08-17	234.6M	zip-file
43	46.079	deu+eng+fra+...2024-05-30	222.9M	zip-file
42	46.055	eng-fra/opus-2021-02-22	77.5M	zip-file
41	45.989	deu+eng+fra+...2024-05-30	222.9M	zip-file
40	45.940	facebook/nllb-200-3.3B	3379.2M	URL
39	45.940	facebook/nll...illed-1.3B	1331.2M	URL
38	45.884	gmw-deu+eng+...2024-05-30	225.5M	zip-file
37	45.865	eng-fra/opus-2021-02-19	77.5M	zip-file
36	45.811	gmw-fra+ita+...2024-08-17	234.1M	zip-file
35	45.520	eng-fra/opus-2021-02-15	77.5M	zip-file
34	45.440	facebook/nllb-200-1.3B	1331.2M	URL
33	45.205	gem-deu+eng+...2024-05-30	226.4M	zip-file
32	43.385	facebook/nll...illed-600M	600M	URL
31	43.063	deu+eng+fra+...2024-05-30	231M	zip-file
30	42.294	facebook/m2m100_1.2B	1331.2M	URL
29	42.089	ine-deu+eng+...2024-05-30	230.5M	zip-file
28	41.095	eng-roa/opus-2020-06-28	72.6M	zip-file
27	41.000	eng-deu+eng+...2021-02-22	75.8M	zip-file
26	40.460	eng-roa/opus2m-2020-08-01	73.2M	zip-file
25	40.010	eng-itc/opus2m-2020-08-01	73.5M	zip-file
24	39.879	mul-deu+eng+...2024-05-30	235.1M	zip-file
23	39.875	eng-roa/opus-2020-07-27	73.2M	zip-file
22	39.680	eng-roa/opus-2020-07-20	73.2M	zip-file
21	39.475	eng-itc/opus-2020-07-27	73.5M	zip-file
20	39.380	eng-itc/opus-2020-07-20	73.5M	zip-file
19	39.205	eng-itc/opus-2020-07-14	73.5M	zip-file
18	39.180	eng-roa/opus-2020-07-14	73.2M	zip-file
17	38.605	deu+eng+fin+...2021-02-22	66.2M	zip-file
16	38.168	deu+eng+fra+...2024-05-30	240.9M	zip-file
15	37.265	eng-roa/opus...2021-04-10	71.7M	zip-file
14	37.115	eng-roa/opus...2021-03-23	72.4M	zip-file
13	36.556	facebook/m2m100_418M	418M	URL
12	36.280	eng-itc/opus...2021-04-10	71.9M	zip-file
11	36.110	eng-roa/opus...2021-03-24	72M	zip-file
10	35.974	mul-mul/opus...2024-08-17	247.8M	zip-file
9	34.030	eng-ine/opus2m-2020-08-01	75.5M	zip-file
8	33.615	eng-ine/opus-2020-07-27	75.5M	zip-file
7	33.350	eng-ine/opus-2020-07-19	75.5M	zip-file
6	32.785	eng-ine/opus-2020-07-14	75.5M	zip-file
5	28.445	eng-mul/opus2m-2020-08-01	77M	zip-file
4	27.430	eng-mul/opus-2020-07-27	77M	zip-file
3	26.750	eng-mul/opus-2020-07-20	77M	zip-file
2	25.200	eng-mul/opus-2020-07-14	77M	zip-file
1	24.911	tatoeba-lowe...2020-06-15	61.3M	zip-file
0	2.261	JamesH/Trans...fr_project	?	URL