OPUS-MT Dashboard

Language pair: ces-eng
Models: [all models] [OPUS-MT] [external] [contributed] [compare]
Benchmark: all benchmarks [average score]
Evaluation metric: [bleu][spbleu] chrf [chrf++][comet]
Chart Type: [barchart][diff]

blue = OPUS-MT / Tatoeba-MT models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]
exclude scores of user-contributed translations

Model Scores (comparing between OPUS-MT and external models)

ID	Benchmark (chrf)	Output	OPUS-MT	chrf	external	chrf	Diff	contributed	chrf	Diff
0	flores101-devtest	compare	ces+slk-eng/...2022-03-17	0.66511	facebook/nllb-200-3.3B	0.65205	0.013
1	flores200-devtest	compare	ces+slk-eng/...2022-03-17	0.66511	facebook/nllb-200-3.3B	0.64936	0.016	nllb-200-54.5B	0.66424	0.001
2	generaltest2022	compare	ces+slk-eng/...2022-03-13	0.7068	facebook/nllb-200-3.3B	0.67615	0.031	Online-W	0.79696	-0.090
3	multi30k_test_2016_flickr	compare	ces+slk-eng/...2022-03-17	0.62216	facebook/nll...illed-1.3B	0.61665	0.006
4	multi30k_test_2018_flickr	compare	ces+slk-eng/...2022-03-17	0.61838	facebook/nll...illed-1.3B	0.61223	0.006
5	newssyscomb2009	compare	sla-eng/opus...2024-08-17	0.56704	facebook/nllb-200-1.3B	0.55803	0.009
6	newstest2008	compare	zlw-eng/opus...2022-03-17	0.54288	facebook/nllb-200-1.3B	0.53419	0.009
7	newstest2009	compare	zlw-eng/opus...2022-03-17	0.56309	facebook/nllb-200-3.3B	0.54934	0.014
8	newstest2010	compare	zlw-eng/opus...2022-03-17	0.57778	facebook/nllb-200-3.3B	0.5741	0.004
9	newstest2011	compare	zlw-eng/opus...2022-03-17	0.57336	facebook/nllb-200-3.3B	0.55977	0.014
10	newstest2012	compare	zlw-eng/opus...2022-03-17	0.56761	facebook/nllb-200-1.3B	0.55747	0.010
11	newstest2013	compare	sla-eng/opus...2024-08-17	0.58997	facebook/nllb-200-3.3B	0.57848	0.011
12	newstest2014	compare	zlw-eng/opus...2022-03-17	0.64401	facebook/nllb-200-3.3B	0.62589	0.018
13	newstest2015	compare	ces+slk-eng/...2022-03-17	0.58688	facebook/nllb-200-3.3B	0.5746	0.012
14	newstest2016	compare	zlw-eng/opus...2022-03-17	0.6178	facebook/nllb-200-3.3B	0.60325	0.015
15	newstest2017	compare	zlw-eng/opus...2022-03-17	0.58259	facebook/nllb-200-3.3B	0.57605	0.007
16	newstest2018	compare	zlw-eng/opus...2022-03-17	0.58677	facebook/nllb-200-3.3B	0.57796	0.009	nllb-200-54.5B	0.5881	-0.001
17	newstest2021	compare	zlw-eng/opus...2022-03-17	0.60597	facebook/nllb-200-1.3B	0.5801	0.026	Facebook-AI	0.63618	-0.030
18	ntrex128	compare	ces+slk-eng/...2022-03-17	0.64143	facebook/nllb-200-3.3B	0.64548	-0.004
19	tatoeba-test-v2020-07-28	compare	ces+slk-eng/...2022-03-17	0.72914	facebook/nllb-200-3.3B	0.72455	0.005
20	tatoeba-test-v2021-03-30	compare	ces+slk-eng/...2022-03-17	0.7243	facebook/nllb-200-3.3B	0.72073	0.004
21	tatoeba-test-v2021-08-07	compare	ces+slk-eng/...2022-03-17	0.7212	facebook/nllb-200-3.3B	0.71778	0.003
		average		0.623		0.612	0.011		0.671	-0.049