OPUS-MT Dashboard

Language pair: rus-eng
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: all benchmarks [average score]
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart][diff]

blue = OPUS-MT / Tatoeba-MT models, grey = external models, purple = user-contributed
render chart with [gd] [plotly]

Model Scores (comparing between OPUS-MT and external models)

ID	Benchmark (bleu)	Output	OPUS-MT	bleu	external	bleu	Diff
0	flores101-devtest	compare	zle-eng/opus..2022-03-17	35.2	facebook/wmt19-ru-en	37.3	-2.1
1	flores200-devtest	compare	zle-eng/opus..2022-03-17	35.2	facebook/wmt19-ru-en	37.3	-2.1
2	generaltest2022	compare	zle-eng/opus..2022-03-17	41.1	facebook/nllb-200-1.3B	37.6	3.5
3	newstest2012	compare	zle-eng/opus..2022-03-17	39.2	facebook/wmt19-ru-en	40	-0.8
4	newstest2013	compare	zle-eng/opus..2022-03-17	31.3	facebook/wmt19-ru-en	38.3	-7.0
5	newstest2014	compare	zle-eng/opus..2022-03-17	40.5	facebook/wmt19-ru-en	42.2	-1.7
6	newstest2015	compare	zle-eng/opus..2022-03-17	36.1	facebook/wmt19-ru-en	45	-8.9
7	newstest2016	compare	zle-eng/opus..2022-03-03	35.8	facebook/wmt19-ru-en	40	-4.2
8	newstest2017	compare	zle-eng/opus..2022-03-17	40.8	facebook/wmt19-ru-en	51.9	-11.1
9	newstest2018	compare	zle-eng/opus..2022-03-17	35.2	facebook/wmt19-ru-en	38.6	-3.4
10	newstest2019	compare	zle-eng/opus..2022-03-17	41.6	facebook/wmt19-ru-en	39	2.6
11	newstest2020	compare	zle-eng/opus..2022-03-17	36.9	facebook/wmt19-ru-en	38	-1.1
12	newstest2021	compare	zle-eng/opus..2022-03-17	50.6	facebook/nllb-200-1.3B	48.7	1.9
13	newstestALL2020	compare	zle-eng/opus..2022-03-17	52.2	facebook/nllb-200-1.3B	50.4	1.8
14	newstestB2020	compare	zle-eng/opus..2022-03-17	39.3	facebook/wmt19-ru-en	40.1	-0.8
15	ntrex128	compare	zle-eng/opus..2022-03-17	29.3	facebook/nll..illed-1.3B	32	-2.7
16	tatoeba-test-v2020-07-28	compare	ru-en/opus-2020-02-26	60.6	facebook/nllb-200-3.3B	61.6	-1.0
17	tatoeba-test-v2021-03-30	compare	ru-en/opus-2020-02-26	60.1	facebook/nllb-200-3.3B	61.2	-1.1
18	tatoeba-test-v2021-08-07	compare	ru-en/opus-2020-02-26	58.2	facebook/nll..illed-1.3B	59.6	-1.4
19	tico19-test	compare	zle-eng/opus..2022-03-17	33.3	facebook/nllb-200-3.3B	36.4	-3.1
		average		41.6		43.8	-2.1