OPUS-MT Dashboard

Language pair: [eng-fra] all languages
Models: [all models] [OPUS-MT] [external] [compare]
Selected: huggingface/facebook/m2m100_1.2B
Benchmark: all benchmarks [download]
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart] [heatmap]

Selected Benchmark: [avg] [flores101-devtest] [flores200-devtest] [tatoeba-test-v2021-08-07] [tatoeba-test-v2021-03-30] [tico19-test] [tatoeba-test-v2020-07-28] [multi30k_test_2016_flickr] [multi30k_test_2018_flickr] [newssyscomb2009] [newstest2009] [newstest2010] [newstest2011] [newstest2012] [newstest2013] [newstest2019] [newstest2014] [newstest2015] [newstest2016] [newstest2017] [newstest2018] [multi30k_test_2017_flickr] [multi30k_test_2017_mscoco] [newstest2020] [newstestB2020] [newstest2021] [wikipedia.devtest] [wikipedia.test]
Scores shown in percentage points

	afr	amh	ara	ast	aze	bak	bel	ben	bos	bre	bul	cat	ceb	ces	cym	dan	deu	ell	eng	est	fas	fin	fra	fry	ful	gla	gle	glg	guj	hat	hau	heb	hin	hrv	hun	hye	ibo	ilo	ind	isl	ita	jav	jpn	kan	kat	kaz	khm	kor	lao	lav	lin	lit	ltz	lug	mal	mar	mkd	mon	msa	mya	nep	nld	nor	oci	pan	pol	por	pus	ron	rus	sin	slk	slv	snd	som	spa	sqi	srp	ssw	sun	swa	swe	tam	tgl	tha	tsn	tur	ukr	urd	uzb	vie	wol	xho	yid	yor	zho	zul
afr	afr	0.9	10.1	22.1		1.3	6.3	9.7	22.7		31.0	31.9	11.7	23.9	9.2	35.3	33.9	21.4	52.0	19.9	13.5	16.6	35.6		0.1	1.1	0.2	28.2	0.6	12.8	6.5	17.7	20.7	22.8	20.6	3.2	5.5	8.4	31.9	14.2	22.1	13.3	24.1	0.2	3.6	0.9	3.3	21.1	4.8	17.3	0.4	20.3	12.4	0.4	2.5	5.7	26.4	3.6	28.1	0.3		36.0		19.4	2.9	16.2	35.5	6.2	30.9	27.4	5.1	25.1	23.3	4.3	1.0	35.5		24.5	1.7	9.1		33.1	1.0	15.2	7.0	1.7	18.1	21.7	10.6	0.3	33.0	0.5	3.2		1.9		3.4
amh	8.0	amh	1.6	4.9		0.6	2.7	3.5	7.5		10.4	12.1	3.4	7.2	3.4	8.2	7.9	8.1	17.7	7.4	4.3	6.0	11.8		0.0	0.4	0.1	9.4	0.4	5.8	3.1	5.7	7.9	7.1	8.0	1.3	2.0	2.0	9.4	5.5	8.6	5.2	7.4	0.1	1.6	0.6	1.6	7.8	2.6	5.7	0.2	7.9	3.2	0.2	1.1	2.8	9.2	2.0	7.9	0.2		7.6		6.3	1.5	5.8	11.8	3.1	10.7	7.3	2.3	8.4	8.1	1.3	0.4	9.4		7.7	0.8	3.6		9.2	1.4	7.6	4.4	0.9	4.3	7.0	3.7	0.2	13.1	0.1	1.8		0.7		1.9
ara	18.4	0.5	ara	13.8		0.6	1.8	6.9	16.8		23.0	23.0	4.2	16.9	5.5	23.4	24.0	25.1	31.0	13.9	11.3	12.6	26.9		0.0	0.2	0.1	20.1	0.1	9.4	3.8	18.5	16.5	17.0	15.4	2.9	3.2	2.9	23.1	10.6	26.3	9.1	20.0	0.0	2.9	0.5	1.3	17.9	2.2	17.0	0.1	15.4	7.2	0.2	1.3	2.5	19.3	2.0	19.5	0.2		15.0		12.5	1.2	19.6	25.2	4.3	22.4	21.9	3.5	18.4	16.9	3.1	0.4	23.5		17.2	0.7	6.5		21.9	0.4	5.5	4.7	0.8	14.9	16.1	8.6	0.2	26.5	0.1	2.0		0.6		2.4
ast	19.3	0.4	4.4	ast		0.4	0.4	5.9	16.3		24.3	29.9	2.1	18.6	2.8	23.5	20.8	18.2	34.3	15.7	8.4	13.9	29.3		0.0	0.1	0.1	27.0	0.1	10.6	3.5	13.0	15.0	16.5	16.6	2.5	2.2	1.1	23.4	9.2	18.6	7.3	16.6	0.0	2.0	0.1	2.0	14.1	3.1	14.8	0.1	17.1	7.2	0.2	0.7	2.8	20.5	1.5	19.0	0.2		16.6		13.6	0.8	13.3	28.7	3.4	24.6	16.8	2.2	19.0	17.4	1.3	0.3	20.0		18.2	0.4	5.7		22.3	0.1	3.0	5.9	0.5	11.2	15.1	5.6	0.2	25.7	0.2	2.0		0.6		2.2
aze					aze														32.9																																																									37.2											23.6
bak	1.7	0.1	0.5	1.6		bak	0.7	0.4	2.0		2.8	3.2	1.1	2.0	1.1	2.2	1.7	2.1	2.3	2.3		2.0	3.4			0.2	0.1	3.0	0.1	1.8	1.1	1.0	1.1	1.8	2.2	0.2	0.7	0.8	2.4	1.3	2.4	1.3	1.3	0.0	0.3	0.4	0.7	1.2	0.7		0.2	2.4	0.9	0.2	0.1	0.3	2.6		1.8	0.0		1.8		1.5	0.2	1.8	3.3		2.8	1.9	0.5	2.1	2.3	0.1	0.2	2.8			0.2	1.1		2.2	0.2	2.2	1.2	0.5	0.6	2.2	0.5		1.6	0.2	0.5		0.4		0.6
bel	9.1	0.3	3.2	9.4		0.7	bel	3.7	9.6		14.4	14.2	5.5	9.7	3.9	10.9	20.7	9.9	18.8	8.6	5.2	7.3	19.2		0.0	0.7	0.2	12.3	0.7	5.5	3.1	6.5	7.9	10.0	8.5	1.8	2.6	4.0	11.2	5.6	19.6	5.9	11.2	0.2	2.0	1.1	2.2	10.4	2.4	7.8	0.2	10.3	4.9	0.2	1.3	2.8	12.3	2.2	9.6	0.2		18.9		7.8	1.6	20.3	13.4	3.3	13.5	23.2	2.3	10.4	10.7	1.7	0.5	19.9		10.9	0.8	3.9		10.9	0.9	7.1	4.2	0.8	4.9	20.5	4.1	0.2	16.6	0.1	1.4		1.0	21.4	1.6
ben	16.1	0.8	6.9	13.9		1.3	3.4	ben	14.7		20.0	20.9	7.6	15.0	5.9	20.4	17.0	13.9	33.0	13.6	10.5	11.5	22.9		0.1	0.6	0.1	17.6	0.4	8.5	4.5	11.7	17.9	15.1	14.2	3.3	3.5	5.0	21.5	9.7	15.5	8.9	20.3	0.3	3.0	0.5	2.2	18.0	3.2	15.3	0.3	14.2	7.5	0.3	3.2	5.9	16.9	2.7	18.6	0.4		14.4		12.3	2.8	11.2	22.7	4.8	20.3	15.1	5.3	15.9	15.2	4.3	0.6	15.4		15.8	1.1	6.1		19.6	2.6	9.8	5.2	1.0	12.0	13.9	10.1	0.3	24.8	0.2	2.1		1.1		2.3
bos	22.8	0.8	7.5	19.2		1.4	8.2	8.7	bos		30.5	29.3	9.3	24.9	7.8	29.1	25.6	20.5	36.8	18.9	12.0	16.4	32.4		0.1	0.6	0.2	25.9	2.3	11.1	5.8	16.1	18.3	28.3	19.1	3.8	4.9	7.2	28.5	13.0	22.0	11.5	22.6	0.5	3.5	1.8	3.8	19.4	4.8	20.2	0.4	20.7	11.4	0.4	2.7	5.6	28.3	3.1	23.4	0.3		19.8		17.2	2.8	17.3	32.2	5.2	28.9	22.6	5.6	25.9	25.4	4.1	1.2	21.1		30.5	1.3	8.4		28.5	3.6	14.0	6.7	1.6	14.3	22.3	9.6	0.3	30.8	0.4	2.8		1.6		3.1
bre										bre									1.8				1.3
bul	23.0	0.7	9.1	20.5		1.1	2.9	8.9	23.2		bul	30.2	8.3	23.7	7.4	30.4	37.0	21.2	40.8	19.6	13.4	17.2	37.7		0.0	0.7	0.2	26.9	0.3	11.2	5.2	16.8	19.7	23.2	20.5	3.6	4.2	5.0	28.0	12.8	26.0	11.0	21.3	0.1	3.0	0.1	2.6	21.7	3.9	14.0	0.2	20.6	10.8	0.2	2.6	5.4	27.9	3.4	23.4	0.3		20.9		17.1	2.2	17.9	32.4	5.4	29.6	28.5	5.7	24.7	24.3	3.7	0.6	31.1		24.6	1.4	7.8		29.6	0.8	9.9	6.4	1.1	21.7	29.4	10.6	0.4	31.9	0.3	2.7		1.5	31.5	2.8
cat	24.3	0.9	9.5	26.1		1.5	2.8	8.7	22.1		30.8	cat	11.4	22.8	8.0	33.6	36.2	22.2	45.4	19.4	13.5	17.7	43.1		0.2	0.9	0.1	32.2	0.5	12.9	5.7	17.1	19.5	22.8	20.3	3.9	4.7	7.7	30.7	13.8	42.3	12.3	24.9	0.2	3.8	0.2	3.3	21.8	5.0	19.8	0.4	20.8	11.8	0.5	3.0	5.3	26.3	3.3	25.8	0.4		36.2		27.2	2.4	17.1	47.6	5.7	32.6	23.2	5.3	24.3	23.7	4.3	1.0	39.1		24.2	1.6	8.6		31.1	1.3	13.7	7.3	1.4	17.6	31.1	10.4	0.4	32.9	0.4	3.0		1.6		3.2
ceb	12.1	0.6	3.7	11.6		1.0	3.6	3.8	10.4		13.8	16.4	ceb	9.8	6.4	12.1	6.5	11.2	13.9	8.9	4.8	7.3	16.7		0.1	1.8	0.2	14.2	0.9	7.9	5.7	6.5	7.6	9.8	9.3	2.2	4.3	13.9	16.6	6.6	12.4	9.9	9.3	0.3	2.3	2.1	3.7	7.8	5.1	8.9	0.6	8.7	7.0	0.5	1.2	2.8	12.0	1.9	13.0	0.6		9.8		11.2	1.6	7.6	17.1	3.2	14.6	9.2	2.1	10.4	10.5	1.6	1.3	12.9		10.2	2.3	7.6		12.2	1.8	18.5	6.5	1.9	6.4	8.8	4.2	0.3	16.5	0.5	3.3		1.8		3.2
ces	21.6	0.7	8.6	19.7		1.5	2.1	8.4	23.0		29.0	28.2	8.5	ces	6.9	29.6	26.2	20.6	33.3	20.3	12.9	17.5	33.3		0.0	0.7	0.3	25.7	0.2	10.9	5.1	16.4	18.7	24.5	24.6	3.7	4.0	6.7	27.8	13.2	29.6	11.1	23.8	0.1	3.6	0.3	2.9	21.2	3.5	15.9	0.4	21.9	10.9	0.4	2.7	4.6	25.1	3.2	22.9	0.3		20.4		15.1	1.9	33.1	31.3	5.0	29.1	32.1	4.9	28.8	13.0	3.4	0.8	29.8		23.0	1.4	8.2		28.4	0.9	12.8	7.2	1.3	15.6	27.8	9.6	0.4	31.2	0.4	2.5		1.5		2.7
cym	16.5	0.8	4.3	11.1		0.8	4.4	5.0	11.4		15.4	18.5	8.8	11.0	cym	17.7	14.4	12.3	24.3	10.6	6.8	8.6	19.2		0.1	1.2	0.2	15.7	2.2	9.0	5.7	9.2	11.4	10.5	10.5	1.9	4.6	5.9	18.5	9.0	12.7	9.9	10.1	0.4	1.9	1.4	3.7	10.5	5.8	9.9	0.4	9.6	7.3	0.6	2.0	3.6	13.5	2.4	16.4	0.4		11.1		12.4	2.5	8.1	19.9	4.0	17.4	11.8	3.2	12.4	11.8	2.7	1.1	13.5		12.6	1.5	6.9		16.8	2.3	12.5	6.2	1.8	6.9	10.9	5.8	0.2	18.6	0.6	3.3		1.4		3.1
dan	26.5	0.5	9.8	21.4		1.0	4.8	8.5	23.5		31.3	33.5	9.0	25.0	8.1	dan	43.4	21.7	50.9	21.8	13.8	23.9	44.7		0.1	1.0	0.1	28.2
deu																	deu		33.6
ell																		ell	47.5
eng	41.6	1.6	11.7	27.6	15.7	1.6	11.4	12.8	28.2	0.5	39.2	41.4	9.3	26.7	9.2	49.2	29.9	36.3	eng	28.6	19.1	24.3	38.0	20.1	0.2	1.1	0.2	38.6	1.0	15.1	7.8	27.0	26.1	35.4	24.8	4.9	6.8	8.3	40.9	25.3	35.3	8.5	23.6	0.3	5.4	1.3	2.6	25.4	5.1	33.0	0.7	28.5	17.9	1.0	7.2	12.8	31.6	4.1	28.5	0.9	0.5	39.6	47.3	16.1	3.2	28.7	47.8	6.8	40.4	30.6	5.7	31.7	20.3	5.5	1.3	37.1	40.7	30.4	2.3	11.4	21.9	49.5	3.0	18.8	5.6	1.7	22.2	29.8	14.5	0.3	37.6	0.6	4.1	0.7	2.3	28.5	5.7
est																			37.3	est
fas																			33.2		fas
fin																			31.9			fin
fra																			38.9				fra
fry																			23.0					fry
ful																			2.4						ful
gla																			0.8							gla
gle																			1.1								gle
glg																			45.3									glg
guj																			1.1										guj
hat																			27.4											hat
hau																			13.7												hau
heb																			39.9													heb
hin																			35.5														hin
hrv																			44.2															hrv
hun																			33.3																hun
hye																			21.1																	hye
ibo																			12.5																		ibo
ilo																			9.0																			ilo
ind																			40.7																				ind
isl																			37.2																					isl
ita																			42.5																						ita
jav																			14.5																							jav
jpn																			23.4																								jpn
kan																			0.8																									kan
kat																			28.5																										kat
kaz																			4.8																											kaz
khm																			15.6																												khm
kor																			31.2																													kor
lao																			14.6																														lao
lav																			41.6																															lav
lin																			4.8																																lin
lit																			42.6																																	lit
ltz																			29.4																																		ltz
lug																			5.6																																			lug
mal																			32.2																																				mal
mar																			32.5																																					mar
mkd																			41.5																																						mkd
mon																			16.6																																							mon
msa																			40.2																																								msa
mya																			7.5																																									mya
nep																			11.6																																										nep
nld																			44.2																																											nld
nor																			50.7																																												nor
oci																			32.7																																													oci
pan																			15.6																																														pan
pol																			36.3																																															pol
por																			51.1																																																por
pus																			16.1																																																	pus
ron																			45.6																																																		ron
rus																			36.3																																																			rus
sin																			17.9																																																				sin
slk																			36.5																																																					slk
slv																			42.9																																																						slv
snd																			6.7																																																							snd
som																			3.2																																																								som
spa																			37.4																																																									spa
sqi																			53.4																																																										sqi
srp																			40.0																																																											srp
ssw																			7.7																																																												ssw
sun																			22.9																																																													sun
swa																			35.1																																																														swa
swe																			51.2																																																															swe
tam																			12.9																																																																tam
tgl																			27.8																																																																	tgl
tha																			29.6																																																																		tha
tsn																			2.6																																																																			tsn
tur																			34.3																																																																				tur
ukr																			42.0																																																																					ukr
urd																			25.5																																																																						urd
uzb																			3.4																																																																							uzb
vie																			34.8																																																																								vie
wol																			3.3																																																																									wol
xho																			19.4																																																																										xho
yid																			2.0																																																																											yid
yor																			4.7																																																																												yor
zho																			27.2																																																																													zho
zul																			20.3																																																																														zul

color:
score:	0	10	20	30	40	50	60	70	80	90	100