OPUS-MT Dashboard

Language pair: [eng-fra] all languages
Models: [all models] [OPUS-MT] [external] [compare]
Selected: huggingface/facebook/m2m100_1.2B
Benchmark: all benchmarks [download]
Evaluation metric: [bleu][spbleu][chrf] chrf++ [comet]
Chart Type: [barchart] [heatmap]

Selected Benchmark: [avg] [flores101-devtest] [flores200-devtest] [tatoeba-test-v2021-08-07] [tatoeba-test-v2021-03-30] [tico19-test] [tatoeba-test-v2020-07-28] [multi30k_test_2016_flickr] [multi30k_test_2018_flickr] [newssyscomb2009] [newstest2009] [newstest2010] [newstest2011] [newstest2012] [newstest2013] [newstest2019] [newstest2014] [newstest2015] [newstest2016] [newstest2017] [newstest2018] [multi30k_test_2017_flickr] [multi30k_test_2017_mscoco] [newstest2020] [newstestB2020] [newstest2021] [wikipedia.devtest] [wikipedia.test]
Scores shown in percentage points

	afr	amh	ara	ast	aze	bak	bel	ben	bos	bre	bul	cat	ceb	ces	cym	dan	deu	ell	eng	est	fas	fin	fra	fry	ful	gla	gle	glg	guj	hat	hau	heb	hin	hrv	hun	hye	ibo	ilo	ind	isl	ita	jav	jpn	kan	kat	kaz	khm	kor	lao	lav	lin	lit	ltz	lug	mal	mar	mkd	mon	msa	mya	nep	nld	nor	oci	pan	pol	por	pus	ron	rus	sin	slk	slv	snd	som	spa	sqi	srp	ssw	sun	swa	swe	tam	tgl	tha	tsn	tur	ukr	urd	uzb	vie	wol	xho	yid	yor	zho	zul
afr	afr	10.0	35.5	49.4		14.5	29.3	37.3	50.0		56.3	56.2	34.8	49.4	31.7	59.7	57.5	46.0	70.0	49.8	39.4	47.8	58.7		2.5	12.9	12.9	53.2	13.3	40.4	27.9	44.2	44.5	50.1	48.8	22.5	23.7	29.2	58.5	39.7	49.3	40.4	25.0	13.0	26.2	13.7	19.4	26.8	22.0	41.3	7.9	49.2	41.5	6.2	25.1	30.7	53.5	23.5	56.2	10.3		58.8		46.8	16.4	42.9	59.1	27.0	55.0	50.2	28.2	50.3	49.4	21.8	15.2	56.3		50.0	17.2	36.9		58.3	16.5	40.5	34.1	14.5	47.5	47.8	34.0	6.3	52.1	4.2	27.2		14.5		26.8
amh	30.9	amh	14.6	23.5		9.7	19.4	22.5	29.7		32.4	33.7	19.6	26.9	21.1	31.4	30.7	29.2	39.5	31.7	24.1	30.7	33.6		1.7	12.2	11.8	31.1	12.9	28.8	20.1	26.3	27.7	28.8	30.5	15.9	15.0	17.0	32.7	25.4	31.6	25.5	13.0	14.1	18.0	11.7	13.2	14.6	15.3	24.9	6.8	30.9	20.2	4.8	17.0	21.0	31.9	18.3	32.6	8.0		31.5		24.9	12.2	26.8	33.5	20.8	32.2	27.8	18.5	29.3	30.4	13.1	10.8	31.2		26.5	11.4	23.5		32.2	17.9	30.7	24.2	11.6	25.2	28.0	21.9	4.0	32.0	2.5	20.9		10.0		21.2
ara	45.8	7.4	ara	38.4		11.2	15.1	33.1	43.0		48.2	47.9	22.1	41.5	25.2	48.0	48.1	47.4	52.3	42.3	36.8	42.1	49.1		1.5	12.7	12.8	45.5	12.8	36.0	23.2	43.0	39.5	43.3	42.3	20.9	18.3	18.9	50.9	34.6	49.4	34.9	21.4	13.9	23.6	13.2	15.9	23.1	16.7	43.3	6.3	42.9	32.8	5.0	16.9	19.6	46.2	19.4	48.9	8.4		43.3		38.3	11.6	44.0	49.9	23.9	47.1	44.9	24.0	43.1	42.5	19.5	11.9	46.9		39.9	12.1	32.6		47.6	13.2	25.2	32.0	10.5	43.1	40.8	31.3	5.1	46.2	2.7	23.4		10.1		23.9
ast	45.2	5.6	23.5	ast		10.1	13.5	29.0	41.0		48.8	53.8	17.0	42.7	16.1	47.8	46.8	42.4	58.3	44.5	31.2	42.9	52.5		2.1	13.3	13.1	51.4	13.4	36.5	19.6	37.3	37.7	40.6	43.9	18.5	16.0	14.3	49.4	30.9	44.7	29.7	19.3	14.7	19.3	12.5	14.0	20.7	14.3	38.8	7.3	44.3	29.5	4.2	14.5	20.0	46.3	15.4	45.9	8.8		43.4		37.1	10.7	38.7	52.6	21.6	47.8	40.2	18.5	43.1	42.4	12.8	9.9	45.2		41.4	8.8	27.8		46.8	10.6	22.9	31.2	9.3	37.6	38.7	24.2	5.0	44.4	3.5	20.8		9.3		20.7
aze					aze														49.1																																																									51.3											46.9
bak	16.3	2.6	10.1	16.2		bak	12.7	10.4	16.5		16.9	18.0	14.4	14.4	12.6	18.0	16.6	13.2	18.1	17.8		17.8	17.3			12.7	10.9	16.8	12.6	17.3	12.7	13.5	11.9	16.3	15.8	9.5	9.5	14.1	19.3	14.5	17.2	13.3	4.8	14.5	10.0	12.5	7.7	4.8	10.0		7.4	17.1	12.7	4.6	9.0	10.0	17.5		19.1	6.1		17.8		12.7	6.4	14.7	17.6		16.3	16.0	9.8	15.1	17.4	7.5	9.0	17.9			8.9	14.9		17.5	11.9	19.5	11.8	7.9	11.8	16.3	11.0		12.2	2.7	12.3		8.3		12.0
bel	39.1	6.2	24.8	36.6		12.5	bel	27.3	38.5		43.9	42.2	27.8	35.9	25.5	39.8	43.5	35.6	45.2	39.3	29.8	37.7	41.6		1.9	12.0	12.9	40.5	12.6	33.2	25.0	31.7	31.8	38.6	36.5	19.8	20.1	23.9	40.8	30.3	42.0	32.2	17.7	12.5	21.7	14.0	15.6	18.4	18.0	32.8	7.4	40.6	31.6	5.2	20.5	24.6	42.9	21.5	39.8	9.4		43.4		35.1	13.9	43.3	41.4	23.3	41.7	48.0	22.4	37.5	38.7	17.6	14.1	42.4		39.2	15.1	30.2		40.8	18.2	34.1	28.9	12.6	30.1	46.6	25.8	4.7	40.4	3.4	23.9		12.9	15.2	23.8
ben	43.9	9.6	30.9	39.1		14.0	21.2	ben	40.5		45.7	45.9	29.5	39.4	27.0	45.6	43.6	38.2	56.1	41.8	35.2	40.6	47.6		2.7	12.5	12.8	43.2	13.6	35.1	24.7	36.5	42.1	41.3	40.8	22.4	19.4	24.1	49.2	33.8	41.9	34.7	21.2	13.7	24.5	13.4	17.2	23.7	19.3	41.6	7.2	41.1	33.6	5.7	27.7	30.7	43.8	22.0	47.6	11.5		42.2		38.3	16.4	36.6	47.6	25.0	44.7	40.1	28.6	40.6	41.0	22.1	13.9	41.1		40.4	14.8	32.6		45.6	23.3	33.8	31.5	12.4	40.4	39.3	33.6	6.1	44.6	3.4	24.0		12.7		24.2
bos	51.6	9.1	32.0	46.6		15.2	32.9	36.0	bos		56.9	54.8	31.6	50.6	30.2	54.9	53.1	45.7	62.2	49.8	38.1	48.0	57.1		2.7	12.7	12.7	52.0	13.5	39.7	27.4	43.4	42.6	56.0	48.7	23.8	22.7	28.9	56.1	38.3	49.5	38.6	23.2	10.1	26.4	16.5	19.9	25.5	20.5	47.2	7.9	50.2	40.2	6.1	27.7	30.6	56.7	22.1	52.9	11.9		49.1		45.2	16.8	44.2	56.9	25.9	53.9	48.7	28.7	51.1	51.8	21.7	16.6	47.6		56.5	14.9	36.1		54.9	25.3	40.8	34.3	13.5	43.4	49.0	33.2	6.3	50.8	4.5	26.8		14.3		26.6
bre										bre									14.6				13.1
bul	51.3	8.2	34.8	48.5		13.9	17.7	36.9	50.9		bul	55.4	30.2	49.7	29.6	55.8	58.5	46.7	63.0	50.0	39.4	48.2	59.6		1.6	12.6	12.9	52.6	13.7	39.4	26.3	44.5	43.7	51.2	49.2	22.6	21.5	23.9	56.0	38.2	51.4	38.5	21.2	14.3	24.1	12.8	17.4	27.3	19.4	35.6	7.3	50.1	39.4	5.7	25.8	30.1	55.7	23.2	52.9	10.5		49.7		45.5	14.4	44.8	57.1	26.0	54.8	53.9	29.2	51.0	50.9	21.0	14.3	53.3		50.3	15.1	35.8		55.9	17.5	33.1	34.3	12.3	51.1	55.1	33.9	6.6	51.6	3.5	25.4		13.4	21.0	25.4
cat	52.5	10.6	35.3	54.5		15.1	18.6	36.8	49.4		56.4	cat	34.8	48.6	30.1	57.8	58.1	46.9	66.2	49.5	39.3	48.5	62.9		2.8	13.1	13.0	57.2	13.6	41.2	26.8	44.2	43.4	50.0	48.9	23.3	22.3	29.5	57.6	39.1	63.0	39.4	26.0	13.6	26.7	13.0	18.8	27.5	21.4	45.9	7.6	49.2	40.6	6.4	27.1	30.2	53.7	23.0	54.2	12.3		58.2		53.8	15.3	44.1	67.1	26.3	54.7	48.6	28.4	49.8	49.6	22.1	15.2	60.8		49.4	15.8	36.4		56.7	18.7	38.3	34.5	12.8	47.1	53.4	33.7	7.3	51.9	4.0	26.5		14.3		26.1
ceb	37.6	7.6	21.5	34.9		13.6	22.5	24.3	33.8		37.3	39.1	ceb	31.8	26.3	36.6	26.0	31.7	31.9	34.0	25.7	32.7	38.6		2.8	14.2	12.9	37.3	12.4	32.8	25.1	27.4	27.8	32.3	32.3	18.8	20.2	38.4	40.6	27.9	35.9	33.1	15.5	11.7	20.6	16.8	15.9	15.4	19.3	31.8	9.0	33.0	30.2	6.3	17.7	21.4	36.6	16.9	38.3	10.9		35.5		33.7	13.0	30.1	39.3	20.9	37.0	31.3	17.9	32.7	34.2	15.2	16.3	35.5		32.2	16.6	31.8		36.7	17.0	43.9	26.2	15.3	29.4	30.7	23.6	6.6	35.1	4.2	24.6		14.4		24.6
ces	49.7	8.9	34.1	47.0		14.2	16.1	35.9	50.2		55.0	53.2	30.7	ces	28.3	54.8	52.1	45.5	56.6	49.7	38.3	48.4	56.5		2.0	12.9	13.0	51.3	13.3	38.7	25.8	42.6	42.4	51.0	51.6	22.7	20.7	27.7	55.4	38.1	54.3	37.6	24.7	14.1	25.8	13.0	18.0	26.6	19.1	38.5	7.9	50.0	38.8	6.3	26.1	28.3	52.5	21.5	52.3	11.4		48.8		42.5	13.5	56.4	56.0	25.5	53.5	55.3	27.0	54.1	34.4	19.8	14.4	53.8		47.6	15.1	35.6		54.6	17.2	37.4	34.1	12.1	45.1	52.1	32.3	6.8	50.6	3.6	24.9		13.2		25.1
cym	42.3	8.8	22.3	33.1		11.0	25.1	28.0	36.1		40.1	42.6	28.6	34.5	cym	42.6	40.1	35.1	45.2	36.8	29.0	35.6	43.0		2.2	13.5	12.6	40.2	14.2	34.5	26.6	32.2	33.2	34.7	35.5	18.3	21.6	24.2	44.6	31.8	37.6	33.6	16.6	9.8	20.2	14.0	18.4	17.8	21.2	33.0	7.5	35.5	31.1	6.2	21.9	24.9	39.0	20.2	43.8	9.6		38.0		36.0	14.9	31.7	43.9	23.1	41.2	34.8	22.1	36.0	36.4	18.3	15.8	37.4		36.6	14.0	30.7		41.7	20.4	38.2	27.9	13.9	31.6	34.0	26.8	4.8	38.9	4.6	26.3		13.2		26.4
dan	54.5	7.5	34.8	48.4		12.9	23.0	35.9	50.2		56.5	57.1	30.6	50.0	30.3	dan	64.2	46.5	68.8	51.3	39.2	52.0	64.3		2.3	12.4	12.8	53.3
deu																	deu		56.3
ell																		ell	66.8
eng	64.1	13.4	35.9	54.3	42.1	15.5	33.9	40.9	55.0	11.8	61.9	62.7	30.3	51.3	29.4	67.5	54.6	58.5	eng	55.7	43.3	52.9	60.3	41.4	3.0	12.8	11.9	60.1	13.5	43.1	28.0	50.9	49.2	59.1	51.3	23.5	24.8	27.6	64.5	47.8	59.1	30.3	24.0	12.8	29.1	15.7	18.8	30.4	22.2	57.6	8.7	56.2	41.0	7.4	34.1	38.6	56.1	22.8	55.3	12.3	12.1	61.4	64.8	40.7	16.5	53.3	67.4	27.2	61.6	55.0	29.2	56.2	40.9	23.1	15.3	59.5	62.4	53.4	18.1	39.0	50.5	67.5	22.3	42.9	38.6	13.5	51.6	53.6	38.2	7.7	55.8	4.4	28.0	12.9	15.2	20.6	29.2
est																			60.1	est
fas																			54.4		fas
fin																			55.3			fin
fra																			60.5				fra
fry																			40.4					fry
ful																			17.0						ful
gla																			12.2							gla
gle																			12.6								gle
glg																			64.9									glg
guj																			12.8										guj
hat																			53.2											hat
hau																			35.7												hau
heb																			59.5													heb
hin																			58.5														hin
hrv																			63.9															hrv
hun																			55.5																hun
hye																			43.6																	hye
ibo																			35.4																		ibo
ilo																			27.7																			ilo
ind																			62.9																				ind
isl																			57.0																					isl
ita																			63.5																						ita
jav																			32.5																							jav
jpn																			46.3																								jpn
kan																			13.0																									kan
kat																			47.1																										kat
kaz																			15.2																											kaz
khm																			33.9																												khm
kor																			52.9																													kor
lao																			39.8																														lao
lav																			62.0																															lav
lin																			23.0																																lin
lit																			62.9																																	lit
ltz																			45.2																																		ltz
lug																			22.1																																			lug
mal																			53.1																																				mal
mar																			53.8																																					mar
mkd																			60.8																																						mkd
mon																			36.4																																							mon
msa																			62.1																																								msa
mya																			26.8																																									mya
nep																			34.2																																										nep
nld																			63.6																																											nld
nor																			66.5																																												nor
oci																			52.3																																													oci
pan																			41.4																																														pan
pol																			58.1																																															pol
por																			69.0																																																por
pus																			41.2																																																	pus
ron																			65.3																																																		ron
rus																			59.7																																																			rus
sin																			42.9																																																				sin
slk																			61.2																																																					slk
slv																			62.5																																																						slv
snd																			25.8																																																							snd
som																			18.0																																																								som
spa																			60.1																																																									spa
sqi																			68.7																																																										sqi
srp																			64.3																																																											srp
ssw																			27.1																																																												ssw
sun																			48.1																																																													sun
swa																			52.0																																																														swa
swe																			68.6																																																															swe
tam																			31.5																																																																tam
tgl																			49.2																																																																	tgl
tha																			52.2																																																																		tha
tsn																			19.1																																																																			tsn
tur																			56.9																																																																				tur
ukr																			61.9																																																																					ukr
urd																			49.4																																																																						urd
uzb																			15.6																																																																							uzb
vie																			57.0																																																																								vie
wol																			19.5																																																																									wol
xho																			39.5																																																																										xho
yid																			14.9																																																																											yid
yor																			19.5																																																																												yor
zho																			51.8																																																																													zho
zul																			43.1																																																																														zul

color:
score:	0	10	20	30	40	50	60	70	80	90	100