OPUS-MT Dashboard

Language pair: [eng-fra] all languages
Models: [all models] [OPUS-MT] [external] [compare]
Benchmark: [all benchmarks] [average score] tatoeba-test-v2021-03-30
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Highlighting colors: [model score] [model type] [model size] [model diff]

Table of bleu score differences between the best OPUS-MT model and the best external model:

	afr	amh	ang	ara	arq	asm	awa	aze	aze_Latn	bel	ben	ber	bos_Latn	bre	bul	cat	cbk	ceb	ces	cha	chm	chv	cmn_Hans	cmn_Hant	cor	crh	cym	dan	deu	dsb	dtp	egl	ell	eng	epo	est	eus	fao	fas	fin	fkv	fra	frr	fry	gcf	gla	gle	glg	gos	got	grc	grn	gsw	hbs	heb	hin	hoc	hoc_Latn	hrv	hrx	hsb	hun	hye	ido	ido_Latn	ile	ile_Latn	ilo	ina	ina_Latn	ind	isl	ita	jav	jbo	jbo_Latn	jpn	jpn_Hani	jpn_Hira	jpn_Kana	kab	kat	kaz	kaz_Cyrl	kha	khm	kor	kur	kur_Latn	kzj	lad	lad_Latn	lat	lat_Latn	lav	lfn	lfn_Cyrl	lfn_Latn	lit	ltz	mal	mar	mkd	mlt	mon	mri	msa	mya	nds	nld	nno	nob	nor	nov	nst	oci	orv	ota	ota_Arab	ota_Latn	pam	pcd	pes	pms	pol	por	prg	rom	ron	run	rus	slv	spa	sqi	srp_Cyrl	srp_Latn	swa	swe	swg	tam	tat	tel	tgl	tha	tlh	tlh_Latn	toki	toki_Latn	tuk	tuk_Latn	tur	tzl	tzl_Latn	uig	uig_Arab	ukr	urd	uzb	uzb_Latn	vie	vol	war	wuu	xal	xho	yid	yue_Hans	yue_Hant	zho	zsm_Latn	zza
afr	afr																												48.6					63.1	-17.5																																																																											-4.4																					-7.9		10.6
amh		amh																																3.7
ang			ang																															11.3
ara				ara																									44.4				3.4	-2.4	-14.1							39.9													40.6																		-2.9				17.0																																																1.0						42.3		47.2																		33.7
arq					arq																													9.1
asm						asm																												-16.3
awa							awa																											-18.7
aze								aze																										33.2																																																																																																			-23.5																		0.3
aze_Latn									aze_Latn																																																																																																																																														31.6
bel										bel																			-3.7					48.1	-22.3							-4.0																															-4.0																				4.8																	-4.3															-6.2						68.7		-0.7																							65.5													-12.7
ben											ben																							49.8
ber												ber																						40.0								69.2																																																																																											59.7
ber_Latn																													2.0					15.0
bos_Latn													bos_Latn																					66.7
bre														bre																				41.6								26.9
bua																																																																																																																																			5.6
bul															4.1								-29.8						4.0					60.5	-11.7							2.7																															43.8				-1.4																																																						52.2		4.5																		-0.4					0.8													-31.5
cat																cat													0.6					57.3	-17.8							-0.3																															-0.8																																					-0.4																4.3							74.0																							-14.0
cbk																	cbk																	17.4
ceb																		ceb											-2.6					29.5
ces																			ces										51.4					0.0	25.7							2.0																				48.3											-2.5																				8.3																																6.0						3.0	0.3	53.4																							53.0
cha																				cha														10.9
chm																					chm																																																																																																														1.8
chv																						chv												35.7																																																																																																	9.7																				8.9
cmn_Hans															1.9								cmn_Hans						-4.0					-2.3								-9.2													-17.9							-13.0														0.0																																																	-5.5	-9.4						-0.6	-9.8					0.7								0.2					-17.7									-14.2			0.2
cmn_Hant																								cmn_Hant					6.5					2.0								-2.5													-15.2																					0.0																																																	3.7	-6.6							-7.0					11.1								0.2					-8.7												0.3
cor																									cor				6.5					6.4	2.6							7.1																															5.9																																																										2.5		5.3
crh																										crh																																																																																																																													-7.0
cym																											cym							-5.4
dan																												dan	2.2					0.2	-20.8					37.8		2.1																															-1.5				-6.9																																	64.4		76.9	76.2													2.5					53.9		53.7					7.9													0.0
deu	52.7			23.2						-9.6					-1.9	2.2		-3.8	42.3				-32.8	-25.7	3.5			1.8	1.1	15.9			45.2	-2.3	8.6	6.7	-7.9		13.3	3.7		1.6	1.4						2.7					39.7	37.2				44.6	2.3	16.9	4.3		0.6		0.1					-4.1	1.1	0.0		0.1		-4.8	0.6	0.1	0.3	-6.5						-19.9		10.5		23.1							8.3	17.8	-15.3							10.7		23.3	0.7		47.8	47.5												23.3	25.2			41.6		-1.1	0.5	0.2			36.8		57.3	0.8		-9.8		14.2				0.0				35.5					-1.3				-1.0						6.6			4.0
dsb																													43.5	dsb
dtp																															dtp			2.3																																											0.3		0.4																																																																																											0.2
egl																																egl																																									5.3
ell				2.5																									53.3				-1.4	2.4	-13.3							5.1																															-5.7																																					7.1																6.0					54.7		29.4					4.3													-7.6
eng	57.0	-9.7	7.0	3.2	0.9	-10.0	-6.4	25.8		24.9	17.2	47.6	50.5	21.8	51.5	48.4	4.6	18.5	3.3	7.5		10.7	0.1	1.5	4.2		1.7	1.6	0.0		1.7		2.4	-1.1	8.0	53.4	33.4	-10.2	-3.3	2.5		1.8		5.2		-7.4	0.7	0.3	2.8	0.4	0.3	-10.9	4.1	42.1	3.0	22.4	0.3	0.3	3.1	4.4		-0.8	20.0	11.9	11.9	3.0		33.8	20.5		39.4	12.0	-1.0	-4.9	0.2	0.2	-15.9	0.5	0.1	0.0	-10.3	1.5	-5.1	25.2	0.7	-0.6	-11.6	14.2	17.3	0.2	22.1	24.7	24.6		7.7	2.9	0.2	3.7	1.7	-9.7	0.2	11.0	15.7	7.2	-5.5	-10.6	35.9	0.0	21.7	0.0	40.3	57.3	55.0	2.6	0.1	-3.5	0.7	1.1	0.4	2.1	3.0		5.1	16.3	0.3	4.7	0.5	8.9	1.6	14.3	1.0	1.3	0.7	6.3	8.4	39.7	14.4	-1.1		-2.3	10.9	-0.6	26.8	-4.5	0.1		0.1		9.2	9.2	2.2	0.9	0.9	0.3	2.2	13.5	16.3	6.8	23.0	37.1	0.4	14.0		5.4	21.7	9.6	0.1	0.4	7.1	27.9	1.0
epo	-17.8			-14.2						-24.3					-16.8	-15.7			17.4						0.9			-22.1	9.5				-15.3	6.0	-5.3				16.7	37.2		12.0						-18.2						13.4	-14.8				18.1			-17.0		15.3		3.8	3.8					-26.0	-12.1		0.1		-15.0	0.9	0.1												0.9	0.9	8.8			2.6		3.4	-22.0											-10.4						-10.4									-18.5	-10.2			19.3		-20.7	-2.0	10.4		10.8	23.9		29.2					-13.5				0.1				19.9					25.6				9.9	0.4					0.7
est																													4.9					59.7		est																																																																																															-3.0
eus																													-11.2					53.6			eus																																								-0.1																																																						-13.9		48.8
fao																																		-13.6				fao
fas																													29.9					-3.2	26.6				fas			0.9
fin																												55.1	3.3					2.7	43.3					0.7	1.8	5.3													1.9							45.0											20.2				-8.7	0.2	0.0	1.2							-22.2						6.8																	2.1	-22.0	59.5	15.0												4.8	5.0					47.0		3.5					7.5													31.0																		-1.9
fkv																																								23.5	fkv
fra				15.0						-5.3		48.4		13.0	2.0	2.5			2.5				-31.2	-21.8	2.8			0.6	3.1				1.0	-0.8	13.2				-0.6	3.2		4.9			0.2									39.7	39.1				1.8			3.5		0.5		4.6					-3.2		1.0		0.1		-8.6	0.2	0.0		-12.1						-20.4						6.0					8.2									11.9		15.9	1.3		0.4	20.5			-2.2						1.0			2.8	5.3			-0.3	-16.6	-0.1	0.3	2.0					1.8			-17.8		0.4		0.3	0.3	0.1	0.1			2.3			-14.4	10.5	3.2				31.0			0.1			8.9			-28.2
frr																													7.2														frr
fry																																		19.0										fry																																																																		25.6
gcf																																										12.9			1.8
gla																																		-17.5												gla																																																																																							-13.4
gle																																		-2.7													gle
glg																																		-2.4	-16.5													glg																																																																														2.2							72.1
gos																													24.2					23.7															gos																																																													16.7
got																																		0.3																got
grc																																		9.2																	grc
grn																																		-24.9																		grn																																																																										-15.4							-18.3
gsw																																		33.0																			gsw
hbs																													51.4					57.7	18.5							50.3												hbs																			54.0				0.0																																																51.3						59.0		58.1																							52.9
heb				24.6																			-33.4	-24.9					45.2					0.5	-16.4					3.2		47.0													2.5							-1.1							1.4				40.9				-20.7														2.0		7.4			0.7		3.9												18.1															3.3	3.2					40.5		51.2																		37.1					0.5										1.3			0.0
hin																																		43.3																						hin																																																																																																					-10.1
hoc																																		1.0																							hoc
hoc_Latn																																		1.0																								hoc_Latn
hrv																													51.2					0.5	23.2							1.8																	hrv																																																																		5.7								2.2																							4.8
hrx																													28.7					27.8																										hrx
hsb																													47.5																																hsb
hun																			48.4				-31.0						2.6					0.4	-16.9					51.8		1.1													-3.6							12.7															-18.2										-27.6						10.4																	45.2															39.7						-6.8							48.1													-6.1					-0.8
hye																																		41.6																													hye																																																																				-12.4
ido																													27.1					38.5	34.9							25.6																						ido					1.6				21.8																							6.2																																					26.8																																	0.5
ido_Latn																																		33.3																															ido_Latn																																	3.1
ile																													26.7					27.9	43.0							40.3																								ile
ile_Latn																																			43.1																																ile_Latn
ilo																																		44.7																																		ilo
ina																																		42.5	22.1																													11.3					ina																											6.5																														2.3																			0.2
ina_Latn																																																																						ina_Latn																						1.4						7.4																																																0.2
ind																													-1.3					47.9								0.0																													ind		-0.6						0.1																																																																																											26.5
isl																													3.2					3.8	-13.3																																					isl	1.1				-18.3																																																								14.0
ita				2.2						-16.5					47.8	1.6			1.0				0.4	1.1	1.5			-1.8	1.4			1.1	-10.9	1.3	-18.2					44.0		6.1												6.4	38.5									0.5							-1.7	-21.5	4.1				-8.9	0.0	0.1																				0.0								4.2		15.4	-0.8														1.6	25.8	4.0			-2.5		0.1		56.4			40.3		-1.3									0.5				16.1					48.3				-1.6						9.9			33.5
jav																																		-11.2																																								jav
jbo																													0.6					0.3	0.9							0.5																																	jbo		0.0																																																						0.2		0.1					0.3
jbo_Latn																							0.0	0.0										0.3																																										jbo_Latn
jpn				11.7											-5.6													-14.4	1.2		0.4			6.2	-22.5		-5.6			3.7		2.9												18.4	-4.8							-5.0										-22.7	-8.1		0.0		-0.1										-11.2												-10.6			-19.6					6.8		5.3	-7.1			26.1												-7.9	-6.3					-6.3		2.9					-3.0							0.4		0.0				-4.6					-15.2				-6.3									13.8
jpn_Hani																													12.9					30.5	19.9					20.4		30.3																				15.1											12.6					jpn_Hani																																24.9																24.0					10.8		19.4
jpn_Hira																													11.7		0.0			29.0	18.8					16.8		27.4													22.4				16.1			11.8									21.0		12.0						jpn_Hira																															18.3																19.9					11.7		15.8																		7.4					11.2
jpn_Kana																													12.0					34.2						24.8																																								jpn_Kana																																																			15.7		22.9
kab																													-8.5					-13.5								-15.0																																							-11.7																																																		-24.3		-7.9
kat																																		-8.6																																																kat																																																	-14.2
kaz																																		-12.7																																																	kaz
kaz_Cyrl																																		37.1																																																		kaz_Cyrl
kha																																		1.2																																																			kha
khm																																		-16.5																																																				khm																																															-4.8
kor																													-2.5					-2.7						9.2		-1.4																				3.1															-20.6										kor																																												-4.7		-1.4
kor_Hang																																		41.1						24.8		30.3																				28.0
kur																																		16.7																																																						kur
kur_Latn																													25.7					25.3																																																							kur_Latn
lad																													30.4					33.3	16.5																				10.3																																				lad		0.2																																								40.3																																	5.0
lad_Latn																																		38.1	20.6																																			12.5																						lad_Latn						0.9																																			45.0																																	6.6
lat																																		24.6								10.3																																																	3.5		4.4																	32.1																16.1					13.6		26.2
lat_Latn																																																																																														lat_Latn																																16.1
lav																																		4.1																																																													lav																																				3.3
lfn																																		10.5	9.5																													7.9					0.7																											lfn																														1.4																			0.2
lfn_Cyrl																																		4.1																																																															lfn_Cyrl																													3.2
lfn_Latn																													33.2					30.5	20.5							35.8																							1.2					12.7																						0.3						lfn_Latn																												19.3																																								0.1
lit																													25.5					0.1	-40.2																																						-8.9				-22.2																						lit																										53.6						1.7		0.5																		-6.4
ltz																													-17.8					-11.9																																																																		ltz										-26.2
mal																																		-5.2																																																																			mal
mar																																		2.8																																											-31.5																									mar
mkd																																		7.3																																																																					mkd																														9.3
mlt																																		-5.6																																																																						mlt
mon																																		-8.8																																																																							mon
mri																																		-13.2																																																																								mri
msa																													-0.7					46.7								2.1																															0.6				-16.0																														-5.6																										-0.3																																				17.0
mya																																		-11.5																																																																										mya
nds																													49.8					43.3								47.1																															39.0																																				nds	44.9																43.8					25.5		46.1
nld	-2.9									-17.8						-5.8								4.2				66.2	1.3				-18.0	-0.4	-24.5					3.7		2.0		30.8					2.8						14.8							38.8											-2.1				-8.9	1.3	0.2																					-40.5									24.3	0.9			62.5												25.4	31.4			26.4		-2.9		0.6														0.1				17.9					40.8													30.4
nno																																		56.1						-5.6																																																																							nno	81.3
nob																												73.1	45.6					60.2						36.1		0.3																																																																					56.4	nob																			45.2		-1.2			21.4		-0.1
nor																												73.1	45.7					57.2						34.3		56.9																															53.6																				0.3																	59.1			57.2												35.9	47.8					39.9		56.7					73.0																		42.7													30.0
nov																																		26.6																																																																																nov
nst																																		0.6																																																																																	nst
oci																																		-20.2	-34.6							-14.3																																																																										oci
orv																																		13.7																																																																																			orv																																							9.3
ota																																		4.8																																																																																				ota																																	3.2
ota_Arab																																		3.4																																																																																					ota_Arab
ota_Latn																																		16.5																																																																																						ota_Latn
pam																																		2.0																																																																																							pam
pcd																																										17.7																																																																																pcd
pes																																		-2.5																																																																																									pes
pms																																		20.4																																							19.8																																																			pms
pol				-1.9						-11.7									5.1				-29.4	-20.0					28.8					0.8	-29.5					6.3		2.2												48.7	4.2				6.1			39.1											28.1				-14.6																						43.5											30.2			49.6												pol	3.3					55.5		2.3					34.8													-35.0					2.7
por																2.7							-33.2	-29.6				-1.2	48.2				-4.1	-1.9	-7.9					10.1		2.5						1.5				-7.9			2.1																		-2.2				-9.5	0.6	0.1														11.8	11.8			0.4	1.1											19.8	35.3			58.3												1.0	6.3			-2.2		47.6		2.9					0.2					28.4				0.1				22.7					44.7
prg																																		4.5																																																																																													prg
que																																		12.1
rom																																		13.1																																																																																														rom
ron																													47.9					-0.8	27.6							1.9																															-4.3																																					32.3																1.3			ron		-1.9		2.0																		2.8
run																													17.4					36.9								-20.6																																																																																								run	17.5		-16.6
rus	-10.3			16.8						51.1					54.0				5.2		1.4		0.9	0.6	0.6			59.6	1.2				29.0	-1.1	-22.9	5.2	-8.2			42.2		1.9												49.5	36.1							-0.2	-8.8										-2.5		0.1		-11.8	0.3	0.2	0.4	-15.7	-29.3					-11.5								16.0				7.9										11.4	-1.2		46.1	40.4												54.0	42.9			-4.5		4.8	2.9	1.2		46.5	51.2		53.3									0.1	0.1			12.1			-20.9		70.2				-3.0						5.9	0.1		15.5
slv																			-4.8				-27.3						1.8					3.9	-38.5							3.7																																																																																									-4.4	slv																								-7.2
spa	1.7			20.6						-5.3		42.7			4.1	68.8			45.1				-34.8	-28.2	2.1			56.3	1.8				28.6	-0.2	13.1		36.8			4.7		0.6				-2.3		67.6				-4.4		48.8	43.5				4.2					0.7								-12.2	51.7		0.1		-9.8	0.2	0.0	0.0	-3.8					0.3	-24.5				25.7	27.9	27.0						3.8				9.8				-4.0		19.1	0.4		1.2	60.5												0.3	7.1			-2.1	-8.3	0.2		8.0					39.7			-11.0		22.9		0.6		0.2				0.0					-0.9				1.4						11.5			18.9
sqi																																		7.3																																																																																																				sqi
srp_Cyrl																																		1.5	15.4																																																																																																55.8				srp_Cyrl																					3.9
srp_Latn																													31.7					58.5	30.0																																						61.1																																							31.7																			61.1					srp_Latn																				57.8
swa																																		13.8																																																																																																							swa
swe																							-32.8	-27.9				8.8	55.4				0.3	2.2	29.7					9.4		3.6																				38.6											2.0				-18.2																																			8.1	72.3												25.9	3.9					45.7		36.7					7.8													-0.6																		40.3
swg																													10.0																																																																																																														swg
tam																																		-6.6																																																																																																										tam
tat																													-5.5					14.6								-10.2																																																																																											26.3								tat										14.9
tel																																		-19.0																																																																																																												tel
tgl																													-7.7					36.8								-14.5																																																																																				28.8							-11.2										tgl
tha																																		2.0																																																																																																														tha
tlh																																		0.3	0.5							2.4																											0.1																											0.3																																					1.1												tlh
tlh_Latn																																										2.4																												0.3																																																																												tlh_Latn
toki																													0.2					0.4	0.4							0.4																															0.7				0.4																																	0.9																0.4					0.6		0.1														toki
toki_Latn																																										0.3																																																																																									0.6																	toki_Latn
tuk																																		19.6																																																																																																																			tuk
tuk_Latn																																		19.6																																																																																																																				tuk_Latn
tur				15.8				27.5	27.7						2.4							7.2	-36.7	-30.8		10.4		1.4	23.6				-48.6	2.3	28.4					33.0		0.3													24.7							-5.7											18.9				-11.8		0.3																				0.3											24.4								1.3							-40.8	22.4			-0.9		15.1		2.3					4.5			12.4										16.9					-5.5		3.4
tzl																																		16.9																																																																																																																						tzl
tzl_Latn																																		16.9																																																																																																																							tzl_Latn
uig																																		2.6								24.0																																																																																																																uig
uig_Arab																																		11.8								23.9																																																																																																																	uig_Arab
ukr										58.9					0.7	-1.3			57.5				0.7	1.3					-0.1					7.4	34.1							4.4												52.1	1.8				5.0			1.7											50.0				-9.3		0.5																															50.7			55.3				0.3								2.8	45.3					76.2	-1.7	2.9		3.8	53.5															-3.6					37.9													22.1
urd																																		27.9																						-11.6																																																																																																					urd
uzb																																		-29.8																																																																																																																					-27.3							uzb
uzb_Latn																																		42.7																																																																																																																													uzb_Latn
vie																							-23.0						2.6					42.9	12.3							33.9																															1.1				-17.5																																																						-0.4		1.6																											61.5									23.8
vol																																		2.0	0.5																																																																																																																														vol
war																																		19.6																																																																																																																																war
wuu																							0.6	1.4																																																																																																																																											wuu
xal																																		5.5																																																																																																																																		xal
xho																																		9.6																																																																																																																																			xho
yid																													22.2					34.3	14.3							29.7													8.6									0.4									15.2																		0.1	0.1						0.8																																	18.6		22.1																																	7.2
yue_Hans																																		22.5																																																																																																																																					yue_Hans
yue_Hant																																		25.5																																																																																																																																						yue_Hant
zho															29.7														31.9					-0.3						40.8															26.9							9.5											30.0				24.6										5.8																				11.8			31.2																					16.3							46.1																		10.1				19.3									zho
zsm_Latn																															0.2			39.4																																					39.9																																																																																																			zsm_Latn
zza																																		2.1																																																																																																																																									zza