OPUS-MT Dashboard

Language pair: [eng-fra] all languages
Models: [all models] [OPUS-MT] [external] [compare]
Selected: Tatoeba-MT-models/deu+eng+fra+por+spa-mul/opusTCv20230926max50+bt+jhubc_transformer-big_2024-05-30
Benchmark: all benchmarks [download]
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart] [heatmap]

Selected Benchmark: [avg] [flores200-devtest] [ntrex128] [tatoeba-test-v2021-08-07] [tatoeba-test-v2020-07-28] [tatoeba-test-v2021-03-30] [multi30k_test_2016_flickr] [multi30k_test_2018_flickr] [newssyscomb2009] [newstest2008] [newstest2009] [newstest2010] [newstest2011] [newstest2012] [newstest2013] [newstest2019] [generaltest2022] [multi30k_test_2017_flickr] [multi30k_test_2017_mscoco] [newstest2014] [newstest2015] [newstest2016] [newstest2017] [newstest2018] [newstest2020] [newstest2021] [tico19-test]
Scores shown in percentage points

	acm	afr	aka	amh	apc	ara	arq	arz	asm	ast	awa	aze_Latn	bak	bam	ban	bel	bem	ben	bho	bos_Latn	bre	bug	bul	cat	ceb	ces	cha	chv	cjk	ckb	cor	crh	cym	dan	deu	dik	din	dsb	dtp	dyu	ell	eng	epo	est	eus	ewe	fao	fas	fij	fil	fin	fon	fra	frr	fry	fuc	fur	gcf	gla	gle	glg	gos	got	grc	grn	gsw	guj	hat	hau	hbs	heb	hin	hmn	hne	hoc	hrv	hsb	hun	hye	ibo	ido_Latn	iku	ilo	ind	isl	ita	jav	jbo	jbo_Latn	kab	kac	kam	kan	kas_Arab	kas_Deva	kat	kau	kaz	kaz_Cyrl	kbp	kea	kha	khm	kik	kin	kmb	kmr	kon	kur_Latn	lad	lad_Latn	lao	lat	lat_Latn	lav	lfn_Cyrl	lfn_Latn	lij	lim	lin	lit	lmo	ltz	lua	lug	luo	lus	mag	mai	mal	mar	mkd	mlg	mlt	mni	mon	mos	mri	msa	mya	nde	nds	nep	nld	nno	nob	nor	npi	nso	nus	nya	oci	orm	ota_Arab	ota_Latn	pag	pam	pan	pap	pcd	pes	plt	pms	pol	por	prs	pus	rom	ron	run	rus	sag	san	scn	shi	shn	sin	slk	slv	smo	sna	snd_Arab	som	sot	spa	sqi	srd	srp_Cyrl	ssw	sun	swa	swe	swg	swh	szl	tah	tam	tat	tel	tgk	tgk_Cyrl	tgl	tha	tir	tlh	tlh_Latn	ton	tpi	tsn	tso	tuk	tuk_Latn	tum	tur	twi	tzl	tzl_Latn	uig	uig_Arab	ukr	umb	urd	uzb_Latn	vec	ven	vie	war	wol	wuu	xal	xho	yid	yor	yue_Hans	yue_Hant	zsm_Latn	zul	zza
deu	1.3	30.8	2.5	0.9	0.3	13.9		5.2	0.7	16.3	0.7	7.3	3.5	2.3	5.3	17.9	3.8	5.8	5.3			2.8	32.5	31.5	10.9	18.5			0.6	1.1	2.0	2.7	13.0	40.9	34.0	1.6		9.5		1.1	23.2	30.0	34.9	32.0	17.5	4.2	7.2	13.8	9.3	15.2	23.1	1.1	27.7	1.4		1.4	10.1		5.9	11.1	22.4	1.6			3.5		4.5	14.3	9.1	10.7	16.9	13.7	3.5	6.3		24.4	11.8	16.5	4.8	5.8			13.7	26.1	22.5	29.6	11.9	0.4		5.8	4.5	1.8	2.7	0.2	0.4	3.6		5.0		1.9	6.6		0.9	2.5	5.2	1.3	3.6	6.9	5.1	10.3		4.8	11.0		11.2		8.0	6.1	4.1	9.0	18.0	3.5	23.8	1.0	2.9	1.1	4.6	5.5	4.0	1.2	4.3	18.9	7.7	13.1	0.2	3.2	2.4	8.4	20.4	0.6	2.1	15.2	2.9	37.5	17.2	30.0	45.6	0.3	7.2	1.8	5.8	15.7	1.2			7.2		4.8	15.4		9.2	7.2		20.2	29.2	9.7	3.0		26.4	5.6	24.2	4.5	0.7	4.1	0.1	0.8	0.8	16.1	13.9	12.8	4.9	0.1	5.2	8.0	29.2	18.4	9.7	15.9	2.5	7.4	18.6	33.2	1.2	11.7	6.3	15.2	0.7	5.8	3.3	7.9	6.9	15.0	4.2	0.2	0.3		3.7	11.1	11.4	6.8	3.5		1.1	17.1	0.8			1.4		24.5	1.1	8.4		6.9	2.4	22.7	16.1	3.6			4.1	7.0	2.3				3.7
eng	4.6	40.6	3.0	2.5	0.4	15.4	0.9	8.1	2.0	22.5	3.8	8.9	4.1	3.3	9.4	12.8	5.3	7.9	7.6	42.2	9.2	4.6	31.6	35.8	15.1	21.6	7.5	4.0	1.1	0.9	1.8	4.6	25.3	46.0	23.4	2.2	0.0		1.4	1.3	34.8	69.3	37.2	23.5	14.9	5.7	12.6	13.1	13.5	24.3	19.5	1.1	33.7		16.8	1.7	12.2		15.4	24.9	34.6	0.5	0.3	0.1	4.5	3.4	9.6	19.3	9.6	0.0	23.2	16.1	4.6	11.3	0.3	32.5		18.1	7.7	12.2	0.5	0.5	20.5	37.6	20.5	35.3	12.0	0.0	0.0	6.0	5.1	2.4	4.8	0.4	0.4	9.3	0.0	11.5	16.8	2.6	6.9	0.3	0.6	3.4	5.0	1.6	4.2	8.7	4.2	9.9	10.9	8.1	11.6		19.7	0.1	6.6	8.1	6.0	5.8	22.1	3.9	23.1	1.0	2.1	1.3	5.8	12.5	5.8	5.7	10.0	29.5	10.0	22.4	0.2	7.7	2.7	13.9	22.8	0.4	3.1	14.3	2.0	38.4	28.1	37.5	49.0	0.4	11.6	1.1	10.3	12.7	0.7	0.2	0.1	10.6	3.0	8.1	21.7		16.7	10.5	8.5	25.3	42.3	10.6	2.3	4.1	33.0	7.8	23.2	6.3	1.0	4.8	0.2	0.6	1.1	21.1	17.6	18.8	8.1	0.2	5.7	12.0	35.5	35.0	12.9	28.2	3.8	13.8	26.8	45.3		20.1	7.6	17.5	4.5	6.6	5.5	9.1	7.3	16.3	5.3	0.3	0.5		5.3	14.6	15.1	11.6	4.9	5.8	1.0	20.9	0.5	0.6	0.6	2.8	5.4	23.7	1.2	9.2	15.6	8.8	3.6	31.8	17.8	4.3		5.2	12.1	9.7	3.3	0.0	0.0	1.2	4.8	0.5
fra	1.2	21.5	2.2	0.4	0.2	8.5		6.0	0.9	18.1	0.7	7.3	3.5	2.4	5.2	16.7	3.7	3.9	5.3		7.3	3.1	30.7	34.5	18.2	21.3			0.6	0.7	2.3	2.9	14.3	46.2	25.1	1.3	0.0			1.0	33.3	33.3	34.7	14.2	9.1	4.2	7.2	11.6	10.1	15.0	26.2	1.0	43.3			1.2	12.1	0.1	6.5	11.6	25.2				3.7		5.5	19.7	6.3	27.4	17.8	9.6	3.7	6.8		26.3		19.9	5.2	5.4			14.5	20.3	12.2	36.3	13.4	0.1		4.5	4.4	1.8	2.8	0.2	0.4	3.8	0.0	5.1		1.9	7.5		0.8	2.5	3.5	1.3	3.9	7.1				5.3	3.4		10.8		8.1	8.0	4.4	4.9	13.3	3.6	10.0	0.0	1.4	0.9	4.3	6.6	3.4	1.9	2.8	19.2	9.0	14.4	0.1	3.3	2.3	8.8	14.7	0.3	1.9	12.0	1.4	32.9	17.2	39.7	49.7	0.2	7.4	0.8	5.8	13.7	0.6			7.3		4.9	17.3	0.2	9.6	8.0		24.3	32.8	6.4	1.6		33.5	7.4	21.5	5.4	0.8	3.7	0.2	0.9	0.8	15.3	9.7	14.0	5.6	0.1	4.0	9.1	32.9	19.4	11.8	15.8	2.9	7.8	10.1	43.1		13.1	6.7	16.3	0.1	11.3	3.1	7.9	6.4	12.5	5.3	0.2	0.2	0.1	3.9	11.4	11.0	7.4	3.5		0.9	20.5	0.0			4.8	8.3	24.1	0.9	5.8		7.8	2.5	26.1	17.1	3.2	0.0		5.0	9.4	2.2				2.5
por	1.5	23.1	2.8	0.4	0.3	6.7		5.9	0.9	20.0	0.8	7.3	3.6	2.9	5.4	8.4	4.3	3.5	5.5			3.4	22.6	39.5	19.1	18.2			0.7	0.8		3.0	14.3	48.6	28.1	1.7	0.0			0.9	34.7	40.5	35.9	14.4	9.6	4.7	7.5	5.5	9.8	15.9	30.2	1.2	37.2			1.3	12.3		6.6	12.1	43.9				4.7		5.1	16.5	6.8		27.0	10.0	3.7	6.8		19.0		19.7	5.2	5.4			14.1	15.0	12.2	41.6	13.4			3.3	4.7	2.0	2.8	0.1	0.4	3.8	0.0	5.0		1.9	9.0		0.8	2.9	3.7	1.7	3.9	8.1				6.5	6.6	6.6	11.2	0.6	8.0	8.0	4.2	5.1	13.7	3.9	9.5	1.2	1.7	1.3	4.5	6.2	4.1	1.1	2.6	20.4	7.9	16.1	0.1	3.2	2.4	9.0	10.0	0.3	2.2	16.7	1.4	29.0	18.2	22.4	52.1	0.3	7.9	1.1	6.1	21.2	0.7			7.6		5.0	18.2		11.1	7.8		26.0	54.9	6.7	1.4		35.1	4.6	17.6	5.1	0.6	4.6	0.1	0.9	0.7	14.9	18.0	13.6	5.2	0.1	3.8	9.0	38.9	21.7	12.3	16.8	3.1	8.4	11.1	42.8		13.8	7.3	16.1	0.2	5.1	3.1	8.0	7.0	12.6	5.2	0.2			4.3	11.7	11.2	7.4	3.7		1.3	19.4	0.6			1.4		21.3	1.1	5.5		7.9	2.9	26.0	17.3	3.9			4.6		2.4				2.5
spa	1.3	37.0	2.3	0.4	0.2	9.4		4.6	0.3	14.4	0.4	7.5	3.2	2.1	4.3	16.7	3.6	3.5	4.8			2.8	27.9	38.8	14.5	19.1			0.7	0.7	1.7	3.2	12.5	31.5	24.6	1.3	0.0			0.8	23.5	31.9	35.2	13.1	15.2	4.5	6.7	5.4	9.2	15.6	23.9	1.1	31.6			1.3	9.0		15.1	10.8	36.0				6.1		3.0	11.5	6.2	26.1	17.9	8.4	3.9	5.5		32.4		15.8	4.4	5.3			12.0	12.5	18.1	32.2	10.2	0.1		6.5	4.3	1.6	2.7	0.1	0.4	3.5	0.0	4.8		1.8	6.9		0.4	2.4	3.6	1.3	3.5	6.4		9.7	11.2	4.7	11.6		11.1			6.2	3.0	4.0	24.3	3.3	8.0	0.8	1.4	0.8	4.5	5.2	2.7	1.1	2.3	28.5	8.4	12.6	0.1	3.2	2.1	8.6	12.9	0.2	2.3	16.4	1.3	33.7	15.4	37.1	54.3	0.3	6.8	0.8	5.6	13.1	0.7			5.8		4.6	12.9		8.7	6.7		26.5	36.9	5.8	1.4		33.9	7.8	22.2	4.6	0.5	3.6	0.2	0.7	0.6	13.2	15.8	12.7	4.0	0.1	3.7	7.4	50.3	21.3	8.9	13.6	2.4	6.4	10.8	30.8		11.0	5.2	16.1	0.1	10.2	3.1	6.3	6.9	12.8	4.5	0.2	0.5		4.2	10.6	10.8	5.7	3.5		0.8	27.0	0.0			1.2		24.1	1.0	5.2		5.9	2.9	26.7	13.9	3.6			3.8	9.4	2.3				2.4

color:
score:	0	10	20	30	40	50	60	70	80	90	100