OPUS-MT Dashboard

Language pair: [eng-fra] all languages
Models: [all models] [OPUS-MT] [external] [compare]
Selected: Tatoeba-MT-models/tatoeba-zero/opus-2020-06-21
Benchmark: all benchmarks [download]
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart] [heatmap]

Selected Benchmark: [avg] [tatoeba-test-v2020-07-28] [tatoeba-test-v2021-03-30] [tatoeba-test-v2021-08-07] [flores200-devtest] [flores101-devtest] [multi30k_test_2016_flickr] [multi30k_test_2017_flickr] [multi30k_test_2017_mscoco] [multi30k_test_2018_flickr] [newssyscomb2009] [newstest2009] [newstest2010] [newstest2011] [newstest2012] [newstest2013] [newstest2014] [newstest2015] [newstest2016] [newstest2017] [newstest2018] [newstest2019] [newstest2020] [newstest2021] [tico19-test]
Scores shown in percentage points

	awa	deu	dtp	egl	eng	epo	fin	fra	gos	hoc	hoc_Latn	ile	ile_Latn	ina_Latn	ind	ita	jpn	jpn_Hani	jpn_Hira	jpn_Kana	kha	lad	lad_Latn	lfn_Cyrl	lfn_Latn	nld	ota_Arab	ota_Latn	por	rus	spa	swg	toki	toki_Latn	tur	ukr	yid	zsm_Latn
awa	awa				0.1		0.0
deu	0.3	deu			20.5	23.8	13.2	18.0	0.5			0.1			20.7	19.0	10.1	0.7	0.1	0.3		0.2			1.5	25.5			20.4	14.9	19.8	0.1	0.0		13.0	17.0	0.2
dtp			dtp		0.8												0.3		0.4																			0.2
egl				egl												2.3
eng	0.2	16.0	0.3		eng	28.1	11.9	23.4	0.4	0.1	0.1	0.3			23.7	23.8	9.5	0.3	0.1	0.1	0.5	0.3	0.3	0.1	0.6	25.6	0.1	0.1	28.4	14.2	25.3		0.1		11.4	17.1	0.3	1.4
epo	0.3	20.3			30.5	epo	19.0	24.3				0.3	0.3		14.3	23.6	11.4	0.9	0.1			0.2	0.2		1.9	22.1			21.6	20.0	25.2		0.1		16.1	21.5	0.1
fin	0.1	17.4			16.7	24.8	fin	21.4							9.9	15.4	8.0	0.2	0.0	1.2						26.6			21.9	16.4	16.6				9.7	6.0
fra	0.3	15.8			25.5	26.3	18.1	fra				0.3			21.0	26.3	10.3	0.2	0.0						0.9	22.4			27.6	15.9	26.6		0.1	0.1	11.9	17.5	0.1
gos		14.3			10.5				gos																	10.6
hoc					0.5					hoc
hoc_Latn					0.5						hoc_Latn
ile		26.7			27.9	32.5		30.7				ile
ile_Latn						32.5							ile_Latn
ina_Latn														ina_Latn									0.2		1.3
ind	0.2	17.7			24.0	11.1	4.7	20.9							ind	16.8	6.8		0.1							8.1			13.0	6.5	9.8				4.0	6.3		1.2
ita	0.3	18.5		0.4	30.8	27.4	14.5	30.7							17.0	ita	10.0	0.0	0.1							25.0			28.2	17.4	30.0		0.5		11.2	18.5	0.2
jpn	0.1	9.0	0.0		10.2	15.9	6.1	11.5							7.0	9.2	jpn									13.3			10.8	8.5	12.3		0.0		6.0	9.2
jpn_Hani		12.7			15.4	18.2	10.8	15.1								12.3		jpn_Hani								24.6			15.1	10.6	18.8
jpn_Hira		11.7	0.0		14.7	18.8	8.5	13.9							14.1	11.8			jpn_Hira							18.1			12.4	11.7	15.7				7.4	10.8
jpn_Kana		11.7			16.9		11.4													jpn_Kana										15.6	20.9
kha					1.0																kha
lad		22.9			19.9	16.6																lad									21.9						0.1
lad_Latn					22.0	20.9								12.7									lad_Latn		1.4						21.6						0.1
lfn_Cyrl					1.7																			lfn_Cyrl					3.2
lfn_Latn		17.1			19.0	19.0		20.2						12.4									0.3		lfn_Latn				19.3								0.1
nld	0.3	24.9			29.9	23.6	22.2	24.9	0.3						11.3	22.9	11.4	1.2	0.2							nld			23.1	18.0	23.1		0.1		12.5	16.1
ota_Arab					0.0																						ota_Arab
ota_Latn					5.7																							ota_Latn
por	0.3	21.7			36.0	26.5	23.0	33.1							15.8	28.4	11.4	0.6	0.1					0.4	0.9	24.0			por	17.5	33.9		0.1		15.8	17.7
rus	0.3	17.0			19.9	25.1	14.6	19.7							11.1	17.6	9.8	0.2	0.1	0.4						20.0			18.6	rus	19.2		0.0	0.0	8.6	24.6	0.1
spa	0.3	16.4			26.0	26.6	15.6	26.0							11.2	27.5	11.4	0.3	0.0	0.2		0.7	0.8			21.9			29.9	15.7	spa		0.1		17.4	17.0	0.1
swg		5.8																														swg
toki		0.2			0.3	0.3		0.3								0.6	0.4									1.0			0.3	0.4	0.1		toki
toki_Latn								0.3																						0.4				toki_Latn
tur	0.2	17.0			17.8	23.2	10.1	17.5							8.8	14.2	7.7		0.3							17.3			17.0	11.0	22.0				tur	16.4
ukr	0.2	22.1			26.4	28.5	5.5	23.0							11.8	21.5	10.4		0.5							21.6			21.1	28.7	22.0				15.8	ukr
yid		15.6			12.8	13.4		14.8								13.4						0.1	0.1		0.8					12.2	13.2						yid
zsm_Latn			0.2		24.6										25.4																							zsm_Latn

color:
score:	0	10	20	30	40	50	60	70	80	90	100