OPUS-MT Dashboard

Language pair: [eng-fra] all languages
Models: [all models] [OPUS-MT] [external] [compare]
Selected: Tatoeba-MT-models/mul-deu+eng+fra+por+spa/opusTCv20230926max50+bt+jhubc_transformer-big_2024-05-30
Benchmark: all benchmarks [download]
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart] [heatmap]

Selected Benchmark: [avg] [flores200-devtest] [ntrex128] [tatoeba-test-v2021-08-07] [tatoeba-test-v2021-03-30] [tico19-test] [tatoeba-test-v2020-07-28] [multi30k_test_2016_flickr] [multi30k_test_2018_flickr] [newssyscomb2009] [newstest2008] [newstest2009] [newstest2010] [newstest2011] [newstest2012] [newstest2013] [newstest2019] [generaltest2022] [newstest2014] [newstest2015] [newstest2016] [newstest2017] [newstest2018] [newstest2021] [multi30k_test_2017_flickr] [multi30k_test_2017_mscoco] [newstest2020]
Scores shown in percentage points

	deu	eng	fra	por	spa
acm	16.2	25.4	23.2	21.7	16.7
afr	31.9	52.9	29.8	30.3	40.1
aka	2.8	5.0	4.2	3.7	4.1
amh	7.7	16.7	7.0	6.4	6.2
apc	14.7	24.0	21.7	20.7	15.6
ara	29.8	29.7	21.4	13.2	20.5
arq		6.6
arz	12.6	19.8	19.2	17.7	14.3
asm	5.4	11.2	9.5	7.7	7.0
ast	21.1	33.9	30.1	30.3	20.7
awa	13.9	31.9	19.6	18.0	14.0
aze_Latn	12.6	19.9	15.9	15.4	18.7
bak	5.8	12.8	8.8	8.0	8.9
bam	2.7	6.1	4.9	4.4	4.3
ban	8.2	18.0	12.4	12.5	9.9
bel	31.0	26.5	31.0	16.0	32.0
bem	6.3	12.6	9.2	9.0	9.4
ben	13.3	21.0	11.5	11.0	10.5
bho	9.9	16.4	14.0	13.5	11.5
bod	0.0	0.0	0.0	0.0	0.0
bos_Latn		61.8
bre		20.6	11.1
bug	4.6	9.3	7.7	7.4	6.8
bul	36.4	39.6	39.5	26.8	34.1
cat	34.7	42.4	43.8	45.7	43.7
ceb	14.5	28.5	25.3	26.6	18.7
ces	23.6	32.7	31.9	26.2	29.1
cha		7.0
chv		17.7
cjk	2.5	4.4	4.0	3.9	3.9
ckb	9.1	6.8	6.2	6.0	4.8
cmn_Hans	18.3	22.0	22.4	20.9	24.6
cmn_Hant	18.8	19.9	21.7	23.6	22.1
cor	4.1	3.4	5.0		1.7
crh	12.1	17.7	17.7	16.0	12.5
cym	16.2	36.3	21.7	20.4	19.9
dan	40.6	52.2	48.5	47.3	34.5
deu	35.1	33.1	31.3	32.2	31.6
dik	2.4	5.2	3.6	3.5	4.0
din		6.5	0.0	4.9	6.7
div	0.0	0.0	0.0	0.0	0.0
dsb	30.7
dtp		1.8
dyu	1.8	3.1	3.0	2.6	2.7
dzo	0.0	0.0	0.0	0.0	0.0
ell	29.3	46.8	44.0	36.8	30.3
eng	26.0	69.4	35.3	38.1	34.4
epo	35.3	45.2	37.0	38.0	38.1
est	36.7	34.2	25.2	22.9	22.2
eus	27.4	31.4	20.9	20.8	27.6
ewe	2.7	5.2	3.7	3.6	4.1
fao	13.1	29.3	15.5	15.0	13.5
fas	22.8	26.6	24.5	8.8	10.5
fij	6.8	13.4	9.4	9.1	8.9
fil	18.1	38.2	22.5	22.5	26.0
fin	32.3	31.7	36.3	36.7	36.4
fon	2.3	3.9	3.1	2.8	3.3
fra	27.4	35.8	43.2	34.6	34.3
frr	5.6
fry		36.5
fuc	3.8	7.9	5.3	5.2	6.3
fur	16.8	28.0	25.5	24.7	17.6
gcf			10.5
gla	8.3	20.3	12.0	11.0	15.7
gle	14.2	34.8	18.8	18.0	17.6
glg	22.8	45.5	30.5	48.0	42.1
gos	20.0	21.7
got		0.0
grc		6.2
grn	7.9	12.7	11.8	10.9	11.1
gsw		25.0
guj	9.4	18.1	12.9	11.8	13.4
hat	17.1	29.9	31.8	24.7	16.7
hau	7.3	12.0	8.3	7.8	7.9
hbs	48.8	52.7	44.3		51.9
heb	26.6	39.4	31.0	34.8	30.3
hin	15.8	24.9	13.6	13.1	12.0
hmn	3.1	5.7	4.3	3.9	4.7
hne	15.0	27.2	20.5	19.2	14.6
hoc		1.0
hrv	31.6	46.3	34.5	27.2	40.6
hsb	33.3
hun	24.0	29.9	30.5	28.0	24.5
hye	13.6	19.4	18.0	16.4	15.7
ibo	8.3	15.8	11.1	10.3	10.8
ido_Latn		32.6
iku		1.0
ilo	15.8	31.9	21.0	21.1	15.9
ind	32.1	29.7	29.3	17.3	15.6
isl	32.4	34.9	21.2	20.6	31.0
ita	31.6	46.7	43.1	43.2	36.3
jav	14.6	20.1	19.9	20.1	14.0
jbo	0.3	0.3	0.1		0.1
jbo_Latn		0.3
jpn	15.8	14.1	19.7	18.5	19.3
kab	7.4	12.3	8.4	5.5	8.7
kac	3.3	6.3	4.9	4.7	5.2
kam	3.0	6.4	4.7	5.2	4.9
kan	5.8	12.2	9.8	5.8	9.3
kas_Arab	1.5	2.5	3.2	2.2	2.6
kas_Deva	1.4	3.4	2.1	1.8	2.2
kat	10.0	25.9	13.8	12.2	12.4
kau		8.7	6.4	6.8	8.4
kaz	11.1	21.2	15.6	14.9	14.9
kaz_Cyrl		30.9
kbp	2.3	4.4	4.0	3.2	3.3
kea	16.6	32.2	24.6	28.2	17.4
kha		1.6
khm	2.6	7.1	5.1	1.8	5.4
kik	4.1	8.3	7.5	7.0	6.4
kin	9.0	11.4	8.6	7.8	8.1
kmb	2.9	5.5	4.8	5.0	4.8
kmr	4.8	8.0	6.8	6.9	7.2
kon	7.1	11.6	11.3	10.3	8.8
kur_Latn	14.6	14.4
lad	25.8	29.8			38.9
lad_Latn		35.7			44.0
lao	2.4	3.5	7.8	2.4	2.5
lat	22.4	21.5	9.4	13.5	21.5
lat_Latn				13.5
lav	15.4	31.3	18.4	18.3	21.6
lfn_Cyrl		5.6		5.6
lfn_Latn	32.1	33.8	35.5	31.0
lij	17.0	28.3	26.0	24.1	18.0
lim	13.5	21.6	16.5	16.2	12.8
lin	9.7	8.2	7.0	6.8	5.2
lit	26.3	40.4	23.5	22.0	36.9
lmo	11.9	20.7	19.4	19.1	14.0
ltz	38.3	41.7	23.8	22.3	19.8
lua	3.4	6.7	6.0	5.7	5.5
lug	4.6	4.8	3.5	3.1	2.7
luo	2.4	4.6	3.7	3.4	3.8
lus	5.2	9.5	7.3	7.1	6.7
mag	16.0	26.4	21.1	21.0	14.6
mai	12.4	22.5	18.1	17.5	13.3
mal	7.0	16.7	11.3	4.8	9.1
mar	11.8	27.8	10.5	9.5	9.7
mkd	22.9	44.2	28.2	27.9	40.5
mlg	10.2	16.5	13.2	12.5	14.5
mlt	22.4	40.6	29.7	30.0	26.1
mni	0.8	2.1	2.3	1.4	2.0
mon	7.3	17.7	9.5	9.1	11.0
mos	2.5	4.6	3.5	3.2	3.6
mri	8.2	17.5	11.4	10.3	11.4
msa	31.3	28.9	28.8	16.3	27.6
mya	2.5	7.1	2.7	2.1	1.7
nde	7.9	14.0	10.4	10.0	11.2
nds	44.3	40.6	43.1	38.4	41.6
nep	10.3	10.0	6.7	6.2	7.7
nld	40.2	47.5	38.3	32.6	39.2
nno	24.2	44.5	28.6	27.5	24.6
nob	31.8	44.6	42.6	27.5	39.3
nor	46.7	55.4	53.5	45.1	53.2
npi	13.0	22.8	18.0	17.3	13.0
nso	8.8	18.5	11.2	10.6	10.6
nus	1.7	1.8	1.6	1.1	1.3
nya	8.1	16.6	11.4	10.7	10.4
oci	24.0	27.9	28.5	34.5	21.0
orm	2.4	2.2	1.2	1.5	1.8
ota_Arab		1.2
ota_Latn		11.2
pag	10.5	21.5	14.2	15.2	11.8
pam		2.0
pan	10.6	16.2	14.4	12.9	12.3
pap	20.9	40.8	28.9	30.9	20.2
pcd			14.6
pes	19.0	35.3	25.6	24.2	17.6
plt	12.2	20.0	18.6	15.6	11.8
pms		19.6
pol	27.2	37.2	36.9	34.1	35.5
por	31.3	43.6	39.2	52.8	40.5
prs	16.1	17.3	13.9	13.6	12.0
pus	7.3	6.7	4.5	4.5	5.2
rom		4.6
ron	31.3	44.9	43.1	43.0	43.6
run	16.1	23.4	22.4	12.7	19.1
rus	30.6	34.5	29.9	22.0	29.9
sag	3.2	6.1	4.8	4.5	4.6
san	2.6	6.9	5.5	5.1	4.5
sat	0.0	0.0	0.0	0.0	0.0
scn	14.4	23.6	21.9	21.6	15.8
shi	0.0	2.1	2.5	0.0	2.6
shn	0.0	0.0	0.0	0.0	0.0
sin	4.2	3.4	7.0	3.5	2.5
slk	20.9	32.0	25.2	24.0	22.8
slv	37.7	43.3	35.5	24.5	23.0
smo	9.3	17.1	13.2	12.4	12.1
sna	9.3	16.6	13.8	10.9	9.0
snd_Arab	0.0	0.0	0.0	0.0	0.0
som	8.0	11.0	7.7	6.4	6.6
sot	9.5	18.5	12.3	11.3	9.3
spa	27.3	34.4	34.0	37.9	50.7
sqi	20.1	48.8	24.3	25.4	29.3
srd	16.0	27.9	25.2	25.0	16.5
srp_Cyrl	19.8	41.8	25.4	24.4	21.2
ssw	8.1	15.7	11.2	9.9	10.0
sun	11.9	26.2	16.4	17.1	12.8
swa	16.5	33.2	10.2	10.3	12.1
swe	34.4	53.2	46.3	40.3	35.0
swg	8.6
swh	17.9	32.1	24.2	23.9	15.4
szl	17.6	25.5	23.8	22.6	16.4
tah	8.0	12.3	10.6	9.9	11.4
tam	6.8	15.7	6.7	3.9	5.9
tat	11.7	18.5	20.9	14.5	18.8
tel	8.7	18.7	12.5	10.2	11.4
tgk	14.3	19.5	19.1	17.2	14.0
tgk_Cyrl	10.5	15.1	13.4	12.3	14.3
tgl	21.5	24.3	20.6	18.7	22.4
tha	12.6	30.2	16.1	14.3	15.6
tir	3.1	6.2	4.9	3.8	4.5
tlh	0.7	0.8	1.0		0.4
tlh_Latn			1.0
ton	3.9	7.5	6.5	5.3	6.7
tpi	10.0	19.0	15.2	14.0	12.1
tsn	9.5	17.4	13.2	12.5	12.7
tso	7.0	15.3	10.7	8.6	7.8
tuk	8.4	14.5	11.6	11.2	11.2
tuk_Latn		19.4
tum	4.0	7.4	6.4	6.1	6.0
tur	25.2	31.5	33.1	28.7	38.7
twi	2.6	5.9	4.4	4.0	4.3
tzl		15.8
tzl_Latn		15.9
uig	3.6	8.8	11.3	4.8	5.0
uig_Arab		15.7	17.4
ukr	36.6	39.9	37.9	31.0	37.3
umb	2.7	4.4	4.1	3.9	3.9
urd	13.1	17.7	11.1	9.8	10.0
uzb_Latn		38.6
vec	14.3	27.7	23.9	23.6	16.5
ven	6.0	10.8	8.6	7.6	9.4
vie	21.0	31.6	25.9	21.9	27.3
war	19.0	31.1	25.5	27.4	18.8
wol	4.0	7.3	5.8	5.8	6.2
wuu			7.8
xal		5.5
xho	12.1	28.0	16.2	15.2	14.4
yid	11.2	18.3	17.2		12.1
yor	3.3	7.0	5.3	5.0	5.8
yue_Hans		4.8
yue_Hant		7.1
zsm_Latn		45.7
zul	11.4	15.0	10.2	9.3	8.9
zza		1.6

color:
score:	0	10	20	30	40	50	60	70	80	90	100