OPUS-MT Dashboard

Language pair: [eng-fra] all languages
Models: [all models] [OPUS-MT] [external] [compare]
Selected: Tatoeba-MT-models/ine-deu+eng+fra+por+spa/opusTCv20230926max50+bt+jhubc_transformer-big_2024-05-30
Benchmark: all benchmarks [download]
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart] [heatmap]

Selected Benchmark: [avg] [flores200-devtest] [ntrex128] [tatoeba-test-v2021-08-07] [tatoeba-test-v2021-03-30] [tatoeba-test-v2020-07-28] [tico19-test] [multi30k_test_2016_flickr] [multi30k_test_2018_flickr] [newssyscomb2009] [newstest2008] [newstest2009] [newstest2010] [newstest2011] [newstest2012] [newstest2013] [newstest2019] [generaltest2022] [newstest2014] [newstest2015] [newstest2016] [newstest2017] [newstest2018] [newstest2021] [multi30k_test_2017_flickr] [multi30k_test_2017_mscoco] [newstest2020]
Scores shown in percentage points

	deu	eng	fra	por	spa
afr	34.9	55.8	32.5	32.2	43.4
asm	6.1	15.4	10.0	10.6	7.6
ast	24.1	36.2	32.3	31.7	21.4
awa	17.0	36.5	22.6	22.0	16.1
bel	34.5	29.1	33.5	18.6	32.1
ben	15.6	24.4	13.7	12.7	12.1
bho	12.9	19.5	17.1	16.4	13.6
bos_Latn		64.6
bre		30.3	20.1
bul	40.7	42.5	41.9	28.6	37.3
cat	38.1	45.4	45.9	48.1	45.0
ces	26.2	35.5	34.1	28.2	31.0
ckb	12.9	9.1	9.0	8.4	6.3
cor	4.9	6.8	7.1		3.3
cym	21.5	45.4	27.4	26.1	24.1
dan	44.0	54.9	50.3	47.7	36.5
deu	34.9	35.7	33.7	34.4	33.7
div	0.0	0.0	0.0	0.0	0.0
dsb	37.2
ell	32.3	50.6	46.9	41.0	32.8
eng	31.8	60.0	37.5	47.8	39.8
fao	15.9	33.1	17.5	17.1	15.8
fas	25.9	29.0	26.4	9.3	11.7
fra	29.9	38.1	39.5	35.8	35.7
frr	7.0
fry		36.7
fur	21.1	32.6	30.0	28.8	19.8
gcf			12.9
gla	12.7	24.5	17.0	16.6	20.1
gle	17.9	40.4	22.9	22.1	21.1
glg	25.1	48.1	32.0	47.8	43.4
gos	23.6	22.1
got		0.0
grc		9.6
gsw		32.9
guj	13.7	24.1	18.4	17.5	17.4
hat	20.0	33.1	35.0	27.7	18.9
hbs	51.5	55.6	46.5		53.1
hin	17.8	27.7	15.5	14.9	13.4
hne	19.1	33.1	25.7	24.8	17.0
hrv	33.1	48.5	36.9	29.0	42.2
hsb	43.0
hye	17.2	25.3	22.0	20.8	19.3
isl	37.1	39.2	24.7	23.3	33.2
ita	34.0	48.8	45.3	44.7	37.4
kas_Arab	1.8	3.0	3.3	0.0	0.0
kas_Deva	1.4	3.0	1.7	1.9	2.1
kea	19.5	35.5	27.0	31.7	19.0
kmr	8.6	12.6	11.2	10.7	10.7
kur_Latn	25.8	22.6
lad	6.2	28.7			26.2
lad_Latn		37.3			44.0
lat	24.8	24.0	10.2	15.2	24.2
lat_Latn				15.2
lav	18.1	34.9	20.1	20.1	23.9
lij	20.8	32.6	30.4	28.3	19.7
lim	15.0	19.6	18.5	16.8	14.0
lit	29.7	43.8	26.0	24.6	40.6
lmo	15.2	24.1	22.7	22.5	16.3
ltz	37.2	45.4	27.6	23.6	21.1
mag	19.5	33.0	26.0	25.2	17.2
mai	17.1	28.3	23.3	22.4	16.2
mar	14.4	31.4	12.1	11.8	11.3
mkd	25.1	47.3	30.5	30.0	41.7
nds	48.1	45.4	47.2	40.4	46.1
nep	11.3	12.0	7.6	7.2	8.4
nld	42.7	49.9	40.3	34.2	41.1
nno	26.1	47.9	31.1	29.5	26.2
nob	33.9	46.9	44.7	29.3	41.6
nor	49.2	58.0	56.7	47.5	56.1
npi	15.5	27.8	20.7	20.6	14.6
oci	27.9	31.4	31.4	36.9	22.8
pan	13.9	21.7	18.3	16.6	16.2
pap	25.0	45.3	32.4	34.6	22.1
pcd			15.4
pes	21.9	38.5	29.3	27.4	19.5
pms		20.4
pol	30.1	40.0	39.2	36.3	37.8
por	34.0	45.7	40.9	50.5	42.0
prs	18.2	19.4	15.5	14.9	13.2
pus	9.0	8.4	5.4	5.3	6.5
rom		12.2
ron	33.0	47.6	44.6	44.3	45.3
rus	33.3	37.2	32.1	23.6	31.9
san	3.9	8.2	6.3	6.1	5.2
scn	18.0	27.6	25.9	25.3	17.5
sin	6.9	9.8	10.1	7.4	8.4
slk	23.3	35.5	28.4	26.4	24.8
slv	41.2	47.0	37.0	26.6	24.9
snd_Arab	0.0	0.0	0.0	0.0	0.0
spa	29.3	36.1	35.5	39.1	51.3
sqi	22.0	52.2	26.0	26.7	31.2
srd	19.3	31.6	28.4	27.1	18.2
srp_Cyrl	23.6	44.9	28.7	27.5	23.6
swe	37.8	56.0	48.0	42.9	36.6
swg	13.5
szl	23.2	31.1	30.3	28.0	19.8
tgk	16.7	23.1	22.5	20.1	15.9
tgk_Cyrl	12.2	18.1	15.5	14.5	17.2
tpi	12.1	21.1	17.5	16.9	13.7
ukr	39.7	43.0	39.8	33.2	39.9
urd	15.7	20.9	13.5	12.1	11.6
vec	18.6	30.3	27.3	26.5	18.3
yid	7.1	19.3	20.9		8.2
zza		1.4

color:
score:	0	10	20	30	40	50	60	70	80	90	100