OPUS-MT Dashboard

Language pair: [eng-fra] all languages
Models: [all models] [OPUS-MT] [external] [compare]
Selected: Tatoeba-MT-models/iir-deu+eng+fra+por+spa/opusTCv20230926max50+bt+jhubc_transformer-big_2024-05-30
Benchmark: all benchmarks [download]
Evaluation metric: bleu [spbleu][chrf][chrf++][comet]
Chart Type: [barchart] [heatmap]

Selected Benchmark: [avg] [flores200-devtest] [tatoeba-test-v2021-03-30] [tatoeba-test-v2021-08-07] [ntrex128] [tico19-test] [tatoeba-test-v2020-07-28]
Scores shown in percentage points

	deu	eng	fra	por	spa
asm	4.6	20.4	10.7	11.9	8.0
awa	16.9	36.5	22.7	23.1	15.9
ben	17.0	28.1	14.6	13.9	12.8
bho	14.0	23.5	18.8	18.4	13.8
ckb	13.1	12.2	9.7	9.1	6.5
div	1.1	0.0	0.0	1.4	0.0
fas	26.3	37.9	32.1	24.5	28.4
guj	16.1	32.1	20.8	20.1	18.9
hin	18.7	39.8	16.0	15.2	13.5
hne	20.3	39.3	27.3	27.2	17.6
kas_Arab	3.2	5.2	6.3	4.8	5.2
kas_Deva	1.9	4.8	3.0	2.9	2.7
kmr	7.7	13.3	10.2	9.8	10.1
kur_Latn	26.2	22.9
mag	21.7	39.3	27.6	28.0	17.9
mai	17.5	31.2	24.0	23.9	16.3
mar	14.6	39.6	13.1	12.9	11.7
nep	14.2	15.0	8.9	8.4	10.1
npi	17.8	34.2	23.8	24.1	16.8
pan	17.5	33.3	22.0	21.1	19.0
pes	21.8	41.0	28.8	28.0	19.7
prs	18.6	20.7	15.9	15.0	13.4
pus	11.0	11.0	6.5	6.2	7.6
rom		10.2
san	5.3	11.7	8.7	9.4	7.6
sin	14.4	26.6	19.0	18.4	17.0
snd_Arab	0.0	0.0	0.0	0.0	0.0
tgk	15.3	26.5	22.4	22.2	16.2
tgk_Cyrl	10.9	20.2	16.0	14.6	17.6
urd	17.0	32.2	14.4	13.7	12.9
zza		1.3

color:
score:	0	10	20	30	40	50	60	70	80	90	100