BioASQ Participants Area

Test Results for ElCardioCC Task

The evaluation measures indicating the performance of the systems that submitted results are presented below.

+ Named Entity Recognition (NER)

Team Name	System	R	P	F1
droidlyx	system1	0.7059	0.7618	0.7328
ELCardioCC_baseline	mbert_baseline	0.6959	0.746	0.7201
svassileva	greek-bert-exact-bge-m3	0.7012	0.7328	0.7167
svassileva	greek-bert-statistical-bge-m3	0.7012	0.7328	0.7167
svassileva	greek-bert-statistical-sap	0.7012	0.7328	0.7167
svassileva	xlmr-exact-bge-m3	0.7079	0.7222	0.715
svassileva	xlmr-statistical-bge-m3	0.7079	0.7222	0.715
bhuang	5nm	0.6448	0.5205	0.5761
bhuang	1nm	0.4914	0.5331	0.5114
bhuang	2nm	0.6338	0.4	0.4905
bhuang	3nm	0.546	0.4387	0.4865
bhuang	4nm	0.6575	0.3601	0.4653
pjmathematician	config1	0.2484	0.2586	0.2534
pjmathematician	config2	0.2892	0.2188	0.2491
pjmathematician	config3	0.3297	0.1732	0.2271

+ Entity Linking (EL)

Team Name	System	R	P	F1
droidlyx	system1	0.6529	0.7046	0.6778
ELCardioCC_baseline	EL_baseline	0.6476	0.6942	0.6701
svassileva	greek-bert-exact-bge-m3	0.6548	0.6844	0.6693
svassileva	greek-bert-statistical-sap	0.6548	0.6844	0.6693
svassileva	greek-bert-statistical-bge-m3	0.654	0.6835	0.6684
svassileva	xlmr-statistical-bge-m3	0.6594	0.6728	0.666
svassileva	xlmr-exact-bge-m3	0.6585	0.6719	0.6651
bhuang	5nm	0.5927	0.4852	0.5336
bhuang	1nm	0.448	0.5	0.4726
bhuang	3nm	0.4963	0.4211	0.4556
bhuang	2nm	0.5734	0.3677	0.448
bhuang	4nm	0.5945	0.3374	0.4305
pjmathematician	config1	0.0616	0.0642	0.0629
pjmathematician	config2	0.0693	0.0525	0.0597
pjmathematician	config3	0.0212	0.0112	0.0146

+ MultiLabel Classification and explainable ai (MLC-X)

Team Name	System	SubTask 3a (MLC-X)			SubTask 3b (MLC-X)
Team Name	System	R	P	F1	R	P	F1
droidlyx	system1	0.8377	0.8569	0.8472	-	-	-
bhuang	5nm	0.825	0.6947	0.7543	-	-	-
ELCardioCC_baseline	MLCX1_baseline	0.7422	0.9339	0.8271	-	-	-
ELCardioCC_baseline	MLCX2_baseline	0.5864	0.9531	0.7261	0.4442	0.605	0.5122
bhuang	1nm	0.7676	0.6205	0.6863	-	-	-
bhuang	3nm	0.8237	0.5227	0.6395	-	-	-
bhuang	2nm	0.8355	0.5131	0.6358	-	-	-
bhuang	4nm	0.8576	0.4572	0.5965	-	-	-
pjmathematician	config5	0.2656	0.586	0.3655	-	-	-
pjmathematician	config4	0.2257	0.6056	0.3288	0.0932	0.2326	0.1331
kbogas	w2l_cb	0.3421	0.2115	0.2614	-	-	-
kbogas	w2l_emb_la	0.3421	0.2115	0.2614	-	-	-
kbogas	w2l_la	0.3421	0.2115	0.2614	-	-	-
kbogas	w2l_tf_cb	0.3421	0.2115	0.2614	-	-	-
kbogas	w2l_tfidf_la	0.3421	0.2115	0.2614	-	-	-

Copyright © 2023, the BioASQ Challenge (http://bioasq.org)

Platinum sponsors of the BioASQ Challenge between 2012 and 2023

Google was a proud sponsor of the BioASQ Challenge from 2018 to 2022.
BioASQ was supported by the National Library of Medicine of the National Institutes of Health under award number R13LM012214. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
The research leading to these results has received funding from the European Commission's Seventh Framework Programme (FP7/2007-2013, ICT-2011.4.4(d), Intelligent Information Management, Targeted Competition Framework) under grant agreement n° 318652.