BioASQ Participants Area

Test Results for GutBrainIE Task

The evaluation measures indicating the performance of the systems that submitted results are presented below.

+ Participant Teams Overview

Team ID	Affiliation	Country
6	University of Zurich	Switzerland
ata2425ds	University of Padua	Italy
ataupd2425-gainer	University of Padua	Italy
ataupd2425-pam	University of Padua	Italy
BIU-ONLP	Bar Ilan University	Israel
DS@GT-bioasq-task6	NA	United States
DS@GT-BioNER	NA	Canada
Graphswise-1	Graphwise	Bulgaria
greenday	Stony Brook University	United States
Gut-Instincts	Aalborg University	Denmark
ICUE	University of Edinburgh	United Kingdom
lasigeBioTM	LASIGE, Faculdade de Ciências, Universidade de Lisboa	Portugal
LYX-DMIIP-FDU	Fudan University	China
NLPatVCU	Virginia Commonwealth University	United States
ONTUG	University of Technology, Graz; ontotext, Bulgaria	Austria
Schemalink	Dept. of Computer Science, University of Milan	Italy
ToGS	University of Technology, Graz	Austria

+ Subtask 6.1 (NER)

Team ID	Run ID	Macro-P	Macro-R	Macro-F1	Micro-P	Micro-R	Micro-F1
6	2	0.7950	0.7736	0.7613	0.8384	0.8432	0.8408
Gut-Instincts	5eedev	0.7619	0.7813	0.7591	0.8286	0.8480	0.8382
NLPatVCU	ensemble1	0.8139	0.7161	0.7169	0.8255	0.8488	0.8370
ICUE	ensemble5	0.8216	0.7451	0.7546	0.8369	0.8294	0.8331
LYX-DMIIP-FDU	run1	0.7605	0.7910	0.7347	0.8020	0.8513	0.8259
ata2425ds	trf	0.7199	0.7546	0.7217	0.7914	0.8432	0.8164
greenday	1	0.7368	0.7682	0.7471	0.7956	0.8278	0.8114
Graphswise-1	13	0.7691	0.7398	0.7185	0.8066	0.7955	0.8010
BASELINE	Organizers	0.6883	0.7690	0.7047	0.7639	0.8238	0.7927
ataupd2425-gainer	ma	0.5808	0.5322	0.5281	0.8333	0.7397	0.7837
DS@GT-bioasq-task6	1	0.6342	0.7849	0.6872	0.7337	0.8197	0.7743
DS@GT-BioNER	run2	0.6731	0.6497	0.6469	0.7783	0.7437	0.7606
ataupd2425-pam	3	0.6400	0.7435	0.6763	0.6809	0.7745	0.7247
Schemalink	1	0.4813	0.5038	0.4650	0.5547	0.5659	0.5602
BIU-ONLP	3	0.4393	0.3585	0.3711	0.4916	0.4721	0.4816
lasigeBioTM	R1	0.2206	0.1034	0.0863	0.3471	0.1964	0.2509

+ Subtask 6.2.1 (Binary Tag-Based RE)

Team ID	Run ID	Macro-P	Macro-R	Macro-F1	Micro-P	Micro-R	Micro-F1
Gut-Instincts	6219eedev3re	0.5166	0.6315	0.5386	0.6304	0.7532	0.6864
ONTUG	union	0.4185	0.4074	0.4057	0.7121	0.6104	0.6573
Graphswise-1	104	0.4043	0.3748	0.3832	0.7418	0.5844	0.6538
ataupd2425-pam	A7	0.4807	0.6091	0.4993	0.5671	0.7316	0.6389
BIU-ONLP	4	0.4632	0.3379	0.3713	0.7453	0.5195	0.6122
BASELINE	Organizers	0.4650	0.3564	0.3864	0.7584	0.4892	0.5947
LYX-DMIIP-FDU	run1	0.3637	0.4269	0.3688	0.6168	0.5714	0.5933
NLPatVCU	C18	0.3975	0.8419	0.5082	0.4381	0.8571	0.5798
Schemalink	1	0.3758	0.6573	0.4421	0.4531	0.7533	0.5659
ataupd2425-gainer	bp	0.3171	0.3254	0.2969	0.6150	0.4979	0.5504
ICUE	run17	0.3559	0.8790	0.4751	0.3894	0.9221	0.5476
ToGS	hermes8bragreorder	0.2211	0.1304	0.1451	0.5701	0.2641	0.3610

+ Subtask 6.2.2 (Ternary Tag-Based RE)

Team ID	Run ID	Macro-P	Macro-R	Macro-F1	Micro-P	Micro-R	Micro-F1
Gut-Instincts	6229eedev3re	0.4663	0.6445	0.5184	0.6280	0.7572	0.686567
ataupd2425-pam	B7	0.4409	0.5704	0.4694	0.5853	0.7202	0.6458
ONTUG	union	0.4254	0.4025	0.4058	0.7059	0.5926	0.6443
Graphswise-1	105	0.4120	0.3709	0.3840	0.7326	0.5638	0.6372
ICUE	run22	0.4011	0.7123	0.4880	0.4974	0.7860	0.6093
BIU-ONLP	4	0.4725	0.3288	0.3630	0.7362	0.4939	0.5911
BASELINE	Organizers	0.4729	0.3421	0.3745	0.7533	0.4650	0.5751
NLPatVCU	C19	0.3810	0.8005	0.4868	0.4362	0.8436	0.5750
LYX-DMIIP-FDU	run1	0.3625	0.4171	0.3549	0.5973	0.5432	0.5690
Schemalink	1	0.3756	0.6592	0.4437	0.4523	0.7613	0.5675
ataupd2425-gainer	td	0.3167	0.2315	0.2528	0.7405	0.3992	0.5187
ToGS	hermes8bragreorder	0.2261	0.1267	0.1414	0.5556	0.2469	0.3419
lasigeBioTM	R1	0.0797	0.0622	0.0646	0.3929	0.0453	0.0812

+ Subtask 6.2.3 (Ternary Mention-Based RE)

Team ID	Run ID	Macro-P	Macro-R	Macro-F1	Micro-P	Micro-R	Micro-F1
Gut-Instincts	6239eedev3re	0.3310	0.4303	0.3497	0.4215	0.5147	0.4635
Graphswise-1	107	0.3323	0.2369	0.2603	0.4686	0.3097	0.3729
ICUE	run23	0.2509	0.4239	0.2825	0.2858	0.5054	0.3651
LYX-DMIIP-FDU	run1	0.2106	0.2418	0.1990	0.3682	0.3257	0.3457
ONTUG	union	0.2589	0.2293	0.2266	0.3529	0.3231	0.3373
BASELINE	Organizers	0.3514	0.1829	0.2123	0.4986	0.2453	0.3288
Schemalink	1	0.2265	0.4088	0.2546	0.1948	0.4665	0.2749
ataupd2425-pam	C7	0.1940	0.2764	0.1982	0.2278	0.3432	0.2738
ataupd2425-gainer	tms	0.2203	0.1384	0.1538	0.4272	0.1810	0.2542
NLPatVCU	C11	0.1522	0.5041	0.2163	0.1423	0.6005	0.2300
BIU-ONLP	4	0.1171	0.0854	0.0879	0.2339	0.1461	0.1799
ToGS	hermes3bloraragreorder	0.0249	0.0180	0.0203	0.1702	0.0536	0.0815
lasigeBioTM	R1	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000

Copyright © 2023, the BioASQ Challenge (http://bioasq.org)

Platinum sponsors of the BioASQ Challenge between 2012 and 2023

Google was a proud sponsor of the BioASQ Challenge from 2018 to 2022.
BioASQ was supported by the National Library of Medicine of the National Institutes of Health under award number R13LM012214. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
The research leading to these results has received funding from the European Commission's Seventh Framework Programme (FP7/2007-2013, ICT-2011.4.4(d), Intelligent Information Management, Targeted Competition Framework) under grant agreement n° 318652.