BioASQ Participants Area

Task 1b: Test Results of Phase A

The test results are presented in seperate tables for each type of annotation. The "System Description" of each system is used.
The evaluation measures that are used in Phase A and Phase B of Task 1B are presented here .

Test batch 1

Documents

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
MCTeamMM	0.2266	0.1481	0.1249	0.0892	0.0005
MCTeamMM10	0.0326	0.1481	0.0436	0.0892	0.0005
Top 50 Baseline	0.2470	0.2591	0.1920	0.1503	0.0024
Top 100 Baseline	0.2460	0.2845	0.1999	0.1606	0.0028
Wishart-S1	0.0465	0.0484	0.0350	0.0237	0.0001

Snippets

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
MCTeamMM	0.0000	0.0000	0.0000	0.0000	0.0000
MCTeamMM10	0.0000	0.0000	0.0000	0.0000	0.0000
Top 50 Baseline	0.1276	0.0816	0.0688	0.0512	0.0004
Top 100 Baseline	0.1264	0.0953	0.0748	0.0578	0.0004
Wishart-S1	0.0000	0.0000	0.0000	0.0000	0.0000

Concepts

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
MCTeamMM	0.0000	0.0000	0.0000	0.0000	0.0000
MCTeamMM10	0.0000	0.0000	0.0000	0.0000	0.0000
Top 50 Baseline	0.1208	0.7588	0.1721	0.4575	0.2034
Top 100 Baseline	0.0799	0.8583	0.1234	0.4718	0.2753
Wishart-S1	0.4643	0.4290	0.3662	0.3422	0.0632

RDF Triples

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
MCTeamMM	0.1866	0.5137	0.1831	0.1886	0.0101
MCTeamMM10	0.1866	0.5137	0.1831	0.1886	0.0101
Top 50 Baseline	0.1653	0.3676	0.1506	0.1483	0.0028
Top 100 Baseline	0.1500	0.5081	0.1718	0.2051	0.0056
Wishart-S1	0.2667	0.0423	0.0613	0.0417	0.0002

Test batch 2

Documents

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
MCTeamMM	0.1121	0.1375	0.0867	0.0522	0.0002
MCTeamMM10	0.0275	0.1375	0.0433	0.0522	0.0002
Wishart-S1	0.0819	0.1118	0.0772	0.0382	0.0002
Top 100 Baseline	0.1578	0.2867	0.1569	0.1090	0.0018
Top 50 Baseline	0.1577	0.2307	0.1482	0.0968	0.0015
Wishart-S2	0.0819	0.1118	0.0772	0.0382	0.0002

Snippets

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
MCTeamMM	0.0000	0.0000	0.0000	0.0000	0.0000
MCTeamMM10	0.0000	0.0000	0.0000	0.0000	0.0000
Wishart-S1	0.0564	0.0772	0.0491	0.0360	0.0002
Top 100 Baseline	0.0871	0.0858	0.0605	0.0337	0.0003
Top 50 Baseline	0.0855	0.0640	0.0515	0.0272	0.0002
Wishart-S2	0.0564	0.0772	0.0491	0.0360	0.0002

Concepts

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
MCTeamMM	0.0000	0.0000	0.0000	0.0000	0.0000
MCTeamMM10	0.0000	0.0000	0.0000	0.0000	0.0000
Wishart-S1	0.4023	0.4663	0.3742	0.4108	0.0937
Top 100 Baseline	0.0561	0.7833	0.0939	0.4634	0.2148
Top 50 Baseline	0.0974	0.7399	0.1455	0.4555	0.1989
Wishart-S2	0.3966	0.4794	0.3788	0.3653	0.0979

RDF Triples

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
MCTeamMM	0.0222	0.4403	0.0413	0.0763	0.0033
MCTeamMM10	0.0222	0.4403	0.0413	0.0763	0.0033
Wishart-S1	0.0000	0.0000	0.0000	0.0000	0.0000
Top 100 Baseline	0.0167	0.3404	0.0309	0.0844	0.0013
Top 50 Baseline	0.0311	0.3265	0.0540	0.0841	0.0013
Wishart-S2	0.0000	0.0000	0.0000	0.0000	0.0000

Test batch 3

Documents

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
Top 50 Baseline	0.2773	0.3185	0.2451	0.1771	0.0055
Top 100 Baseline	0.2731	0.3580	0.2449	0.1834	0.0065
MCTeamMM	0.0000	0.0000	0.0000	0.0000	0.0000
MCTeamMM10	0.0000	0.0000	0.0000	0.0000	0.0000

Snippets

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
Top 50 Baseline	0.1040	0.0857	0.0802	0.0527	0.0006
Top 100 Baseline	0.1035	0.0909	0.0816	0.0537	0.0007
MCTeamMM	0.0000	0.0000	0.0000	0.0000	0.0000
MCTeamMM10	0.0000	0.0000	0.0000	0.0000	0.0000

Concepts

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
Top 50 Baseline	0.0821	0.6977	0.1284	0.3937	0.1200
Top 100 Baseline	0.0537	0.7611	0.0853	0.4002	0.1253
MCTeamMM	0.0000	0.0000	0.0000	0.0000	0.0000
MCTeamMM10	0.0000	0.0000	0.0000	0.0000	0.0000

RDF Triples

System Name	Mean precision	Recall	F-Measure	MAP	GMAP
Top 50 Baseline	0.0339	0.2833	0.0571	0.0487	0.0005
Top 100 Baseline	0.0178	0.3136	0.0326	0.0492	0.0009
MCTeamMM	0.0139	0.1938	0.0253	0.0333	0.0005
MCTeamMM10	0.0139	0.1938	0.0253	0.0333	0.0005

Copyright © 2023, the BioASQ Challenge (http://bioasq.org)

Platinum sponsors of the BioASQ Challenge between 2012 and 2023

Google was a proud sponsor of the BioASQ Challenge from 2018 to 2022.
BioASQ was supported by the National Library of Medicine of the National Institutes of Health under award number R13LM012214. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
The research leading to these results has received funding from the European Commission's Seventh Framework Programme (FP7/2007-2013, ICT-2011.4.4(d), Intelligent Information Management, Targeted Competition Framework) under grant agreement n° 318652.