BioASQ Participants Area

Test Results for Task 5c

The evaluation measures indicating the performance of the systems that submitted results are presented below.
The evaluation measure is micro-recall, as described in "Evaluation" section of Guidelines.
The source code for measure calculation is available here.

+ Dry Run

Measures

System	Grant ID MiR	Grant Agency MiR	Full Grant MiR
Asclepius	0.8909	0.9681	0.8800
DZG1	0.9009	0.8748	0.8291
simpleSystem	0.8746	0.9343	0.8647
DZG2	0.9009	0.8748	0.8291
BioASQ Filtering	0.6008	0.7317	0.5784
BioASQ agency search	0.0000	0.5776	0.0000

+ Test Run

Measures

System	Grant ID MiR	Grant Agency MiR	Full Grant MiR
Asclepius	0.9472	0.9859	0.9390
Hippocrates	0.9491	0.9859	0.9409
Galen	0.9498	0.9862	0.9412
DZG-agency	0.0000	0.8829	0.0000
DZG-grants	0.9235	0.0000	0.0000
DZG1	0.9232	0.9122	0.8443
Simple_ML2	0.9705	0.9900	0.9526
Simple_ML	0.9702	0.9907	0.9523
BioASQ Filtering	0.8167	0.8312	0.7174
simpleSystem	0.9684	0.9890	0.9505
Simple_Regex	0.9530	0.9844	0.9397
Simple_Regex2	0.9550	0.9847	0.9416
BioASQ agency search	0.0000	0.5798	0.0000
BioASQ GrantID	0.1220	0.0000	0.0000