BioASQ Participants Area

Test Results for Task 1a

Here you can find the evaluation measures for the systems that have uploaded results for the test sets. The "System Description" of each system is used.
The tables are updated periodically as new annotations from MEDLINE become available. As a result, the values of the measures as well as the ranking may change while new annotations become available. When "-" are placed in a table it means that no results were available when the page was updated.
The baselines of the challenge are the systems: BioASQ_Baseline and MTI First Line Index

Evaluation Overview

In the following table you can see the number of the articles for each test set that has been released. In parentheses, there is the number of the articles that have been annotated by the curators for each test set.
Batch 1 Batch 2 Batch 3
Week 1 1934(1592) 4869(4068) 7578(6022)
Week 2 830(743) 5551(4788) 10139(3918)
Week 3 790(762) 7144(6081) 8722(2969)
Week 4 2233(722) 4623(3908) 1976(1318)
Week 5 6562(5901) 8233(6651) 1744(1209)
Week 6 4414(4152) 8381(6762) 1357(696)

+ Dry-run test

+ Test batch 1, week 1

+ Test batch 1, week 2

+ Test batch 1, week 3

+ Test batch 1, week 4

+ Test batch 1, week 5

+ Test batch 1, week 6

+ Test batch 2, week 1

+ Test batch 2, week 2

+ Test batch 2, week 3

+ Test batch 2, week 4

+ Test batch 2, week 5

+ Test batch 2, week 6

+ Test batch 3, week 1

+ Test batch 3, week 2

+ Test batch 3, week 3

+ Test batch 3, week 4

+ Test batch 3, week 5

+ Test batch 3, week 6