BioASQ Participants Area
Task Synergy: Test Results  To Be Announced
Test batch 1
Documents
System 
Mean precision 
Recall 
FMeasure 
MAP 
GMAP 
Snippets
System 
Mean precision 
Recall 
FMeasure 
MAP 
GMAP 
Exact Answers

Yes/No 
Factoid 
List 
System 
Accuracy 
F1 Yes 
F1 No 
Macro F1 
Strict Acc. 
Lenient Acc. 
MRR 
Mean Prec. 
Recall 
FMeasure 
Ideal Answers

Automatic scores (Rouge  R) 
Manual scores 
System 
R2 (Rec) 
R2 (F1) 
RSU4 (Rec) 
RSU4 (F1) 
Readability 
Recall 
Precision 
Repetition 
Test batch 2
Documents
System 
Mean precision 
Recall 
FMeasure 
MAP 
GMAP 
Snippets
System 
Mean precision 
Recall 
FMeasure 
MAP 
GMAP 
Exact Answers

Yes/No 
Factoid 
List 
System 
Accuracy 
F1 Yes 
F1 No 
Macro F1 
Strict Acc. 
Lenient Acc. 
MRR 
Mean Prec. 
Recall 
FMeasure 
Ideal Answers

Automatic scores (Rouge  R) 
Manual scores 
System 
R2 (Rec) 
R2 (F1) 
RSU4 (Rec) 
RSU4 (F1) 
Readability 
Recall 
Precision 
Repetition 
Test batch 3
Documents
System 
Mean precision 
Recall 
FMeasure 
MAP 
GMAP 
Snippets
System 
Mean precision 
Recall 
FMeasure 
MAP 
GMAP 
Exact Answers

Yes/No 
Factoid 
List 
System 
Accuracy 
F1 Yes 
F1 No 
Macro F1 
Strict Acc. 
Lenient Acc. 
MRR 
Mean Prec. 
Recall 
FMeasure 
Ideal Answers

Automatic scores (Rouge  R) 
Manual scores 
System 
R2 (Rec) 
R2 (F1) 
RSU4 (Rec) 
RSU4 (F1) 
Readability 
Recall 
Precision 
Repetition 
Test batch 4
Documents
System 
Mean precision 
Recall 
FMeasure 
MAP 
GMAP 
Snippets
System 
Mean precision 
Recall 
FMeasure 
MAP 
GMAP 
Exact Answers

Yes/No 
Factoid 
List 
System 
Accuracy 
F1 Yes 
F1 No 
Macro F1 
Strict Acc. 
Lenient Acc. 
MRR 
Mean Prec. 
Recall 
FMeasure 
Ideal Answers

Automatic scores (Rouge  R) 
Manual scores 
System 
R2 (Rec) 
R2 (F1) 
RSU4 (Rec) 
RSU4 (F1) 
Readability 
Recall 
Precision 
Repetition 