BioASQ Participants Area
Oracle: Results for task B-Phase A
Below you can find the results of the official challenge and the results of the oracle highlighted purple. In addition, you can find your results as part of the results of the oracle even if you selected "not visible" during their submission (in this case they are visible only to you).
+ Task 1b, Test batch 1
Documents
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
MCTeamMM |
0.2266 |
0.1481 |
0.1249 |
0.0892 |
0.0005 |
MCTeamMM10 |
0.0326 |
0.1481 |
0.0436 |
0.0892 |
0.0005 |
Top 50 Baseline |
0.2470 |
0.2591 |
0.1920 |
0.1503 |
0.0024 |
Top 100 Baseline |
0.2460 |
0.2845 |
0.1999 |
0.1606 |
0.0028 |
Wishart-S1 |
0.0465 |
0.0484 |
0.0350 |
0.0237 |
0.0001 |
fdu_5b |
0.1865 |
0.2228 |
0.1791 |
0.1300 |
0.0084 |
Multiclass system |
0.4000 |
0.2222 |
0.2857 |
0.1238 |
0.1238 |
PersonalHealthRecord |
0.1600 |
0.1148 |
0.1274 |
0.1515 |
0.0002 |
Snippets
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
Top 50 Baseline |
0.1276 |
0.0816 |
0.0688 |
0.0512 |
0.0004 |
Top 100 Baseline |
0.1264 |
0.0953 |
0.0748 |
0.0578 |
0.0004 |
Concepts
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
Top 50 Baseline |
0.1208 |
0.7588 |
0.1721 |
0.4575 |
0.2034 |
Top 100 Baseline |
0.0799 |
0.8583 |
0.1234 |
0.4718 |
0.2753 |
Wishart-S1 |
0.4643 |
0.4290 |
0.3662 |
0.3422 |
0.0632 |
RDF triples
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
MCTeamMM |
0.1866 |
0.5137 |
0.1831 |
0.1886 |
0.0101 |
MCTeamMM10 |
0.1866 |
0.5137 |
0.1831 |
0.1886 |
0.0101 |
Top 50 Baseline |
0.1653 |
0.3676 |
0.1506 |
0.1483 |
0.0028 |
Top 100 Baseline |
0.1500 |
0.5081 |
0.1718 |
0.2051 |
0.0056 |
Wishart-S1 |
0.2667 |
0.0423 |
0.0613 |
0.0417 |
0.0002 |
+ Task 1b, Test batch 2
Documents
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
MCTeamMM |
0.1121 |
0.1375 |
0.0867 |
0.0522 |
0.0002 |
MCTeamMM10 |
0.0275 |
0.1375 |
0.0433 |
0.0522 |
0.0002 |
Wishart-S1 |
0.0819 |
0.1118 |
0.0772 |
0.0382 |
0.0002 |
Top 100 Baseline |
0.1578 |
0.2867 |
0.1569 |
0.1090 |
0.0018 |
Top 50 Baseline |
0.1577 |
0.2307 |
0.1482 |
0.0968 |
0.0015 |
Wishart-S2 |
0.0819 |
0.1118 |
0.0772 |
0.0382 |
0.0002 |
Snippets
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
Wishart-S1 |
0.0564 |
0.0772 |
0.0491 |
0.0360 |
0.0002 |
Top 100 Baseline |
0.0871 |
0.0858 |
0.0605 |
0.0337 |
0.0003 |
Top 50 Baseline |
0.0855 |
0.0640 |
0.0515 |
0.0272 |
0.0002 |
Wishart-S2 |
0.0564 |
0.0772 |
0.0491 |
0.0360 |
0.0002 |
Concepts
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
Wishart-S1 |
0.4023 |
0.4663 |
0.3742 |
0.4108 |
0.0937 |
Top 100 Baseline |
0.0561 |
0.7833 |
0.0939 |
0.4634 |
0.2148 |
Top 50 Baseline |
0.0974 |
0.7399 |
0.1455 |
0.4555 |
0.1989 |
Wishart-S2 |
0.3966 |
0.4794 |
0.3788 |
0.3653 |
0.0979 |
RDF triples
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
MCTeamMM |
0.0222 |
0.4403 |
0.0413 |
0.0763 |
0.0033 |
MCTeamMM10 |
0.0222 |
0.4403 |
0.0413 |
0.0763 |
0.0033 |
Top 100 Baseline |
0.0167 |
0.3404 |
0.0309 |
0.0844 |
0.0013 |
Top 50 Baseline |
0.0311 |
0.3265 |
0.0540 |
0.0841 |
0.0013 |
+ Task 1b, Test batch 3
Documents
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
Top 50 Baseline |
0.2773 |
0.3185 |
0.2451 |
0.1771 |
0.0055 |
Top 100 Baseline |
0.2731 |
0.3580 |
0.2449 |
0.1834 |
0.0065 |
main system |
1.0000 |
0.8986 |
0.9453 |
12.7258 |
9.7605 |
Snippets
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
Top 50 Baseline |
0.1040 |
0.0857 |
0.0802 |
0.0527 |
0.0006 |
Top 100 Baseline |
0.1035 |
0.0909 |
0.0816 |
0.0537 |
0.0007 |
main system |
0.0030 |
0.1358 |
0.0058 |
0.0031 |
0.0001 |
Concepts
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
Top 50 Baseline |
0.0821 |
0.6977 |
0.1284 |
0.3937 |
0.1200 |
Top 100 Baseline |
0.0537 |
0.7611 |
0.0853 |
0.4002 |
0.1253 |
main system |
0.1255 |
0.1599 |
0.1117 |
0.0581 |
0.0005 |
RDF triples
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
Top 50 Baseline |
0.0339 |
0.2833 |
0.0571 |
0.0487 |
0.0005 |
Top 100 Baseline |
0.0178 |
0.3136 |
0.0326 |
0.0492 |
0.0009 |
MCTeamMM |
0.0139 |
0.1938 |
0.0253 |
0.0333 |
0.0005 |
MCTeamMM10 |
0.0139 |
0.1938 |
0.0253 |
0.0333 |
0.0005 |
main system |
0.0000 |
0.0000 |
0.0000 |
0.0000 |
0.0000 |
+ Task 2b, Test batch 1
Documents
System Name |
Mean precision |
Recall |
F-Measure |
MAP |
GMAP |
Biomedical Text Ming |
0.2595 |
0.1919 |
0.1678 |
0.1040 |
0.0017 |
Wishart-S1 |
0.1447 |
0.1082 |
0.0858 |
0.0543 |
0.0002 |
SNUMedinfo1 |
0.0658 |
0.6114 |
0.1131 |
0.2794 |
0.0773 |
SNUMedinfo3 |
0.0661 |
0.6155 |
0.1136 |
0.2762 |
0.0744 |
SNUMedinfo4 |
0.0663 |
0.6154 |
0.1139 |
0.2675 |
0.0694 |
SNUMedinfo5 |
0.0667 |
0.6161 |
0.1146 |
0.2596 |
0.0662 |
SNUMedinfo2 |
0.0655 |
0.6030 |
0.1125 |
0.2727 |
0.0686 |
All-Figdoc |
0.0260 |
0.0528 |
0.0319 |
0.0082 |
0.0001 |
UMass-irSDM |
0.0275 |
0.0558 |
0.0339 |
0.0271 |
0.0002 |
Doc-Figdoc-UMLS |
0.0275 |
0.0558 |
0.0339 |
0.0081 |
0.0002 |
All-Figdoc-UMLS |
0.0275 |
0.0558 |
0.0339 |
0.0087 |
0.0002 |
Wishart-S2 |
0.1223 |
0.1248 |
0.0837 |
0.0601 |
0.0002 |
main system |
0.0447 |
0.2453 |
0.0713 |
0.1108 |
0.0018 |
Top 50 Baseline |
0.2495 |
0.3671 |
0.2275 |
0.1735 |
0.0062 |
Top 100 Baseline |
0.2477 |
0.3994 |
0.2269 |
0.1766 |
0.0076 |