BioASQ Participants Area
Task 14b: Test Results of Phase A
* The "-" replace the scores of systems that didn't submit the corresponding annotations. *The test results are presented in separate tables for each type of annotation. They are sorted based on the scores of MAP. The "System Description" of each system is used.
The evaluation measures that are used are presented here .
Test batch 1
Documents
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.4180 | 0.2414 | 0.2350 | 0.3908 | 0.1378 |
| porties-baseline | 0.2800 | 0.1878 | 0.1742 | 0.2268 | 0.0291 |
| health-nlp-1 | 0.3180 | 0.2140 | 0.1932 | 0.2603 | 0.0480 |
| DS@GT BioASQ | 0.0313 | 0.0077 | 0.0114 | 0.0210 | 0.0001 |
| pancras_naive | 0.5608 | 0.2613 | 0.2783 | 0.4494 | 0.1859 |
| dictycite-baseline | 0.4900 | 0.2963 | 0.2841 | 0.4750 | 0.1650 |
| dictycite-snippet | 0.5063 | 0.3086 | 0.2972 | 0.4973 | 0.1896 |
| dictycite-max | 0.5838 | 0.3504 | 0.3424 | 0.5872 | 0.3790 |
| lean_rag_ft_sparse | 0.3952 | 0.2143 | 0.2212 | 0.3623 | 0.1101 |
| lean_rag_ft | 0.3950 | 0.2149 | 0.2212 | 0.3635 | 0.1111 |
| lean_rag | 0.4050 | 0.2232 | 0.2283 | 0.3721 | 0.1155 |
| Fleming-1 | 0.5850 | 0.3203 | 0.3289 | 0.5967 | 0.3368 |
| dictycite-max-rew-si | 0.5725 | 0.3531 | 0.3407 | 0.5753 | 0.3687 |
| dictycite-max-rew-sl | 0.5725 | 0.3496 | 0.3388 | 0.5780 | 0.3686 |
| Fleming-2 | 0.5850 | 0.3203 | 0.3289 | 0.5967 | 0.3368 |
| pancras_crag | 0.4407 | 0.2469 | 0.2490 | 0.3834 | 0.1390 |
| Fleming-3 | 0.5738 | 0.3120 | 0.3209 | 0.5834 | 0.2615 |
| Fleming-4 | 0.5738 | 0.3120 | 0.3209 | 0.5834 | 0.2615 |
| Fleming-5 | 0.6050 | 0.3274 | 0.3389 | 0.6163 | 0.3526 |
| bioinfo-0 | 0.3863 | 0.2298 | 0.2204 | 0.3215 | 0.0893 |
| Organization name | 0.2244 | 0.1149 | 0.1065 | 0.1273 | 0.0054 |
| "RMC_1" | 0.2753 | 0.1187 | 0.1418 | 0.2173 | 0.0273 |
| RMC_2 | 0.5191 | 0.0908 | 0.1330 | 0.1623 | 0.0146 |
| DS@GT-BioASQ | 0.0313 | 0.0077 | 0.0114 | 0.0210 | 0.0001 |
| bioinfo-1 | 0.3875 | 0.2310 | 0.2216 | 0.3224 | 0.0825 |
| bioinfo-2 | 0.4550 | 0.2658 | 0.2613 | 0.4425 | 0.1659 |
| bioinfo-3 | 0.4725 | 0.2752 | 0.2706 | 0.4836 | 0.1489 |
| bioinfo-4 | 0.4875 | 0.2828 | 0.2803 | 0.4918 | 0.1817 |
| Biomedical QA system | 0.4844 | 0.2713 | 0.2713 | 0.4768 | 0.2263 |
| Biomedical QA s. v2 | 0.1897 | 0.0780 | 0.0941 | 0.0874 | 0.0040 |
| main | 0.3038 | 0.1907 | 0.1795 | 0.2558 | 0.0596 |
| IR1 | 0.4750 | 0.2643 | 0.2647 | 0.4785 | 0.1896 |
| dmiip2024 | 0.4625 | 0.2673 | 0.2595 | 0.4577 | 0.1976 |
| dmiip2024_1 | 0.4525 | 0.2646 | 0.2549 | 0.4502 | 0.1933 |
| dmiip2024_2 | 0.4988 | 0.2558 | 0.2716 | 0.4837 | 0.2322 |
| dmiip2024_3 | 0.4975 | 0.2555 | 0.2711 | 0.4793 | 0.2537 |
| dmiip2024_4 | 0.4975 | 0.2554 | 0.2710 | 0.4823 | 0.2315 |
| semantic | 0.3038 | 0.1907 | 0.1795 | 0.2558 | 0.0596 |
| prompted | 0.3038 | 0.1907 | 0.1795 | 0.2558 | 0.0596 |
| Biomedical QA s3 | 0.3667 | 0.1833 | 0.1819 | 0.3324 | 0.0180 |
| IR_J-1 | 0.3273 | 0.1004 | 0.1179 | 0.1412 | 0.0043 |
| IR_J-2 | 0.2914 | 0.1221 | 0.1393 | 0.2065 | 0.0107 |
| IR_Y-1 | 0.2219 | 0.1087 | 0.1216 | 0.1714 | 0.0068 |
| IR_Y-2 | 0.2219 | 0.1087 | 0.1216 | 0.1714 | 0.0068 |
| IR_Y-3 | 0.2219 | 0.1087 | 0.1216 | 0.1714 | 0.0068 |
| IR_Y-4 | 0.2219 | 0.1087 | 0.1216 | 0.1714 | 0.0068 |
| IR_Y-5 | 0.2219 | 0.1087 | 0.1216 | 0.1714 | 0.0068 |
| UR-IW-1 | 0.4642 | 0.2113 | 0.2466 | 0.4072 | 0.1248 |
| UR-IW-2 | 0.4936 | 0.1996 | 0.2461 | 0.3985 | 0.0652 |
| UR-IW-3 | 0.4972 | 0.1900 | 0.2318 | 0.4119 | 0.0530 |
| UR-IW-4 | 0.4454 | 0.1911 | 0.2223 | 0.3977 | 0.0705 |
| UR-IW-5 | 0.4363 | 0.1896 | 0.2185 | 0.3799 | 0.0321 |
| health-nlp-2 | 0.3180 | 0.2140 | 0.1932 | 0.2603 | 0.0480 |
| WHU-ECHO Lab-1 | 0.1575 | 0.1184 | 0.1034 | 0.1058 | 0.0027 |
| ubuntu | 0.1825 | 0.0815 | 0.0949 | 0.1299 | 0.0041 |
Snippets
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.2783 | 0.0968 | 0.1166 | 0.2779 | 0.0348 |
| porties-baseline | 0.1686 | 0.0501 | 0.0640 | 0.1429 | 0.0033 |
| health-nlp-1 | 0.2064 | 0.0601 | 0.0816 | 0.1427 | 0.0051 |
| DS@GT BioASQ | 0.0238 | 0.0027 | 0.0047 | 0.0310 | 0.0000 |
| pancras_naive | 0.4220 | 0.1560 | 0.1835 | 0.4673 | 0.1449 |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| lean_rag_ft_sparse | 0.3404 | 0.1405 | 0.1583 | 0.1514 | 0.0244 |
| lean_rag_ft | 0.3431 | 0.1403 | 0.1585 | 0.1536 | 0.0246 |
| lean_rag | 0.3539 | 0.1352 | 0.1560 | 0.1579 | 0.0309 |
| Fleming-1 | 0.4321 | 0.1569 | 0.1926 | 0.4359 | 0.1826 |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-2 | 0.4180 | 0.1740 | 0.1985 | 0.4455 | 0.2192 |
| pancras_crag | 0.2694 | 0.0902 | 0.1212 | 0.2139 | 0.0142 |
| Fleming-3 | 0.4195 | 0.1531 | 0.1875 | 0.4249 | 0.1445 |
| Fleming-4 | 0.4020 | 0.1657 | 0.1886 | 0.4351 | 0.1560 |
| Fleming-5 | 0.4453 | 0.1618 | 0.1993 | 0.4478 | 0.1860 |
| bioinfo-0 | - | - | - | - | - |
| Organization name | 0.1436 | 0.0504 | 0.0565 | 0.1754 | 0.0013 |
| "RMC_1" | 0.1592 | 0.0523 | 0.0675 | 0.1252 | 0.0056 |
| RMC_2 | 0.2351 | 0.0730 | 0.0961 | 0.2757 | 0.0089 |
| DS@GT-BioASQ | 0.0238 | 0.0027 | 0.0047 | 0.0310 | 0.0000 |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| Biomedical QA system | 0.3941 | 0.1336 | 0.1604 | 0.4217 | 0.1269 |
| Biomedical QA s. v2 | 0.1292 | 0.0305 | 0.0412 | 0.0794 | 0.0005 |
| main | 0.0126 | 0.0041 | 0.0056 | 0.0134 | 0.0000 |
| IR1 | 0.4101 | 0.1475 | 0.1786 | 0.4352 | 0.0790 |
| dmiip2024 | 0.4060 | 0.1852 | 0.1914 | 0.5264 | 0.1913 |
| dmiip2024_1 | 0.4095 | 0.1875 | 0.1925 | 0.5246 | 0.1934 |
| dmiip2024_2 | 0.4175 | 0.1821 | 0.2006 | 0.5194 | 0.1978 |
| dmiip2024_3 | 0.4362 | 0.1901 | 0.2074 | 0.5374 | 0.1921 |
| dmiip2024_4 | 0.4200 | 0.1832 | 0.2018 | 0.5206 | 0.2002 |
| semantic | 0.0447 | 0.0087 | 0.0130 | 0.0527 | 0.0005 |
| prompted | 0.0238 | 0.0075 | 0.0100 | 0.0169 | 0.0001 |
| Biomedical QA s3 | 0.3057 | 0.0953 | 0.1100 | 0.3364 | 0.0122 |
| IR_J-1 | 0.2796 | 0.0637 | 0.0844 | 0.1365 | 0.0025 |
| IR_J-2 | 0.2481 | 0.0871 | 0.1045 | 0.2040 | 0.0069 |
| IR_Y-1 | 0.1492 | 0.1161 | 0.1082 | 0.1088 | 0.0027 |
| IR_Y-2 | 0.1492 | 0.1161 | 0.1082 | 0.0899 | 0.0021 |
| IR_Y-3 | 0.1492 | 0.1161 | 0.1082 | 0.1088 | 0.0027 |
| IR_Y-4 | 0.1492 | 0.1161 | 0.1082 | 0.0899 | 0.0021 |
| IR_Y-5 | 0.1492 | 0.1161 | 0.1082 | 0.1088 | 0.0027 |
| UR-IW-1 | 0.4084 | 0.1186 | 0.1640 | 0.3941 | 0.0796 |
| UR-IW-2 | 0.4574 | 0.1129 | 0.1619 | 0.3707 | 0.0586 |
| UR-IW-3 | 0.4351 | 0.1283 | 0.1676 | 0.4120 | 0.0421 |
| UR-IW-4 | 0.4175 | 0.1226 | 0.1609 | 0.3910 | 0.0541 |
| UR-IW-5 | 0.4069 | 0.1156 | 0.1511 | 0.3778 | 0.0281 |
| health-nlp-2 | 0.2064 | 0.0601 | 0.0816 | 0.1427 | 0.0051 |
| WHU-ECHO Lab-1 | - | - | - | - | - |
| ubuntu | 0.1139 | 0.0382 | 0.0485 | 0.0751 | 0.0010 |
Concepts
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| porties-baseline | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| DS@GT BioASQ | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| Fleming-4 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| Biomedical QA system | - | - | - | - | - |
| Biomedical QA s. v2 | - | - | - | - | - |
| main | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| semantic | - | - | - | - | - |
| prompted | - | - | - | - | - |
| Biomedical QA s3 | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| IR_Y-3 | - | - | - | - | - |
| IR_Y-4 | - | - | - | - | - |
| IR_Y-5 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| WHU-ECHO Lab-1 | - | - | - | - | - |
| ubuntu | - | - | - | - | - |
RDF Triples
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| porties-baseline | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| DS@GT BioASQ | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| Fleming-4 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| Biomedical QA system | - | - | - | - | - |
| Biomedical QA s. v2 | - | - | - | - | - |
| main | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| semantic | - | - | - | - | - |
| prompted | - | - | - | - | - |
| Biomedical QA s3 | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| IR_Y-3 | - | - | - | - | - |
| IR_Y-4 | - | - | - | - | - |
| IR_Y-5 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| WHU-ECHO Lab-1 | - | - | - | - | - |
| ubuntu | - | - | - | - | - |
Test batch 2
Documents
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.5014 | 0.2102 | 0.2376 | 0.4286 | 0.2755 |
| lean_rag | 0.5400 | 0.2460 | 0.2671 | 0.5067 | 0.3094 |
| lean_rag_dprf | 0.5013 | 0.2240 | 0.2435 | 0.4747 | 0.2035 |
| lean_rag_ft | 0.5450 | 0.2478 | 0.2698 | 0.5132 | 0.3145 |
| lean_rag_ft_sparse | 0.5325 | 0.2366 | 0.2600 | 0.5041 | 0.3090 |
| Splade-v3 | 0.4838 | 0.1988 | 0.2360 | 0.4188 | 0.1778 |
| Debertav3 | 0.5663 | 0.2310 | 0.2759 | 0.5080 | 0.3264 |
| Fully fine-tuned | 0.5225 | 0.2155 | 0.2555 | 0.4509 | 0.2664 |
| Recently fine-tuned | 0.5575 | 0.2274 | 0.2712 | 0.4926 | 0.3230 |
| Biomedical QA system | 0.6025 | 0.2607 | 0.2910 | 0.5754 | 0.4317 |
| bm25 + splade | 0.4888 | 0.2171 | 0.2385 | 0.4589 | 0.2100 |
| dictycite-baseline | 0.5925 | 0.2776 | 0.2998 | 0.5624 | 0.4338 |
| dictycite-max | 0.6725 | 0.3057 | 0.3340 | 0.6832 | 0.5525 |
| dictycite-max-rew-si | 0.6713 | 0.3102 | 0.3394 | 0.6643 | 0.5461 |
| dictycite-max-rew-sl | 0.6625 | 0.3024 | 0.3319 | 0.6584 | 0.5436 |
| dictycite-snippet | 0.6200 | 0.2888 | 0.3117 | 0.6000 | 0.4858 |
| Fleming-1 | 0.7275 | 0.3133 | 0.3561 | 0.7205 | 0.6420 |
| Biomedical QA s. v2 | 0.6063 | 0.2607 | 0.2970 | 0.5732 | 0.4217 |
| Fleming-2 | 0.7275 | 0.3133 | 0.3561 | 0.7205 | 0.6420 |
| MedQA-1 | 0.3883 | 0.1398 | 0.1686 | 0.3234 | 0.0887 |
| health-nlp-1 | 0.4075 | 0.1941 | 0.2134 | 0.3540 | 0.1244 |
| Hybrid Retrieval | 0.2450 | 0.0749 | 0.0957 | 0.1534 | 0.0077 |
| MedQA-2 | 0.3933 | 0.1424 | 0.1724 | 0.3430 | 0.0855 |
| "RMC_1" | 0.3658 | 0.1292 | 0.1523 | 0.2897 | 0.0250 |
| RMC_2 | 0.6256 | 0.0969 | 0.1307 | 0.1935 | 0.0335 |
| RMC_3 | 0.4389 | 0.1449 | 0.1728 | 0.3203 | 0.0764 |
| RMC_4 | 0.3796 | 0.1375 | 0.1592 | 0.3000 | 0.0216 |
| RMC_5 | 0.4989 | 0.1552 | 0.1849 | 0.3437 | 0.1234 |
| main | 0.4125 | 0.2010 | 0.2127 | 0.3551 | 0.1464 |
| semantic | 0.4125 | 0.2010 | 0.2127 | 0.3551 | 0.1464 |
| prompted | 0.4125 | 0.2010 | 0.2127 | 0.3551 | 0.1464 |
| pancras_naive | 0.7059 | 0.2574 | 0.3091 | 0.5715 | 0.4159 |
| pancras_crag | 0.7576 | 0.1950 | 0.2590 | 0.4110 | 0.2770 |
| Organization name | 0.3074 | 0.1050 | 0.1260 | 0.1807 | 0.0067 |
| bioinfo-0 | 0.4575 | 0.1939 | 0.2188 | 0.3495 | 0.1892 |
| bioinfo-1 | 0.5625 | 0.2694 | 0.2866 | 0.5225 | 0.3328 |
| bioinfo-2 | 0.3825 | 0.1729 | 0.1857 | 0.2744 | 0.1105 |
| bioinfo-3 | 0.3800 | 0.1694 | 0.1833 | 0.2735 | 0.1000 |
| bioinfo-4 | 0.4838 | 0.2366 | 0.2488 | 0.4499 | 0.2108 |
| IR1 | 0.5788 | 0.2321 | 0.2715 | 0.5000 | 0.3390 |
| health-nlp-2 | 0.4225 | 0.1979 | 0.2180 | 0.3582 | 0.1388 |
| DS@GT-BioASQ | 0.2315 | 0.0670 | 0.0876 | 0.1147 | 0.0011 |
| IR_J-1 | 0.3050 | 0.1253 | 0.1359 | 0.2709 | 0.0164 |
| IR_J-2 | 0.4034 | 0.0938 | 0.1319 | 0.1863 | 0.0158 |
| dmiip2024 | 0.5825 | 0.2627 | 0.2877 | 0.5646 | 0.3344 |
| dmiip2024_1 | 0.5938 | 0.2701 | 0.2968 | 0.5607 | 0.4060 |
| dmiip2024_3 | 0.5775 | 0.2607 | 0.2846 | 0.5486 | 0.3143 |
| dmiip2024_4 | 0.5575 | 0.2554 | 0.2746 | 0.5356 | 0.3011 |
| dmiip2024_2 | 0.5888 | 0.2732 | 0.2964 | 0.5650 | 0.3705 |
| mckpt1 | 0.2896 | 0.0633 | 0.0944 | 0.1206 | 0.0061 |
| mckpt2 | 0.3848 | 0.0749 | 0.1073 | 0.1457 | 0.0126 |
| MedQA-3 | 0.5950 | 0.2501 | 0.2828 | 0.5462 | 0.3175 |
| MedQA-4 | 0.5950 | 0.2501 | 0.2828 | 0.5578 | 0.3292 |
| MedQA-5 | 0.6100 | 0.2698 | 0.2974 | 0.5715 | 0.3705 |
| Fleming-3 | 0.7275 | 0.3152 | 0.3579 | 0.7189 | 0.6405 |
| UR-IW-3 | 0.5720 | 0.2253 | 0.2785 | 0.5077 | 0.2229 |
| WHU-ECHO Lab-2 | 0.2240 | 0.1082 | 0.1085 | 0.1530 | 0.0083 |
| UR-IW-4 | 0.5712 | 0.2285 | 0.2779 | 0.5004 | 0.2238 |
| UR-IW-1 | 0.5551 | 0.2291 | 0.2732 | 0.4988 | 0.2439 |
| UR-IW-5 | 0.5159 | 0.1829 | 0.2340 | 0.4575 | 0.0867 |
| Fleming-5 | 0.7300 | 0.3157 | 0.3587 | 0.7201 | 0.6431 |
| UR-IW-2 | 0.5521 | 0.2079 | 0.2583 | 0.4535 | 0.2009 |
| IR_Y-1 | 0.3050 | 0.1253 | 0.1359 | 0.2709 | 0.0164 |
| IR_Y-2 | 0.2988 | 0.1212 | 0.1312 | 0.2551 | 0.0141 |
| Biomedical QA s3 | 0.6025 | 0.2523 | 0.2883 | 0.5780 | 0.3150 |
| ubuntu | - | - | - | - | - |
| qwen | 0.0125 | 0.0004 | 0.0008 | 0.0013 | 0.0000 |
| config-1 | 0.4113 | 0.1766 | 0.1915 | 0.3270 | 0.0669 |
Snippets
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.3600 | 0.0822 | 0.1112 | 0.3485 | 0.0982 |
| lean_rag | 0.4419 | 0.1300 | 0.1642 | 0.2149 | 0.1022 |
| lean_rag_dprf | 0.4355 | 0.1204 | 0.1541 | 0.1934 | 0.0695 |
| lean_rag_ft | 0.4440 | 0.1318 | 0.1664 | 0.2111 | 0.0996 |
| lean_rag_ft_sparse | 0.4402 | 0.1245 | 0.1602 | 0.2016 | 0.0961 |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| Biomedical QA system | 0.5401 | 0.1163 | 0.1666 | 0.5383 | 0.2655 |
| bm25 + splade | 0.2975 | 0.0511 | 0.0726 | 0.1987 | 0.0174 |
| dictycite-baseline | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| Fleming-1 | 0.5953 | 0.1690 | 0.2263 | 0.5726 | 0.4570 |
| Biomedical QA s. v2 | 0.5297 | 0.1142 | 0.1650 | 0.5333 | 0.2531 |
| Fleming-2 | 0.5168 | 0.1583 | 0.2157 | 0.5024 | 0.3049 |
| MedQA-1 | 0.3294 | 0.0802 | 0.1148 | 0.2673 | 0.0524 |
| health-nlp-1 | 0.3012 | 0.0718 | 0.1035 | 0.2522 | 0.0118 |
| Hybrid Retrieval | 0.2651 | 0.0302 | 0.0521 | 0.2583 | 0.0047 |
| MedQA-2 | 0.2172 | 0.0520 | 0.0706 | 0.2033 | 0.0178 |
| "RMC_1" | 0.2044 | 0.0564 | 0.0713 | 0.1580 | 0.0068 |
| RMC_2 | 0.2711 | 0.0778 | 0.0955 | 0.4073 | 0.0462 |
| RMC_3 | 0.2125 | 0.0637 | 0.0836 | 0.2141 | 0.0176 |
| RMC_4 | 0.2262 | 0.0561 | 0.0689 | 0.1712 | 0.0068 |
| RMC_5 | 0.2817 | 0.0703 | 0.0917 | 0.2674 | 0.0507 |
| main | 0.0253 | 0.0097 | 0.0087 | 0.0347 | 0.0001 |
| semantic | 0.0313 | 0.0093 | 0.0088 | 0.0374 | 0.0002 |
| prompted | 0.0368 | 0.0132 | 0.0132 | 0.0333 | 0.0004 |
| pancras_naive | 0.5959 | 0.1592 | 0.2115 | 0.6402 | 0.4444 |
| pancras_crag | 0.6584 | 0.1249 | 0.1832 | 0.4401 | 0.2848 |
| Organization name | 0.2516 | 0.0556 | 0.0700 | 0.2857 | 0.0062 |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| IR1 | 0.5211 | 0.1322 | 0.1810 | 0.5234 | 0.2101 |
| health-nlp-2 | 0.3027 | 0.0708 | 0.1027 | 0.2457 | 0.0187 |
| DS@GT-BioASQ | 0.1300 | 0.0268 | 0.0381 | 0.0822 | 0.0003 |
| IR_J-1 | 0.2084 | 0.1016 | 0.1084 | 0.1741 | 0.0057 |
| IR_J-2 | 0.3479 | 0.0656 | 0.0964 | 0.1720 | 0.0120 |
| dmiip2024 | 0.5001 | 0.1497 | 0.1861 | 0.5406 | 0.3011 |
| dmiip2024_1 | 0.4958 | 0.1472 | 0.1846 | 0.5312 | 0.3504 |
| dmiip2024_3 | 0.4854 | 0.1476 | 0.1818 | 0.5425 | 0.2562 |
| dmiip2024_4 | 0.5107 | 0.1516 | 0.1858 | 0.5664 | 0.3020 |
| dmiip2024_2 | 0.5066 | 0.1527 | 0.1882 | 0.5587 | 0.3054 |
| mckpt1 | 0.1689 | 0.0528 | 0.0730 | 0.0738 | 0.0037 |
| mckpt2 | 0.2144 | 0.0569 | 0.0764 | 0.0859 | 0.0054 |
| MedQA-3 | 0.5630 | 0.1618 | 0.2101 | 0.5079 | 0.2820 |
| MedQA-4 | 0.5211 | 0.1957 | 0.2287 | 0.4837 | 0.2892 |
| MedQA-5 | 0.5311 | 0.2065 | 0.2402 | 0.4922 | 0.2991 |
| Fleming-3 | 0.5952 | 0.1694 | 0.2266 | 0.5746 | 0.4567 |
| UR-IW-3 | 0.5298 | 0.1392 | 0.1914 | 0.5281 | 0.2019 |
| WHU-ECHO Lab-2 | - | - | - | - | - |
| UR-IW-4 | 0.5216 | 0.1310 | 0.1832 | 0.4916 | 0.2101 |
| UR-IW-1 | 0.5294 | 0.1338 | 0.1895 | 0.5109 | 0.2442 |
| UR-IW-5 | 0.5003 | 0.1099 | 0.1607 | 0.4941 | 0.0817 |
| Fleming-5 | 0.5944 | 0.1693 | 0.2265 | 0.5727 | 0.4574 |
| UR-IW-2 | 0.5102 | 0.1138 | 0.1669 | 0.4492 | 0.1739 |
| IR_Y-1 | 0.2084 | 0.1016 | 0.1084 | 0.1741 | 0.0057 |
| IR_Y-2 | 0.1912 | 0.0997 | 0.1028 | 0.1535 | 0.0049 |
| Biomedical QA s3 | 0.5291 | 0.1119 | 0.1623 | 0.5355 | 0.1703 |
| ubuntu | - | - | - | - | - |
| qwen | 0.0100 | 0.0001 | 0.0002 | 0.0010 | 0.0000 |
| config-1 | 0.3236 | 0.1178 | 0.1472 | 0.2521 | 0.0355 |
Concepts
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| Biomedical QA system | - | - | - | - | - |
| bm25 + splade | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| Biomedical QA s. v2 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| Hybrid Retrieval | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| main | - | - | - | - | - |
| semantic | - | - | - | - | - |
| prompted | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| mckpt1 | - | - | - | - | - |
| mckpt2 | - | - | - | - | - |
| MedQA-3 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| WHU-ECHO Lab-2 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| Biomedical QA s3 | - | - | - | - | - |
| ubuntu | - | - | - | - | - |
| qwen | - | - | - | - | - |
| config-1 | - | - | - | - | - |
RDF Triples
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| Biomedical QA system | - | - | - | - | - |
| bm25 + splade | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| Biomedical QA s. v2 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| Hybrid Retrieval | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| main | - | - | - | - | - |
| semantic | - | - | - | - | - |
| prompted | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| mckpt1 | - | - | - | - | - |
| mckpt2 | - | - | - | - | - |
| MedQA-3 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| WHU-ECHO Lab-2 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| Biomedical QA s3 | - | - | - | - | - |
| ubuntu | - | - | - | - | - |
| qwen | - | - | - | - | - |
| config-1 | - | - | - | - | - |
Test batch 3
Documents
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| lean_rag_ft_sparse | 0.3983 | 0.2065 | 0.1987 | 0.3880 | 0.0612 |
| lean_rag_ft | 0.4034 | 0.2003 | 0.1990 | 0.3933 | 0.0626 |
| lean_rag_dprf | 0.3847 | 0.1976 | 0.1935 | 0.3656 | 0.0789 |
| lean_rag_ensemble | 0.4322 | 0.2247 | 0.2098 | 0.4231 | 0.1069 |
| lean_rag | 0.4119 | 0.2020 | 0.2018 | 0.3996 | 0.0715 |
| aida_2025_2 | 0.4143 | 0.2345 | 0.2131 | 0.3997 | 0.1098 |
| IR1 | 0.4712 | 0.2583 | 0.2362 | 0.4611 | 0.1583 |
| IR5 | 0.5288 | 0.2717 | 0.2594 | 0.5282 | 0.1815 |
| Fleming-1 | 0.5627 | 0.2623 | 0.2647 | 0.5562 | 0.2056 |
| Fleming-2 | 0.5864 | 0.2975 | 0.2822 | 0.5827 | 0.2937 |
| "RMC_1" | 0.3399 | 0.1293 | 0.1479 | 0.2470 | 0.0284 |
| RMC_2 | 0.5339 | 0.0661 | 0.0977 | 0.1437 | 0.0102 |
| RMC_3 | 0.3342 | 0.1296 | 0.1485 | 0.2482 | 0.0286 |
| RMC_4 | 0.3540 | 0.1599 | 0.1585 | 0.3089 | 0.0587 |
| RMC_5 | 0.3603 | 0.1790 | 0.1653 | 0.3313 | 0.0746 |
| Fleming-3 | 0.5339 | 0.2571 | 0.2504 | 0.5292 | 0.2493 |
| IR_J-1 | 0.3563 | 0.1076 | 0.1371 | 0.2552 | 0.0126 |
| IR_J-2 | 0.2853 | 0.0632 | 0.0812 | 0.1305 | 0.0009 |
| pancras_naive | 0.6142 | 0.2407 | 0.2607 | 0.4828 | 0.1996 |
| pancras_crag | 0.6535 | 0.1906 | 0.2198 | 0.3854 | 0.1188 |
| Organization name | 0.2055 | 0.0811 | 0.0840 | 0.1170 | 0.0030 |
| multi-stage rank&llm | 0.5610 | 0.2960 | 0.2676 | 0.5351 | 0.3082 |
| health-nlp-1 | 0.3111 | 0.1723 | 0.1573 | 0.2322 | 0.0425 |
| dmiip2024 | 0.4983 | 0.2455 | 0.2410 | 0.4523 | 0.1621 |
| dmiip2024_2 | 0.5068 | 0.2569 | 0.2473 | 0.4643 | 0.1675 |
| dmiip2024_1 | 0.5136 | 0.2578 | 0.2493 | 0.4665 | 0.1688 |
| dmiip2024_3 | 0.4847 | 0.2423 | 0.2372 | 0.4320 | 0.1482 |
| dmiip2024_4 | 0.4729 | 0.2248 | 0.2321 | 0.4222 | 0.1206 |
| BioNeuralSystem1 | 0.3365 | 0.1991 | 0.1699 | 0.3292 | 0.0561 |
| DS@GT-BioASQ | 0.1475 | 0.0838 | 0.0702 | 0.1397 | 0.0012 |
| BioXR-GTE | 0.4603 | 0.2591 | 0.2368 | 0.4352 | 0.1558 |
| IR_Y-1 | 0.1847 | 0.0952 | 0.0888 | 0.1416 | 0.0049 |
| IR_Y-2 | 0.1576 | 0.0934 | 0.0803 | 0.1404 | 0.0019 |
| dictycite-baseline | 0.5254 | 0.2866 | 0.2650 | 0.5146 | 0.1890 |
| dictycite-snippet | 0.5271 | 0.2768 | 0.2607 | 0.5404 | 0.2029 |
| dictycite-max | 0.5661 | 0.3012 | 0.2840 | 0.5499 | 0.2252 |
| dictycite-max-rew-si | 0.5237 | 0.2981 | 0.2640 | 0.5285 | 0.2310 |
| dictycite-max-rew-sl | 0.5390 | 0.3202 | 0.2799 | 0.5373 | 0.3042 |
| UR-IW-5 | 0.5480 | 0.2672 | 0.2591 | 0.5191 | 0.1987 |
| UR-IW-3 | 0.4944 | 0.2069 | 0.2186 | 0.4503 | 0.1035 |
| UR-IW-4 | 0.5567 | 0.2502 | 0.2581 | 0.5463 | 0.1612 |
| UR-IW-2 | 0.4670 | 0.1907 | 0.1958 | 0.4241 | 0.0567 |
| UR-IW-1 | 0.5165 | 0.2175 | 0.2273 | 0.4583 | 0.1133 |
| BioXR-BGE | 0.4539 | 0.2521 | 0.2326 | 0.4493 | 0.1501 |
| bioinfo-0 | 0.4203 | 0.2201 | 0.2060 | 0.4139 | 0.1395 |
| bioinfo-1 | 0.4475 | 0.2333 | 0.2172 | 0.4162 | 0.1537 |
| bioinfo-2 | 0.4339 | 0.2274 | 0.2125 | 0.3818 | 0.1161 |
| bioinfo-3 | 0.3305 | 0.1802 | 0.1691 | 0.2903 | 0.0484 |
| bioinfo-4 | 0.3000 | 0.1664 | 0.1546 | 0.2607 | 0.0314 |
| Splade-v3 | 0.3576 | 0.1893 | 0.1787 | 0.3081 | 0.0593 |
| Debertav3 | 0.4576 | 0.2198 | 0.2166 | 0.4319 | 0.1406 |
| Fully fine-tuned | 0.4000 | 0.2071 | 0.1954 | 0.3734 | 0.1199 |
| Recently fine-tuned | 0.4424 | 0.2271 | 0.2158 | 0.4206 | 0.1377 |
| MedQA-1 | 0.3791 | 0.1367 | 0.1486 | 0.2449 | 0.0334 |
| MedQA-2 | 0.3623 | 0.1456 | 0.1560 | 0.2712 | 0.0454 |
| MedQA-3 | 0.3791 | 0.1367 | 0.1486 | 0.2449 | 0.0334 |
| MedQA-4 | 0.4243 | 0.1685 | 0.1851 | 0.2976 | 0.0622 |
| MedQA-5 | 0.4243 | 0.1685 | 0.1851 | 0.2976 | 0.0622 |
| Fleming-5 | 0.5610 | 0.2593 | 0.2601 | 0.5663 | 0.1898 |
| Fleming-4 | 0.5424 | 0.2499 | 0.2490 | 0.5416 | 0.1813 |
| IR2 | 0.5254 | 0.2749 | 0.2566 | 0.5332 | 0.2102 |
| IR3 | 0.5136 | 0.2656 | 0.2515 | 0.5223 | 0.1769 |
Snippets
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| lean_rag_ft_sparse | 0.3141 | 0.1067 | 0.1222 | 0.1412 | 0.0117 |
| lean_rag_ft | 0.3130 | 0.1063 | 0.1211 | 0.1428 | 0.0101 |
| lean_rag_dprf | 0.2817 | 0.1046 | 0.1173 | 0.1289 | 0.0083 |
| lean_rag_ensemble | 0.3062 | 0.1068 | 0.1203 | 0.1305 | 0.0120 |
| lean_rag | 0.3220 | 0.1072 | 0.1227 | 0.1475 | 0.0116 |
| aida_2025_2 | 0.2753 | 0.0805 | 0.1018 | 0.2529 | 0.0258 |
| IR1 | 0.3867 | 0.1142 | 0.1450 | 0.3374 | 0.0467 |
| IR5 | 0.4257 | 0.1392 | 0.1658 | 0.4150 | 0.0700 |
| Fleming-1 | 0.3850 | 0.1493 | 0.1688 | 0.3635 | 0.0952 |
| Fleming-2 | 0.3931 | 0.1689 | 0.1769 | 0.3818 | 0.1358 |
| "RMC_1" | 0.2212 | 0.0433 | 0.0631 | 0.1691 | 0.0048 |
| RMC_2 | 0.2246 | 0.0507 | 0.0712 | 0.2484 | 0.0084 |
| RMC_3 | 0.2239 | 0.0437 | 0.0638 | 0.1694 | 0.0055 |
| RMC_4 | 0.2244 | 0.0775 | 0.0853 | 0.1998 | 0.0132 |
| RMC_5 | 0.2286 | 0.0855 | 0.0908 | 0.2031 | 0.0179 |
| Fleming-3 | 0.4183 | 0.1251 | 0.1584 | 0.3851 | 0.0980 |
| IR_J-1 | 0.3480 | 0.0635 | 0.0910 | 0.2672 | 0.0110 |
| IR_J-2 | 0.2067 | 0.0458 | 0.0559 | 0.1142 | 0.0006 |
| pancras_naive | 0.5148 | 0.1678 | 0.2008 | 0.5183 | 0.1665 |
| pancras_crag | 0.5548 | 0.1418 | 0.1677 | 0.3825 | 0.0720 |
| Organization name | 0.1695 | 0.0479 | 0.0545 | 0.1688 | 0.0020 |
| multi-stage rank&llm | 0.4622 | 0.1629 | 0.1770 | 0.4210 | 0.1431 |
| health-nlp-1 | 0.1782 | 0.0363 | 0.0546 | 0.1120 | 0.0037 |
| dmiip2024 | 0.4086 | 0.1296 | 0.1579 | 0.4275 | 0.1121 |
| dmiip2024_2 | 0.4410 | 0.1459 | 0.1627 | 0.4705 | 0.0952 |
| dmiip2024_1 | 0.4280 | 0.1317 | 0.1618 | 0.4442 | 0.0777 |
| dmiip2024_3 | 0.4040 | 0.1261 | 0.1525 | 0.4182 | 0.0831 |
| dmiip2024_4 | 0.3986 | 0.1220 | 0.1495 | 0.4220 | 0.0605 |
| BioNeuralSystem1 | - | - | - | - | - |
| DS@GT-BioASQ | 0.1037 | 0.0174 | 0.0256 | 0.0882 | 0.0003 |
| BioXR-GTE | - | - | - | - | - |
| IR_Y-1 | 0.1199 | 0.0627 | 0.0636 | 0.0788 | 0.0015 |
| IR_Y-2 | 0.1135 | 0.0639 | 0.0604 | 0.0834 | 0.0010 |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| UR-IW-5 | 0.4872 | 0.1578 | 0.1788 | 0.4770 | 0.1008 |
| UR-IW-3 | 0.4834 | 0.1609 | 0.1721 | 0.4637 | 0.0975 |
| UR-IW-4 | 0.5419 | 0.1754 | 0.2034 | 0.5482 | 0.1308 |
| UR-IW-2 | 0.4179 | 0.1350 | 0.1455 | 0.4233 | 0.0548 |
| UR-IW-1 | 0.4763 | 0.1413 | 0.1732 | 0.4491 | 0.0811 |
| BioXR-BGE | 0.0077 | 0.0018 | 0.0027 | 0.0053 | 0.0000 |
| bioinfo-0 | 0.1200 | 0.1573 | 0.0987 | 0.1578 | 0.0447 |
| bioinfo-1 | 0.1364 | 0.1640 | 0.1104 | 0.1434 | 0.0404 |
| bioinfo-2 | 0.1191 | 0.1384 | 0.0958 | 0.1308 | 0.0262 |
| bioinfo-3 | 0.1083 | 0.1124 | 0.0837 | 0.0963 | 0.0105 |
| bioinfo-4 | 0.1014 | 0.1076 | 0.0799 | 0.0849 | 0.0063 |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| MedQA-1 | 0.2365 | 0.0532 | 0.0740 | 0.1399 | 0.0070 |
| MedQA-2 | 0.2293 | 0.0525 | 0.0731 | 0.1579 | 0.0105 |
| MedQA-3 | 0.2365 | 0.0532 | 0.0740 | 0.1399 | 0.0070 |
| MedQA-4 | 0.2895 | 0.0824 | 0.1030 | 0.2084 | 0.0229 |
| MedQA-5 | 0.2895 | 0.0824 | 0.1030 | 0.2084 | 0.0229 |
| Fleming-5 | 0.4452 | 0.1289 | 0.1658 | 0.4069 | 0.0784 |
| Fleming-4 | 0.4268 | 0.1214 | 0.1566 | 0.3899 | 0.0655 |
| IR2 | 0.4726 | 0.1558 | 0.1842 | 0.4849 | 0.0846 |
| IR3 | 0.4590 | 0.1531 | 0.1794 | 0.4745 | 0.0792 |
Concepts
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ensemble | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| aida_2025_2 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| IR5 | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| multi-stage rank&llm | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| BioNeuralSystem1 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| BioXR-GTE | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| BioXR-BGE | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| MedQA-3 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| Fleming-4 | - | - | - | - | - |
| IR2 | - | - | - | - | - |
| IR3 | - | - | - | - | - |
RDF Triples
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ensemble | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| aida_2025_2 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| IR5 | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| multi-stage rank&llm | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| BioNeuralSystem1 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| BioXR-GTE | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| BioXR-BGE | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| MedQA-3 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| Fleming-4 | - | - | - | - | - |
| IR2 | - | - | - | - | - |
| IR3 | - | - | - | - | - |
Test batch 4
Documents
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.4219 | 0.1616 | 0.1851 | 0.3578 | 0.1262 |
| UR-IW-5 | 0.6039 | 0.2311 | 0.2815 | 0.5496 | 0.2789 |
| UR-IW-4 | 0.5638 | 0.2130 | 0.2511 | 0.5284 | 0.2646 |
| UR-IW-3 | 0.4843 | 0.1914 | 0.2255 | 0.4310 | 0.1648 |
| UR-IW-2 | 0.5154 | 0.1938 | 0.2300 | 0.4140 | 0.2576 |
| UR-IW-1 | 0.4921 | 0.1928 | 0.2358 | 0.4329 | 0.1332 |
| SATO | 0.4469 | 0.0687 | 0.0965 | 0.1600 | 0.0084 |
| IR2 | 0.5533 | 0.2211 | 0.2553 | 0.5097 | 0.2261 |
| IR3 | 0.5517 | 0.2220 | 0.2546 | 0.5113 | 0.2269 |
| Fleming-1 | 0.5933 | 0.2089 | 0.2671 | 0.5274 | 0.2249 |
| IR1 | 0.4767 | 0.1846 | 0.2144 | 0.4338 | 0.1843 |
| Splade-v3 | 0.4100 | 0.1516 | 0.1812 | 0.3443 | 0.1240 |
| Debertav3 | 0.5150 | 0.2005 | 0.2367 | 0.4504 | 0.1850 |
| Fully fine-tuned | 0.4483 | 0.1797 | 0.2080 | 0.3664 | 0.1836 |
| Recently fine-tuned | 0.5150 | 0.1997 | 0.2352 | 0.4465 | 0.1961 |
| IR5 | 0.5200 | 0.1984 | 0.2333 | 0.4826 | 0.2038 |
| IR4 | 0.5700 | 0.2273 | 0.2630 | 0.5177 | 0.2261 |
| Fleming-2 | 0.5933 | 0.2089 | 0.2671 | 0.5274 | 0.2249 |
| multi-stage rank&llm | 0.5600 | 0.2229 | 0.2557 | 0.4799 | 0.2977 |
| AJDEM | 0.2027 | 0.0630 | 0.0798 | 0.1154 | 0.0095 |
| FinalQwen | 0.1517 | 0.0553 | 0.0605 | 0.0828 | 0.0019 |
| health-nlp-1 | 0.3583 | 0.1530 | 0.1668 | 0.2620 | 0.0482 |
| health-nlp-2 | 0.3583 | 0.1530 | 0.1668 | 0.2620 | 0.0482 |
| "RMC_1" | 0.2829 | 0.0980 | 0.1222 | 0.1886 | 0.0098 |
| RMC_2 | 0.5908 | 0.0791 | 0.1154 | 0.1629 | 0.0311 |
| RMC_3 | 0.3896 | 0.1155 | 0.1476 | 0.2298 | 0.0678 |
| RMC_4 | 0.2831 | 0.0931 | 0.1129 | 0.2092 | 0.0066 |
| RMC_5 | 0.4531 | 0.1202 | 0.1545 | 0.2576 | 0.0559 |
| dictycite-baseline | 0.5267 | 0.2045 | 0.2422 | 0.4615 | 0.2221 |
| dictycite-snippet | 0.5517 | 0.2145 | 0.2551 | 0.4931 | 0.2681 |
| dictycite-max | 0.6083 | 0.2408 | 0.2792 | 0.5853 | 0.2570 |
| dictycite-max-rew-si | 0.6050 | 0.2476 | 0.2866 | 0.5704 | 0.3611 |
| dictycite-max-rew-sl | 0.6050 | 0.2476 | 0.2866 | 0.5697 | 0.3670 |
| Fleming-3 | 0.5733 | 0.1988 | 0.2556 | 0.5142 | 0.2222 |
| Fleming-5 | 0.5917 | 0.2122 | 0.2691 | 0.5265 | 0.2489 |
| BM25 baseline retrie | 0.0583 | 0.0090 | 0.0150 | 0.0405 | 0.0001 |
| BM25 + MeSH (14b-A) | 0.0583 | 0.0090 | 0.0150 | 0.0405 | 0.0001 |
| BM25 + PRF(14b-A) | 0.0600 | 0.0082 | 0.0140 | 0.0455 | 0.0001 |
| BM25 + cross-encoder | 0.0683 | 0.0098 | 0.0166 | 0.0562 | 0.0001 |
| lean_rag | 0.5390 | 0.1856 | 0.2161 | 0.3916 | 0.1849 |
| lean_rag_ft | 0.5288 | 0.1803 | 0.2163 | 0.3920 | 0.1878 |
| lean_rag_dprf | 0.5343 | 0.1904 | 0.2210 | 0.3963 | 0.1832 |
| lean_rag_ft_sparse | 0.5270 | 0.1821 | 0.2116 | 0.3751 | 0.1809 |
| lean_rag_ensemble | 0.5913 | 0.1688 | 0.2012 | 0.3742 | 0.1096 |
| BM25 + LTR | 0.0500 | 0.0078 | 0.0129 | 0.0359 | 0.0001 |
| Organization name | 0.2311 | 0.0660 | 0.0822 | 0.1276 | 0.0044 |
| multi-stage rank&ll | 0.5633 | 0.2228 | 0.2565 | 0.4775 | 0.2884 |
| dmiip2024 | 0.5433 | 0.2080 | 0.2423 | 0.4945 | 0.3153 |
| dmiip2024_1 | 0.5433 | 0.2087 | 0.2432 | 0.4906 | 0.3277 |
| dmiip2024_2 | 0.5333 | 0.2063 | 0.2395 | 0.4849 | 0.3194 |
| dmiip2024_3 | 0.4917 | 0.1970 | 0.2254 | 0.4428 | 0.2323 |
| dmiip2024_4 | 0.4900 | 0.1932 | 0.2209 | 0.4470 | 0.2318 |
| bioinfo-0 | 0.5217 | 0.2182 | 0.2462 | 0.4662 | 0.3507 |
| bioinfo-1 | 0.4650 | 0.1906 | 0.2148 | 0.3729 | 0.2613 |
| bioinfo-2 | 0.5333 | 0.2129 | 0.2445 | 0.4626 | 0.3062 |
| bioinfo-3 | 0.4650 | 0.1781 | 0.2091 | 0.4054 | 0.2306 |
| bioinfo-4 | 0.4667 | 0.1783 | 0.2094 | 0.4085 | 0.2317 |
| DS@GT-BioASQ | 0.3563 | 0.0795 | 0.1047 | 0.1515 | 0.0215 |
| llama for 14b b | 0.2700 | 0.0900 | 0.1078 | 0.2211 | 0.0110 |
| DSGTBioasq | 0.3563 | 0.0795 | 0.1047 | 0.1515 | 0.0215 |
| IR_J-1 | 0.2385 | 0.0552 | 0.0782 | 0.1178 | 0.0022 |
| IR_J-2 | 0.2796 | 0.0412 | 0.0625 | 0.1071 | 0.0016 |
| IR_Y-1 | 0.2050 | 0.0829 | 0.0886 | 0.1448 | 0.0069 |
| IR_Y-2 | 0.1933 | 0.0768 | 0.0817 | 0.1357 | 0.0067 |
| pancras_naive | 0.6368 | 0.1897 | 0.2524 | 0.4694 | 0.2370 |
| pancras_crag | 0.6782 | 0.1455 | 0.2118 | 0.3317 | 0.2094 |
| BioXR-GTE | 0.4600 | 0.1951 | 0.2203 | 0.3840 | 0.2140 |
| MedQA-1 | 0.3700 | 0.1221 | 0.1538 | 0.3096 | 0.1347 |
| MedQA-2 | 0.3867 | 0.1291 | 0.1622 | 0.3211 | 0.1384 |
| MedQA-4 | 0.3266 | 0.0982 | 0.1247 | 0.1673 | 0.0361 |
| MedQA-5 | 0.4417 | 0.1668 | 0.1993 | 0.3728 | 0.2387 |
| 1 system | 0.5815 | 0.1419 | 0.1929 | 0.3140 | 0.1524 |
| 2 system | 0.5771 | 0.2084 | 0.2590 | 0.5126 | 0.2924 |
| 3 system | 0.5679 | 0.2050 | 0.2559 | 0.5115 | 0.2898 |
| 4 system | 0.5065 | 0.2015 | 0.2329 | 0.3992 | 0.1785 |
| 5 system | 0.5456 | 0.2039 | 0.2445 | 0.4947 | 0.3115 |
Snippets
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.3056 | 0.0540 | 0.0783 | 0.2579 | 0.0131 |
| UR-IW-5 | 0.5469 | 0.1317 | 0.1847 | 0.5287 | 0.2524 |
| UR-IW-4 | 0.5079 | 0.1424 | 0.1783 | 0.5056 | 0.2107 |
| UR-IW-3 | 0.4508 | 0.1171 | 0.1519 | 0.4248 | 0.1322 |
| UR-IW-2 | 0.4987 | 0.1169 | 0.1648 | 0.4353 | 0.2252 |
| UR-IW-1 | 0.4681 | 0.1226 | 0.1675 | 0.4377 | 0.1267 |
| SATO | 0.2511 | 0.1130 | 0.1212 | 0.0911 | 0.0039 |
| IR2 | 0.5217 | 0.1144 | 0.1608 | 0.4894 | 0.1921 |
| IR3 | 0.5122 | 0.1141 | 0.1582 | 0.4792 | 0.2136 |
| Fleming-1 | 0.4688 | 0.1135 | 0.1650 | 0.4240 | 0.1263 |
| IR1 | 0.4074 | 0.0926 | 0.1313 | 0.3586 | 0.0954 |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| IR5 | 0.4490 | 0.0991 | 0.1401 | 0.4189 | 0.1167 |
| IR4 | 0.4626 | 0.1006 | 0.1454 | 0.4384 | 0.1280 |
| Fleming-2 | 0.3846 | 0.1131 | 0.1532 | 0.3819 | 0.1506 |
| multi-stage rank&llm | 0.4985 | 0.1369 | 0.1719 | 0.4199 | 0.2430 |
| AJDEM | 0.0087 | 0.0017 | 0.0026 | 0.0051 | 0.0000 |
| FinalQwen | 0.1218 | 0.0198 | 0.0259 | 0.1112 | 0.0005 |
| health-nlp-1 | 0.2634 | 0.0523 | 0.0761 | 0.1847 | 0.0089 |
| health-nlp-2 | 0.2634 | 0.0523 | 0.0761 | 0.1847 | 0.0089 |
| "RMC_1" | 0.1819 | 0.0414 | 0.0488 | 0.1019 | 0.0035 |
| RMC_2 | 0.2652 | 0.0615 | 0.0844 | 0.2762 | 0.0199 |
| RMC_3 | 0.2281 | 0.0567 | 0.0711 | 0.1959 | 0.0226 |
| RMC_4 | 0.1502 | 0.0210 | 0.0342 | 0.1113 | 0.0015 |
| RMC_5 | 0.2471 | 0.0473 | 0.0682 | 0.2048 | 0.0168 |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-3 | 0.4662 | 0.1124 | 0.1640 | 0.4155 | 0.1115 |
| Fleming-5 | 0.4725 | 0.1126 | 0.1624 | 0.4265 | 0.1582 |
| BM25 baseline retrie | 0.0096 | 0.0015 | 0.0025 | 0.0109 | 0.0000 |
| BM25 + MeSH (14b-A) | 0.0096 | 0.0015 | 0.0025 | 0.0109 | 0.0000 |
| BM25 + PRF(14b-A) | 0.0142 | 0.0019 | 0.0033 | 0.0084 | 0.0000 |
| BM25 + cross-encoder | 0.0162 | 0.0017 | 0.0030 | 0.0171 | 0.0000 |
| lean_rag | 0.3923 | 0.1003 | 0.1304 | 0.1701 | 0.0523 |
| lean_rag_ft | 0.4067 | 0.1045 | 0.1381 | 0.1723 | 0.0513 |
| lean_rag_dprf | 0.4097 | 0.1039 | 0.1373 | 0.1697 | 0.0422 |
| lean_rag_ft_sparse | 0.3934 | 0.1024 | 0.1338 | 0.1625 | 0.0478 |
| lean_rag_ensemble | 0.3962 | 0.1028 | 0.1355 | 0.1734 | 0.0703 |
| BM25 + LTR | 0.0092 | 0.0013 | 0.0022 | 0.0093 | 0.0000 |
| Organization name | 0.2215 | 0.0451 | 0.0637 | 0.2182 | 0.0048 |
| multi-stage rank&ll | 0.5031 | 0.1367 | 0.1719 | 0.4163 | 0.2128 |
| dmiip2024 | 0.4306 | 0.1273 | 0.1544 | 0.4419 | 0.1656 |
| dmiip2024_1 | 0.4288 | 0.1310 | 0.1573 | 0.4334 | 0.2202 |
| dmiip2024_2 | 0.4463 | 0.1314 | 0.1608 | 0.4578 | 0.2776 |
| dmiip2024_3 | 0.4131 | 0.1280 | 0.1526 | 0.4047 | 0.1428 |
| dmiip2024_4 | 0.4326 | 0.1251 | 0.1516 | 0.4259 | 0.1490 |
| bioinfo-0 | 0.3040 | 0.1113 | 0.1231 | 0.2408 | 0.0949 |
| bioinfo-1 | 0.2744 | 0.0842 | 0.1054 | 0.1888 | 0.0618 |
| bioinfo-2 | 0.3440 | 0.1125 | 0.1388 | 0.2549 | 0.1341 |
| bioinfo-3 | 0.2709 | 0.0807 | 0.1009 | 0.2220 | 0.0798 |
| bioinfo-4 | 0.3011 | 0.0968 | 0.1132 | 0.2417 | 0.0548 |
| DS@GT-BioASQ | 0.2187 | 0.0203 | 0.0343 | 0.1166 | 0.0019 |
| llama for 14b b | 0.1812 | 0.0357 | 0.0515 | 0.1433 | 0.0048 |
| DSGTBioasq | 0.2187 | 0.0203 | 0.0343 | 0.1166 | 0.0019 |
| IR_J-1 | 0.2103 | 0.0373 | 0.0536 | 0.1221 | 0.0022 |
| IR_J-2 | 0.2110 | 0.0289 | 0.0424 | 0.1030 | 0.0011 |
| IR_Y-1 | 0.1095 | 0.0517 | 0.0550 | 0.0651 | 0.0022 |
| IR_Y-2 | 0.0942 | 0.0495 | 0.0497 | 0.0576 | 0.0015 |
| pancras_naive | 0.5345 | 0.1268 | 0.1758 | 0.5135 | 0.2391 |
| pancras_crag | 0.5784 | 0.0935 | 0.1465 | 0.3487 | 0.2100 |
| BioXR-GTE | 0.0071 | 0.0023 | 0.0031 | 0.0028 | 0.0000 |
| MedQA-1 | 0.2774 | 0.0490 | 0.0766 | 0.1837 | 0.0329 |
| MedQA-2 | 0.2540 | 0.0492 | 0.0730 | 0.1891 | 0.0329 |
| MedQA-4 | 0.2171 | 0.0457 | 0.0632 | 0.1493 | 0.0167 |
| MedQA-5 | 0.3268 | 0.0714 | 0.1011 | 0.2602 | 0.1037 |
| 1 system | 0.3852 | 0.1111 | 0.1415 | 0.3159 | 0.1142 |
| 2 system | 0.4751 | 0.1634 | 0.2100 | 0.4564 | 0.2493 |
| 3 system | 0.4671 | 0.1639 | 0.2101 | 0.4408 | 0.2242 |
| 4 system | 0.3767 | 0.1555 | 0.1802 | 0.2647 | 0.0889 |
| 5 system | 0.4452 | 0.1831 | 0.2155 | 0.4145 | 0.2415 |
Concepts
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| SATO | - | - | - | - | - |
| IR2 | - | - | - | - | - |
| IR3 | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| IR5 | - | - | - | - | - |
| IR4 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| multi-stage rank&llm | - | - | - | - | - |
| AJDEM | - | - | - | - | - |
| FinalQwen | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| BM25 baseline retrie | - | - | - | - | - |
| BM25 + MeSH (14b-A) | - | - | - | - | - |
| BM25 + PRF(14b-A) | - | - | - | - | - |
| BM25 + cross-encoder | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ensemble | - | - | - | - | - |
| BM25 + LTR | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| multi-stage rank&ll | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| llama for 14b b | - | - | - | - | - |
| DSGTBioasq | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| BioXR-GTE | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| 1 system | - | - | - | - | - |
| 2 system | - | - | - | - | - |
| 3 system | - | - | - | - | - |
| 4 system | - | - | - | - | - |
| 5 system | - | - | - | - | - |
RDF Triples
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| SATO | - | - | - | - | - |
| IR2 | - | - | - | - | - |
| IR3 | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| IR5 | - | - | - | - | - |
| IR4 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| multi-stage rank&llm | - | - | - | - | - |
| AJDEM | - | - | - | - | - |
| FinalQwen | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| BM25 baseline retrie | - | - | - | - | - |
| BM25 + MeSH (14b-A) | - | - | - | - | - |
| BM25 + PRF(14b-A) | - | - | - | - | - |
| BM25 + cross-encoder | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ensemble | - | - | - | - | - |
| BM25 + LTR | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| multi-stage rank&ll | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| llama for 14b b | - | - | - | - | - |
| DSGTBioasq | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| BioXR-GTE | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| 1 system | - | - | - | - | - |
| 2 system | - | - | - | - | - |
| 3 system | - | - | - | - | - |
| 4 system | - | - | - | - | - |
| 5 system | - | - | - | - | - |