BioASQ Participants Area
Task 14b: Test Results of Phase A
* The "-" replace the scores of systems that didn't submit the corresponding annotations. *The test results are presented in separate tables for each type of annotation. They are sorted based on the scores of MAP. The "System Description" of each system is used.
The evaluation measures that are used are presented here .
Test batch 1
Documents
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.0776 | 0.2792 | 0.1119 | 0.1949 | 0.0011 |
| porties-baseline | 0.0700 | 0.2575 | 0.1002 | 0.1743 | 0.0004 |
| health-nlp-1 | 0.0892 | 0.2769 | 0.1163 | 0.1696 | 0.0017 |
| DS@GT BioASQ | - | - | - | - | - |
| pancras_naive | 0.1169 | 0.3000 | 0.1524 | 0.2078 | 0.0020 |
| dictycite-baseline | 0.0938 | 0.3343 | 0.1349 | 0.2333 | 0.0023 |
| dictycite-snippet | 0.1050 | 0.3636 | 0.1500 | 0.2577 | 0.0028 |
| dictycite-max | 0.1138 | 0.3808 | 0.1594 | 0.2830 | 0.0053 |
| lean_rag_ft_sparse | 0.0805 | 0.2547 | 0.1131 | 0.1630 | 0.0010 |
| lean_rag_ft | 0.0825 | 0.2620 | 0.1163 | 0.1650 | 0.0012 |
| lean_rag | 0.0800 | 0.2483 | 0.1112 | 0.1691 | 0.0011 |
| Fleming-1 | 0.1063 | 0.3542 | 0.1490 | 0.2432 | 0.0047 |
| dictycite-max-rew-si | 0.1138 | 0.3934 | 0.1613 | 0.2763 | 0.0048 |
| dictycite-max-rew-sl | 0.1188 | 0.4090 | 0.1686 | 0.2835 | 0.0048 |
| Fleming-2 | 0.1063 | 0.3542 | 0.1490 | 0.2432 | 0.0047 |
| pancras_crag | 0.0934 | 0.2703 | 0.1248 | 0.1798 | 0.0014 |
| Fleming-3 | 0.1050 | 0.3485 | 0.1476 | 0.2428 | 0.0043 |
| Fleming-4 | 0.1050 | 0.3485 | 0.1476 | 0.2428 | 0.0043 |
| Fleming-5 | 0.1063 | 0.3518 | 0.1490 | 0.2462 | 0.0045 |
| bioinfo-0 | 0.0850 | 0.2937 | 0.1200 | 0.1476 | 0.0014 |
| Organization name | 0.0726 | 0.1525 | 0.0759 | 0.0902 | 0.0001 |
| "RMC_1" | 0.0484 | 0.1704 | 0.0690 | 0.1042 | 0.0003 |
| RMC_2 | 0.1035 | 0.1270 | 0.1016 | 0.0998 | 0.0001 |
| DS@GT-BioASQ | - | - | - | - | - |
| bioinfo-1 | 0.0863 | 0.2949 | 0.1212 | 0.1502 | 0.0015 |
| bioinfo-2 | 0.1088 | 0.3576 | 0.1524 | 0.2220 | 0.0035 |
| bioinfo-3 | 0.1050 | 0.3539 | 0.1488 | 0.2479 | 0.0029 |
| bioinfo-4 | 0.1125 | 0.3698 | 0.1581 | 0.2398 | 0.0032 |
| Biomedical QA system | 0.0867 | 0.3152 | 0.1235 | 0.2176 | 0.0032 |
| Biomedical QA s. v2 | 0.0322 | 0.0633 | 0.0401 | 0.0228 | 0.0000 |
| main | 0.0663 | 0.2335 | 0.0952 | 0.1497 | 0.0007 |
| IR1 | 0.0950 | 0.3300 | 0.1358 | 0.2349 | 0.0027 |
| dmiip2024 | 0.0888 | 0.2864 | 0.1217 | 0.1986 | 0.0026 |
| dmiip2024_1 | 0.0888 | 0.2851 | 0.1214 | 0.2023 | 0.0025 |
| dmiip2024_2 | 0.0900 | 0.2703 | 0.1225 | 0.1884 | 0.0038 |
| dmiip2024_3 | 0.0938 | 0.2788 | 0.1276 | 0.1902 | 0.0039 |
| dmiip2024_4 | 0.0900 | 0.2703 | 0.1225 | 0.1887 | 0.0038 |
| semantic | 0.0663 | 0.2335 | 0.0952 | 0.1497 | 0.0007 |
| prompted | 0.0663 | 0.2335 | 0.0952 | 0.1497 | 0.0007 |
| Biomedical QA s3 | 0.0732 | 0.2047 | 0.0913 | 0.1398 | 0.0003 |
| IR_J-1 | 0.1286 | 0.1293 | 0.0991 | 0.0874 | 0.0002 |
| IR_J-2 | 0.0875 | 0.1292 | 0.0870 | 0.0954 | 0.0002 |
| IR_Y-1 | 0.0453 | 0.1685 | 0.0671 | 0.1077 | 0.0003 |
| IR_Y-2 | 0.0453 | 0.1685 | 0.0671 | 0.1077 | 0.0003 |
| IR_Y-3 | 0.0453 | 0.1685 | 0.0671 | 0.1077 | 0.0003 |
| IR_Y-4 | 0.0453 | 0.1685 | 0.0671 | 0.1077 | 0.0003 |
| IR_Y-5 | 0.0453 | 0.1685 | 0.0671 | 0.1077 | 0.0003 |
| UR-IW-1 | 0.0765 | 0.1942 | 0.1012 | 0.1473 | 0.0005 |
| UR-IW-2 | 0.1046 | 0.1966 | 0.1168 | 0.1340 | 0.0004 |
| UR-IW-3 | 0.0938 | 0.1915 | 0.1029 | 0.1312 | 0.0005 |
| UR-IW-4 | 0.0610 | 0.1747 | 0.0828 | 0.1226 | 0.0004 |
| UR-IW-5 | 0.0756 | 0.1658 | 0.0852 | 0.1263 | 0.0004 |
| health-nlp-2 | 0.0892 | 0.2769 | 0.1163 | 0.1696 | 0.0017 |
| WHU-ECHO Lab-1 | 0.0475 | 0.1833 | 0.0731 | 0.0802 | 0.0002 |
| ubuntu | 0.0250 | 0.0468 | 0.0303 | 0.0263 | 0.0000 |
Snippets
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.0462 | 0.1541 | 0.0543 | 0.0769 | 0.0002 |
| porties-baseline | 0.0364 | 0.0871 | 0.0414 | 0.0609 | 0.0001 |
| health-nlp-1 | 0.0595 | 0.0858 | 0.0542 | 0.0542 | 0.0002 |
| DS@GT BioASQ | - | - | - | - | - |
| pancras_naive | 0.0759 | 0.2000 | 0.0825 | 0.1402 | 0.0008 |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| lean_rag_ft_sparse | 0.0504 | 0.1537 | 0.0601 | 0.0404 | 0.0002 |
| lean_rag_ft | 0.0505 | 0.1537 | 0.0601 | 0.0403 | 0.0002 |
| lean_rag | 0.0518 | 0.1369 | 0.0606 | 0.0403 | 0.0002 |
| Fleming-1 | 0.0652 | 0.2098 | 0.0769 | 0.1109 | 0.0015 |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-2 | 0.0640 | 0.2200 | 0.0757 | 0.1198 | 0.0021 |
| pancras_crag | 0.0479 | 0.1094 | 0.0517 | 0.0619 | 0.0002 |
| Fleming-3 | 0.0608 | 0.2057 | 0.0735 | 0.1048 | 0.0011 |
| Fleming-4 | 0.0621 | 0.2215 | 0.0757 | 0.1168 | 0.0020 |
| Fleming-5 | 0.0639 | 0.2083 | 0.0759 | 0.1085 | 0.0012 |
| bioinfo-0 | - | - | - | - | - |
| Organization name | 0.0400 | 0.1033 | 0.0425 | 0.1089 | 0.0001 |
| "RMC_1" | 0.0233 | 0.0764 | 0.0254 | 0.0357 | 0.0001 |
| RMC_2 | 0.0360 | 0.1036 | 0.0436 | 0.1113 | 0.0001 |
| DS@GT-BioASQ | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| Biomedical QA system | 0.0598 | 0.1790 | 0.0710 | 0.1475 | 0.0009 |
| Biomedical QA s. v2 | 0.0179 | 0.0245 | 0.0170 | 0.0152 | 0.0000 |
| main | 0.0034 | 0.0056 | 0.0040 | 0.0048 | 0.0000 |
| IR1 | 0.0689 | 0.2418 | 0.0877 | 0.1656 | 0.0010 |
| dmiip2024 | 0.0682 | 0.2041 | 0.0755 | 0.1574 | 0.0011 |
| dmiip2024_1 | 0.0704 | 0.2213 | 0.0791 | 0.1646 | 0.0013 |
| dmiip2024_2 | 0.0767 | 0.2094 | 0.0852 | 0.1591 | 0.0014 |
| dmiip2024_3 | 0.0824 | 0.2188 | 0.0914 | 0.1671 | 0.0017 |
| dmiip2024_4 | 0.0766 | 0.2099 | 0.0851 | 0.1601 | 0.0015 |
| semantic | 0.0072 | 0.0094 | 0.0069 | 0.0128 | 0.0000 |
| prompted | 0.0033 | 0.0186 | 0.0045 | 0.0064 | 0.0000 |
| Biomedical QA s3 | 0.0387 | 0.1200 | 0.0435 | 0.1078 | 0.0002 |
| IR_J-1 | 0.0953 | 0.0836 | 0.0561 | 0.0565 | 0.0001 |
| IR_J-2 | 0.0622 | 0.0982 | 0.0522 | 0.0633 | 0.0001 |
| IR_Y-1 | 0.0161 | 0.1364 | 0.0254 | 0.0255 | 0.0001 |
| IR_Y-2 | 0.0161 | 0.1364 | 0.0254 | 0.0153 | 0.0001 |
| IR_Y-3 | 0.0161 | 0.1364 | 0.0254 | 0.0255 | 0.0001 |
| IR_Y-4 | 0.0161 | 0.1364 | 0.0254 | 0.0153 | 0.0001 |
| IR_Y-5 | 0.0161 | 0.1364 | 0.0254 | 0.0255 | 0.0001 |
| UR-IW-1 | 0.0617 | 0.1326 | 0.0717 | 0.1193 | 0.0003 |
| UR-IW-2 | 0.0930 | 0.1416 | 0.0829 | 0.1074 | 0.0004 |
| UR-IW-3 | 0.0761 | 0.1385 | 0.0791 | 0.1209 | 0.0003 |
| UR-IW-4 | 0.0481 | 0.1211 | 0.0554 | 0.0997 | 0.0003 |
| UR-IW-5 | 0.0720 | 0.1295 | 0.0702 | 0.1234 | 0.0003 |
| health-nlp-2 | 0.0595 | 0.0858 | 0.0542 | 0.0542 | 0.0002 |
| WHU-ECHO Lab-1 | - | - | - | - | - |
| ubuntu | 0.0155 | 0.0290 | 0.0160 | 0.0179 | 0.0000 |
Concepts
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| porties-baseline | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| DS@GT BioASQ | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| Fleming-4 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| Biomedical QA system | - | - | - | - | - |
| Biomedical QA s. v2 | - | - | - | - | - |
| main | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| semantic | - | - | - | - | - |
| prompted | - | - | - | - | - |
| Biomedical QA s3 | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| IR_Y-3 | - | - | - | - | - |
| IR_Y-4 | - | - | - | - | - |
| IR_Y-5 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| WHU-ECHO Lab-1 | - | - | - | - | - |
| ubuntu | - | - | - | - | - |
RDF Triples
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| porties-baseline | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| DS@GT BioASQ | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| Fleming-4 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| Biomedical QA system | - | - | - | - | - |
| Biomedical QA s. v2 | - | - | - | - | - |
| main | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| semantic | - | - | - | - | - |
| prompted | - | - | - | - | - |
| Biomedical QA s3 | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| IR_Y-3 | - | - | - | - | - |
| IR_Y-4 | - | - | - | - | - |
| IR_Y-5 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| WHU-ECHO Lab-1 | - | - | - | - | - |
| ubuntu | - | - | - | - | - |
Test batch 2
Documents
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.0614 | 0.2662 | 0.0935 | 0.1413 | 0.0009 |
| lean_rag | 0.0650 | 0.2790 | 0.0985 | 0.1781 | 0.0011 |
| lean_rag_dprf | 0.0600 | 0.2600 | 0.0916 | 0.1649 | 0.0009 |
| lean_rag_ft | 0.0650 | 0.2790 | 0.0985 | 0.1791 | 0.0011 |
| lean_rag_ft_sparse | 0.0613 | 0.2657 | 0.0939 | 0.1624 | 0.0009 |
| Splade-v3 | 0.0375 | 0.1368 | 0.0560 | 0.0928 | 0.0002 |
| Debertav3 | 0.0500 | 0.1881 | 0.0743 | 0.1241 | 0.0004 |
| Fully fine-tuned | 0.0425 | 0.1670 | 0.0637 | 0.1218 | 0.0002 |
| Recently fine-tuned | 0.0525 | 0.1951 | 0.0780 | 0.1092 | 0.0004 |
| Biomedical QA system | 0.0688 | 0.2553 | 0.1010 | 0.1689 | 0.0009 |
| bm25 + splade | 0.0575 | 0.2464 | 0.0881 | 0.1947 | 0.0007 |
| dictycite-baseline | 0.0763 | 0.3149 | 0.1150 | 0.2085 | 0.0017 |
| dictycite-max | 0.0800 | 0.3214 | 0.1197 | 0.2395 | 0.0018 |
| dictycite-max-rew-si | 0.0813 | 0.3357 | 0.1222 | 0.2370 | 0.0015 |
| dictycite-max-rew-sl | 0.0825 | 0.3254 | 0.1229 | 0.2322 | 0.0018 |
| dictycite-snippet | 0.0800 | 0.3221 | 0.1193 | 0.2249 | 0.0017 |
| Fleming-1 | 0.0675 | 0.2874 | 0.1023 | 0.2148 | 0.0011 |
| Biomedical QA s. v2 | 0.0763 | 0.2658 | 0.1111 | 0.1724 | 0.0010 |
| Fleming-2 | 0.0675 | 0.2874 | 0.1023 | 0.2148 | 0.0011 |
| MedQA-1 | 0.0271 | 0.1013 | 0.0405 | 0.0646 | 0.0001 |
| health-nlp-1 | 0.0683 | 0.2580 | 0.1023 | 0.1399 | 0.0008 |
| Hybrid Retrieval | 0.0075 | 0.0323 | 0.0120 | 0.0109 | 0.0000 |
| MedQA-2 | 0.0358 | 0.1277 | 0.0521 | 0.0882 | 0.0002 |
| "RMC_1" | 0.0276 | 0.1367 | 0.0429 | 0.0881 | 0.0001 |
| RMC_2 | 0.0813 | 0.1141 | 0.0873 | 0.0995 | 0.0001 |
| RMC_3 | 0.0434 | 0.1570 | 0.0604 | 0.1069 | 0.0002 |
| RMC_4 | 0.0263 | 0.1191 | 0.0405 | 0.0856 | 0.0001 |
| RMC_5 | 0.0485 | 0.1456 | 0.0640 | 0.1090 | 0.0001 |
| main | 0.0450 | 0.1883 | 0.0683 | 0.1214 | 0.0003 |
| semantic | 0.0450 | 0.1883 | 0.0683 | 0.1214 | 0.0003 |
| prompted | 0.0450 | 0.1883 | 0.0683 | 0.1214 | 0.0003 |
| pancras_naive | 0.0957 | 0.2950 | 0.1348 | 0.1807 | 0.0012 |
| pancras_crag | 0.1359 | 0.2434 | 0.1502 | 0.1605 | 0.0006 |
| Organization name | 0.0812 | 0.1819 | 0.0962 | 0.0985 | 0.0002 |
| bioinfo-0 | 0.0525 | 0.1979 | 0.0776 | 0.0813 | 0.0004 |
| bioinfo-1 | 0.0738 | 0.2953 | 0.1107 | 0.1914 | 0.0016 |
| bioinfo-2 | 0.0438 | 0.1845 | 0.0667 | 0.0721 | 0.0003 |
| bioinfo-3 | 0.0438 | 0.1845 | 0.0667 | 0.0718 | 0.0003 |
| bioinfo-4 | 0.0725 | 0.3053 | 0.1103 | 0.1922 | 0.0016 |
| IR1 | 0.1000 | 0.2677 | 0.1264 | 0.1881 | 0.0010 |
| health-nlp-2 | 0.0721 | 0.2703 | 0.1076 | 0.1462 | 0.0008 |
| DS@GT-BioASQ | 0.0642 | 0.1249 | 0.0728 | 0.0917 | 0.0001 |
| IR_J-1 | 0.0425 | 0.1850 | 0.0634 | 0.1177 | 0.0002 |
| IR_J-2 | 0.0948 | 0.1221 | 0.0881 | 0.0891 | 0.0001 |
| dmiip2024 | 0.0663 | 0.2751 | 0.1012 | 0.1923 | 0.0009 |
| dmiip2024_1 | 0.0713 | 0.3011 | 0.1096 | 0.1953 | 0.0013 |
| dmiip2024_3 | 0.0625 | 0.2561 | 0.0954 | 0.1839 | 0.0008 |
| dmiip2024_4 | 0.0613 | 0.2525 | 0.0933 | 0.1846 | 0.0006 |
| dmiip2024_2 | 0.0650 | 0.2847 | 0.1005 | 0.1970 | 0.0009 |
| mckpt1 | 0.0310 | 0.0779 | 0.0404 | 0.0357 | 0.0000 |
| mckpt2 | 0.0261 | 0.0497 | 0.0309 | 0.0262 | 0.0000 |
| MedQA-3 | 0.0588 | 0.2433 | 0.0890 | 0.1524 | 0.0006 |
| MedQA-4 | 0.0588 | 0.2433 | 0.0890 | 0.1515 | 0.0006 |
| MedQA-5 | 0.0688 | 0.2902 | 0.1050 | 0.1628 | 0.0010 |
| Fleming-3 | 0.0688 | 0.2963 | 0.1049 | 0.2155 | 0.0013 |
| UR-IW-3 | 0.0814 | 0.2289 | 0.1080 | 0.1373 | 0.0007 |
| WHU-ECHO Lab-2 | 0.0433 | 0.1511 | 0.0615 | 0.0688 | 0.0002 |
| UR-IW-4 | 0.0738 | 0.2028 | 0.0998 | 0.1200 | 0.0005 |
| UR-IW-1 | 0.0630 | 0.1880 | 0.0846 | 0.1292 | 0.0003 |
| UR-IW-5 | 0.0665 | 0.2236 | 0.0912 | 0.1226 | 0.0004 |
| Fleming-5 | 0.0688 | 0.2937 | 0.1044 | 0.2159 | 0.0012 |
| UR-IW-2 | 0.0971 | 0.2048 | 0.1050 | 0.1474 | 0.0005 |
| IR_Y-1 | 0.0425 | 0.1850 | 0.0634 | 0.1177 | 0.0002 |
| IR_Y-2 | 0.0438 | 0.1768 | 0.0643 | 0.1099 | 0.0002 |
| Biomedical QA s3 | 0.0713 | 0.2413 | 0.1034 | 0.1672 | 0.0008 |
| ubuntu | - | - | - | - | - |
| qwen | - | - | - | - | - |
| config-1 | 0.0463 | 0.2029 | 0.0718 | 0.1007 | 0.0002 |
Snippets
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.0508 | 0.1216 | 0.0580 | 0.1154 | 0.0002 |
| lean_rag | 0.0755 | 0.1469 | 0.0809 | 0.0583 | 0.0003 |
| lean_rag_dprf | 0.0688 | 0.1348 | 0.0762 | 0.0547 | 0.0002 |
| lean_rag_ft | 0.0743 | 0.1466 | 0.0802 | 0.0571 | 0.0003 |
| lean_rag_ft_sparse | 0.0667 | 0.1361 | 0.0761 | 0.0541 | 0.0002 |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| Biomedical QA system | 0.0610 | 0.1192 | 0.0621 | 0.1259 | 0.0003 |
| bm25 + splade | 0.0438 | 0.0682 | 0.0469 | 0.0545 | 0.0001 |
| dictycite-baseline | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| Fleming-1 | 0.0462 | 0.1381 | 0.0570 | 0.0971 | 0.0008 |
| Biomedical QA s. v2 | 0.0607 | 0.1209 | 0.0627 | 0.1245 | 0.0004 |
| Fleming-2 | 0.0408 | 0.1127 | 0.0517 | 0.0949 | 0.0004 |
| MedQA-1 | 0.0203 | 0.0480 | 0.0253 | 0.0373 | 0.0000 |
| health-nlp-1 | 0.0430 | 0.1016 | 0.0512 | 0.0485 | 0.0001 |
| Hybrid Retrieval | 0.0070 | 0.0139 | 0.0093 | 0.0108 | 0.0000 |
| MedQA-2 | 0.0237 | 0.0605 | 0.0282 | 0.0513 | 0.0001 |
| "RMC_1" | 0.0115 | 0.0488 | 0.0156 | 0.0377 | 0.0000 |
| RMC_2 | 0.0373 | 0.0846 | 0.0419 | 0.2108 | 0.0001 |
| RMC_3 | 0.0192 | 0.0613 | 0.0247 | 0.0650 | 0.0001 |
| RMC_4 | 0.0188 | 0.0509 | 0.0204 | 0.0390 | 0.0000 |
| RMC_5 | 0.0315 | 0.0760 | 0.0361 | 0.0763 | 0.0001 |
| main | 0.0048 | 0.0161 | 0.0057 | 0.0069 | 0.0000 |
| semantic | 0.0030 | 0.0102 | 0.0028 | 0.0033 | 0.0000 |
| prompted | 0.0061 | 0.0199 | 0.0074 | 0.0174 | 0.0000 |
| pancras_naive | 0.0717 | 0.1890 | 0.0858 | 0.1455 | 0.0008 |
| pancras_crag | 0.1110 | 0.1592 | 0.0975 | 0.1364 | 0.0005 |
| Organization name | 0.0558 | 0.0987 | 0.0530 | 0.1544 | 0.0001 |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| IR1 | 0.0481 | 0.1253 | 0.0571 | 0.1494 | 0.0003 |
| health-nlp-2 | 0.0430 | 0.0997 | 0.0511 | 0.0539 | 0.0001 |
| DS@GT-BioASQ | 0.0275 | 0.0528 | 0.0359 | 0.0466 | 0.0000 |
| IR_J-1 | 0.0194 | 0.1114 | 0.0273 | 0.0318 | 0.0001 |
| IR_J-2 | 0.0809 | 0.0835 | 0.0644 | 0.0628 | 0.0001 |
| dmiip2024 | 0.0741 | 0.1927 | 0.0911 | 0.1825 | 0.0005 |
| dmiip2024_1 | 0.0725 | 0.2082 | 0.0917 | 0.1824 | 0.0007 |
| dmiip2024_3 | 0.0694 | 0.1799 | 0.0871 | 0.1678 | 0.0004 |
| dmiip2024_4 | 0.0643 | 0.1703 | 0.0800 | 0.1697 | 0.0003 |
| dmiip2024_2 | 0.0674 | 0.1918 | 0.0846 | 0.1826 | 0.0005 |
| mckpt1 | 0.0159 | 0.0605 | 0.0219 | 0.0097 | 0.0000 |
| mckpt2 | 0.0123 | 0.0314 | 0.0149 | 0.0068 | 0.0000 |
| MedQA-3 | 0.0536 | 0.1620 | 0.0646 | 0.0996 | 0.0004 |
| MedQA-4 | 0.0482 | 0.1682 | 0.0599 | 0.0813 | 0.0004 |
| MedQA-5 | 0.0529 | 0.2014 | 0.0682 | 0.0855 | 0.0006 |
| Fleming-3 | 0.0463 | 0.1388 | 0.0578 | 0.0940 | 0.0008 |
| UR-IW-3 | 0.0733 | 0.1574 | 0.0844 | 0.1375 | 0.0005 |
| WHU-ECHO Lab-2 | - | - | - | - | - |
| UR-IW-4 | 0.0631 | 0.1421 | 0.0724 | 0.0983 | 0.0004 |
| UR-IW-1 | 0.0691 | 0.1313 | 0.0720 | 0.1076 | 0.0003 |
| UR-IW-5 | 0.0698 | 0.1516 | 0.0797 | 0.1055 | 0.0003 |
| Fleming-5 | 0.0469 | 0.1413 | 0.0583 | 0.0977 | 0.0008 |
| UR-IW-2 | 0.1010 | 0.1303 | 0.0879 | 0.1132 | 0.0004 |
| IR_Y-1 | 0.0194 | 0.1114 | 0.0273 | 0.0318 | 0.0001 |
| IR_Y-2 | 0.0211 | 0.1096 | 0.0300 | 0.0316 | 0.0001 |
| Biomedical QA s3 | 0.0588 | 0.1058 | 0.0618 | 0.1143 | 0.0003 |
| ubuntu | - | - | - | - | - |
| qwen | - | - | - | - | - |
| config-1 | 0.0356 | 0.1386 | 0.0511 | 0.0629 | 0.0001 |
Concepts
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| Biomedical QA system | - | - | - | - | - |
| bm25 + splade | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| Biomedical QA s. v2 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| Hybrid Retrieval | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| main | - | - | - | - | - |
| semantic | - | - | - | - | - |
| prompted | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| mckpt1 | - | - | - | - | - |
| mckpt2 | - | - | - | - | - |
| MedQA-3 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| WHU-ECHO Lab-2 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| Biomedical QA s3 | - | - | - | - | - |
| ubuntu | - | - | - | - | - |
| qwen | - | - | - | - | - |
| config-1 | - | - | - | - | - |
RDF Triples
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| Biomedical QA system | - | - | - | - | - |
| bm25 + splade | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| Biomedical QA s. v2 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| Hybrid Retrieval | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| main | - | - | - | - | - |
| semantic | - | - | - | - | - |
| prompted | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| mckpt1 | - | - | - | - | - |
| mckpt2 | - | - | - | - | - |
| MedQA-3 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| WHU-ECHO Lab-2 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| Biomedical QA s3 | - | - | - | - | - |
| ubuntu | - | - | - | - | - |
| qwen | - | - | - | - | - |
| config-1 | - | - | - | - | - |
Test batch 3
Documents
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| lean_rag_ft_sparse | 0.0383 | 0.1825 | 0.0606 | 0.1215 | 0.0002 |
| lean_rag_ft | 0.0367 | 0.1742 | 0.0579 | 0.1192 | 0.0002 |
| lean_rag_dprf | 0.0350 | 0.1687 | 0.0553 | 0.1113 | 0.0002 |
| lean_rag_ensemble | 0.0400 | 0.1960 | 0.0631 | 0.1209 | 0.0003 |
| lean_rag | 0.0367 | 0.1742 | 0.0579 | 0.1201 | 0.0002 |
| aida_2025_2 | 0.0500 | 0.2427 | 0.0805 | 0.1521 | 0.0006 |
| IR1 | 0.0550 | 0.2585 | 0.0870 | 0.1404 | 0.0010 |
| IR5 | 0.0567 | 0.2641 | 0.0896 | 0.1677 | 0.0011 |
| Fleming-1 | 0.0750 | 0.3117 | 0.1138 | 0.2007 | 0.0028 |
| Fleming-2 | 0.0833 | 0.3571 | 0.1273 | 0.2063 | 0.0039 |
| "RMC_1" | 0.0320 | 0.0919 | 0.0454 | 0.0374 | 0.0001 |
| RMC_2 | 0.0583 | 0.0631 | 0.0561 | 0.0511 | 0.0000 |
| RMC_3 | 0.0320 | 0.0919 | 0.0454 | 0.0374 | 0.0001 |
| RMC_4 | 0.0388 | 0.1640 | 0.0595 | 0.1099 | 0.0002 |
| RMC_5 | 0.0406 | 0.1807 | 0.0629 | 0.1224 | 0.0002 |
| Fleming-3 | 0.0650 | 0.2846 | 0.0996 | 0.1826 | 0.0023 |
| IR_J-1 | 0.0821 | 0.1362 | 0.0927 | 0.0870 | 0.0001 |
| IR_J-2 | 0.0626 | 0.0996 | 0.0689 | 0.0793 | 0.0001 |
| pancras_naive | 0.0754 | 0.2460 | 0.1070 | 0.1250 | 0.0011 |
| pancras_crag | 0.1248 | 0.1889 | 0.1255 | 0.1128 | 0.0004 |
| Organization name | 0.0179 | 0.0764 | 0.0276 | 0.0416 | 0.0000 |
| multi-stage rank&llm | 0.0800 | 0.3490 | 0.1238 | 0.1764 | 0.0032 |
| health-nlp-1 | 0.0572 | 0.2263 | 0.0853 | 0.1072 | 0.0005 |
| dmiip2024 | 0.0567 | 0.2576 | 0.0886 | 0.1287 | 0.0008 |
| dmiip2024_2 | 0.0600 | 0.2651 | 0.0930 | 0.1401 | 0.0008 |
| dmiip2024_1 | 0.0583 | 0.2655 | 0.0912 | 0.1364 | 0.0008 |
| dmiip2024_3 | 0.0550 | 0.2489 | 0.0857 | 0.1256 | 0.0007 |
| dmiip2024_4 | 0.0550 | 0.2378 | 0.0852 | 0.1297 | 0.0007 |
| BioNeuralSystem1 | 0.0417 | 0.1982 | 0.0668 | 0.1239 | 0.0003 |
| DS@GT-BioASQ | 0.0200 | 0.1000 | 0.0326 | 0.0694 | 0.0001 |
| BioXR-GTE | 0.0604 | 0.2776 | 0.0948 | 0.1674 | 0.0010 |
| IR_Y-1 | 0.0283 | 0.1385 | 0.0452 | 0.0946 | 0.0001 |
| IR_Y-2 | 0.0283 | 0.1385 | 0.0452 | 0.1100 | 0.0001 |
| dictycite-baseline | 0.0583 | 0.2720 | 0.0920 | 0.1482 | 0.0008 |
| dictycite-snippet | 0.0550 | 0.2669 | 0.0877 | 0.1728 | 0.0010 |
| dictycite-max | 0.0633 | 0.2845 | 0.0990 | 0.1289 | 0.0010 |
| dictycite-max-rew-si | 0.0717 | 0.3231 | 0.1118 | 0.1748 | 0.0023 |
| dictycite-max-rew-sl | 0.0750 | 0.3429 | 0.1179 | 0.1879 | 0.0021 |
| UR-IW-5 | 0.0883 | 0.2728 | 0.1168 | 0.1615 | 0.0017 |
| UR-IW-3 | 0.0628 | 0.1790 | 0.0761 | 0.1165 | 0.0002 |
| UR-IW-4 | 0.0619 | 0.2601 | 0.0945 | 0.1773 | 0.0007 |
| UR-IW-2 | 0.0602 | 0.1651 | 0.0763 | 0.0971 | 0.0002 |
| UR-IW-1 | 0.0838 | 0.2396 | 0.1024 | 0.1360 | 0.0007 |
| BioXR-BGE | 0.0485 | 0.2413 | 0.0783 | 0.1423 | 0.0007 |
| bioinfo-0 | 0.0633 | 0.2782 | 0.0976 | 0.1887 | 0.0020 |
| bioinfo-1 | 0.0667 | 0.2780 | 0.1017 | 0.1600 | 0.0013 |
| bioinfo-2 | 0.0583 | 0.2641 | 0.0921 | 0.1419 | 0.0009 |
| bioinfo-3 | 0.0417 | 0.2038 | 0.0671 | 0.1088 | 0.0003 |
| bioinfo-4 | 0.0383 | 0.1927 | 0.0620 | 0.0993 | 0.0003 |
| Splade-v3 | 0.0367 | 0.1613 | 0.0575 | 0.0926 | 0.0002 |
| Debertav3 | 0.0533 | 0.2190 | 0.0814 | 0.1395 | 0.0005 |
| Fully fine-tuned | 0.0467 | 0.1935 | 0.0710 | 0.1226 | 0.0003 |
| Recently fine-tuned | 0.0517 | 0.2327 | 0.0804 | 0.1411 | 0.0006 |
| MedQA-1 | 0.0603 | 0.1727 | 0.0825 | 0.0951 | 0.0003 |
| MedQA-2 | 0.0581 | 0.1890 | 0.0833 | 0.0983 | 0.0004 |
| MedQA-3 | 0.0603 | 0.1727 | 0.0825 | 0.0951 | 0.0003 |
| MedQA-4 | 0.0660 | 0.2120 | 0.0943 | 0.1127 | 0.0004 |
| MedQA-5 | 0.0660 | 0.2120 | 0.0943 | 0.1127 | 0.0004 |
| Fleming-5 | 0.0783 | 0.3206 | 0.1178 | 0.2114 | 0.0026 |
| Fleming-4 | 0.0733 | 0.3016 | 0.1103 | 0.1969 | 0.0021 |
| IR2 | 0.0600 | 0.2839 | 0.0958 | 0.1639 | 0.0013 |
| IR3 | 0.0617 | 0.2808 | 0.0973 | 0.1689 | 0.0015 |
Snippets
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| lean_rag_ft_sparse | 0.0220 | 0.0757 | 0.0309 | 0.0218 | 0.0001 |
| lean_rag_ft | 0.0217 | 0.0757 | 0.0305 | 0.0216 | 0.0001 |
| lean_rag_dprf | 0.0237 | 0.0772 | 0.0327 | 0.0226 | 0.0001 |
| lean_rag_ensemble | 0.0203 | 0.0636 | 0.0275 | 0.0173 | 0.0000 |
| lean_rag | 0.0209 | 0.0754 | 0.0301 | 0.0217 | 0.0001 |
| aida_2025_2 | 0.0205 | 0.0498 | 0.0257 | 0.0489 | 0.0001 |
| IR1 | 0.0227 | 0.0661 | 0.0275 | 0.0469 | 0.0001 |
| IR5 | 0.0351 | 0.1057 | 0.0446 | 0.0666 | 0.0001 |
| Fleming-1 | 0.0448 | 0.1433 | 0.0575 | 0.1007 | 0.0007 |
| Fleming-2 | 0.0491 | 0.1673 | 0.0650 | 0.1065 | 0.0010 |
| "RMC_1" | 0.0110 | 0.0163 | 0.0107 | 0.0064 | 0.0000 |
| RMC_2 | 0.0190 | 0.0369 | 0.0200 | 0.0539 | 0.0000 |
| RMC_3 | 0.0110 | 0.0163 | 0.0107 | 0.0064 | 0.0000 |
| RMC_4 | 0.0149 | 0.0444 | 0.0187 | 0.0345 | 0.0001 |
| RMC_5 | 0.0183 | 0.0516 | 0.0234 | 0.0366 | 0.0001 |
| Fleming-3 | 0.0321 | 0.0964 | 0.0422 | 0.0610 | 0.0003 |
| IR_J-1 | 0.0693 | 0.0723 | 0.0548 | 0.0662 | 0.0001 |
| IR_J-2 | 0.0316 | 0.0562 | 0.0332 | 0.0472 | 0.0001 |
| pancras_naive | 0.0661 | 0.1566 | 0.0782 | 0.1030 | 0.0007 |
| pancras_crag | 0.0911 | 0.1227 | 0.0773 | 0.0819 | 0.0003 |
| Organization name | 0.0108 | 0.0292 | 0.0143 | 0.0244 | 0.0000 |
| multi-stage rank&llm | 0.0560 | 0.1425 | 0.0687 | 0.0954 | 0.0010 |
| health-nlp-1 | 0.0204 | 0.0130 | 0.0128 | 0.0109 | 0.0000 |
| dmiip2024 | 0.0429 | 0.1295 | 0.0531 | 0.0890 | 0.0003 |
| dmiip2024_2 | 0.0487 | 0.1544 | 0.0615 | 0.1226 | 0.0004 |
| dmiip2024_1 | 0.0428 | 0.1343 | 0.0559 | 0.0950 | 0.0003 |
| dmiip2024_3 | 0.0439 | 0.1311 | 0.0547 | 0.0920 | 0.0003 |
| dmiip2024_4 | 0.0452 | 0.1337 | 0.0564 | 0.0914 | 0.0003 |
| BioNeuralSystem1 | - | - | - | - | - |
| DS@GT-BioASQ | 0.0121 | 0.0244 | 0.0144 | 0.0169 | 0.0000 |
| BioXR-GTE | - | - | - | - | - |
| IR_Y-1 | 0.0083 | 0.0559 | 0.0130 | 0.0203 | 0.0000 |
| IR_Y-2 | 0.0091 | 0.0745 | 0.0149 | 0.0315 | 0.0001 |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| UR-IW-5 | 0.0937 | 0.1472 | 0.0836 | 0.1146 | 0.0009 |
| UR-IW-3 | 0.0577 | 0.1233 | 0.0558 | 0.0873 | 0.0002 |
| UR-IW-4 | 0.0690 | 0.1524 | 0.0780 | 0.1440 | 0.0005 |
| UR-IW-2 | 0.0544 | 0.1131 | 0.0509 | 0.0813 | 0.0002 |
| UR-IW-1 | 0.0697 | 0.1335 | 0.0758 | 0.1097 | 0.0003 |
| BioXR-BGE | - | - | - | - | - |
| bioinfo-0 | 0.0196 | 0.1409 | 0.0319 | 0.0546 | 0.0005 |
| bioinfo-1 | 0.0236 | 0.1374 | 0.0373 | 0.0352 | 0.0003 |
| bioinfo-2 | 0.0156 | 0.1255 | 0.0260 | 0.0375 | 0.0003 |
| bioinfo-3 | 0.0092 | 0.0637 | 0.0139 | 0.0267 | 0.0001 |
| bioinfo-4 | 0.0085 | 0.0613 | 0.0132 | 0.0130 | 0.0001 |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| MedQA-1 | 0.0292 | 0.0516 | 0.0291 | 0.0269 | 0.0001 |
| MedQA-2 | 0.0299 | 0.0582 | 0.0325 | 0.0276 | 0.0001 |
| MedQA-3 | 0.0292 | 0.0516 | 0.0291 | 0.0269 | 0.0001 |
| MedQA-4 | 0.0367 | 0.0865 | 0.0434 | 0.0564 | 0.0001 |
| MedQA-5 | 0.0367 | 0.0865 | 0.0434 | 0.0564 | 0.0001 |
| Fleming-5 | 0.0418 | 0.1058 | 0.0501 | 0.0682 | 0.0004 |
| Fleming-4 | 0.0381 | 0.0936 | 0.0444 | 0.0588 | 0.0003 |
| IR2 | 0.0525 | 0.1199 | 0.0610 | 0.0794 | 0.0002 |
| IR3 | 0.0571 | 0.1253 | 0.0641 | 0.0892 | 0.0003 |
Concepts
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ensemble | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| aida_2025_2 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| IR5 | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| multi-stage rank&llm | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| BioNeuralSystem1 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| BioXR-GTE | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| BioXR-BGE | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| MedQA-3 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| Fleming-4 | - | - | - | - | - |
| IR2 | - | - | - | - | - |
| IR3 | - | - | - | - | - |
RDF Triples
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ensemble | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| aida_2025_2 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| IR5 | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| multi-stage rank&llm | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| BioNeuralSystem1 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| BioXR-GTE | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| BioXR-BGE | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| MedQA-3 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| Fleming-4 | - | - | - | - | - |
| IR2 | - | - | - | - | - |
| IR3 | - | - | - | - | - |
Test batch 4
Documents
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.0625 | 0.2603 | 0.0947 | 0.1430 | 0.0011 |
| UR-IW-5 | 0.0808 | 0.2720 | 0.1157 | 0.1782 | 0.0013 |
| UR-IW-4 | 0.0690 | 0.2491 | 0.0995 | 0.2019 | 0.0007 |
| UR-IW-3 | 0.0690 | 0.2689 | 0.1003 | 0.1689 | 0.0007 |
| UR-IW-2 | 0.0846 | 0.2831 | 0.1151 | 0.1970 | 0.0016 |
| UR-IW-1 | 0.0729 | 0.2645 | 0.1055 | 0.1826 | 0.0011 |
| SATO | 0.0700 | 0.0851 | 0.0711 | 0.0642 | 0.0001 |
| IR2 | 0.0833 | 0.3052 | 0.1217 | 0.1973 | 0.0021 |
| IR3 | 0.0817 | 0.3018 | 0.1195 | 0.1917 | 0.0018 |
| Fleming-1 | 0.0650 | 0.2374 | 0.0961 | 0.1623 | 0.0007 |
| IR1 | 0.0717 | 0.2709 | 0.1045 | 0.1955 | 0.0018 |
| Splade-v3 | 0.0433 | 0.1852 | 0.0636 | 0.1035 | 0.0003 |
| Debertav3 | 0.0600 | 0.2544 | 0.0896 | 0.1503 | 0.0007 |
| Fully fine-tuned | 0.0483 | 0.2067 | 0.0735 | 0.1447 | 0.0004 |
| Recently fine-tuned | 0.0583 | 0.2510 | 0.0873 | 0.1420 | 0.0006 |
| IR5 | 0.0783 | 0.3039 | 0.1155 | 0.2025 | 0.0022 |
| IR4 | 0.0783 | 0.2975 | 0.1160 | 0.1998 | 0.0015 |
| Fleming-2 | 0.0650 | 0.2374 | 0.0961 | 0.1623 | 0.0007 |
| multi-stage rank&llm | 0.0900 | 0.3644 | 0.1344 | 0.2034 | 0.0028 |
| AJDEM | 0.0182 | 0.0461 | 0.0236 | 0.0119 | 0.0000 |
| FinalQwen | 0.0117 | 0.0374 | 0.0171 | 0.0119 | 0.0000 |
| health-nlp-1 | 0.0567 | 0.2228 | 0.0853 | 0.1268 | 0.0003 |
| health-nlp-2 | 0.0567 | 0.2228 | 0.0853 | 0.1268 | 0.0003 |
| "RMC_1" | 0.0441 | 0.1085 | 0.0572 | 0.0691 | 0.0001 |
| RMC_2 | 0.1028 | 0.1006 | 0.0896 | 0.0688 | 0.0001 |
| RMC_3 | 0.0497 | 0.1261 | 0.0617 | 0.0707 | 0.0002 |
| RMC_4 | 0.0200 | 0.0607 | 0.0293 | 0.0339 | 0.0000 |
| RMC_5 | 0.0394 | 0.0885 | 0.0516 | 0.0533 | 0.0001 |
| dictycite-baseline | 0.0800 | 0.2923 | 0.1160 | 0.1726 | 0.0017 |
| dictycite-snippet | 0.0850 | 0.3055 | 0.1230 | 0.1835 | 0.0021 |
| dictycite-max | 0.0867 | 0.3456 | 0.1288 | 0.2244 | 0.0021 |
| dictycite-max-rew-si | 0.0967 | 0.3698 | 0.1425 | 0.2310 | 0.0031 |
| dictycite-max-rew-sl | 0.0967 | 0.3698 | 0.1425 | 0.2234 | 0.0030 |
| Fleming-3 | 0.0717 | 0.2492 | 0.1044 | 0.1663 | 0.0008 |
| Fleming-5 | 0.0800 | 0.2852 | 0.1175 | 0.1786 | 0.0011 |
| BM25 baseline retrie | 0.0050 | 0.0149 | 0.0071 | 0.0109 | 0.0000 |
| BM25 + MeSH (14b-A) | 0.0050 | 0.0149 | 0.0071 | 0.0109 | 0.0000 |
| BM25 + PRF(14b-A) | 0.0050 | 0.0149 | 0.0071 | 0.0137 | 0.0000 |
| BM25 + cross-encoder | 0.0050 | 0.0274 | 0.0078 | 0.0119 | 0.0000 |
| lean_rag | 0.1030 | 0.2772 | 0.1274 | 0.1759 | 0.0013 |
| lean_rag_ft | 0.0977 | 0.2745 | 0.1223 | 0.1726 | 0.0015 |
| lean_rag_dprf | 0.0964 | 0.2804 | 0.1223 | 0.1754 | 0.0013 |
| lean_rag_ft_sparse | 0.0967 | 0.2731 | 0.1208 | 0.1700 | 0.0011 |
| lean_rag_ensemble | 0.1224 | 0.2741 | 0.1411 | 0.1852 | 0.0012 |
| BM25 + LTR | 0.0067 | 0.0315 | 0.0101 | 0.0182 | 0.0000 |
| Organization name | 0.0381 | 0.0913 | 0.0518 | 0.0493 | 0.0001 |
| multi-stage rank&ll | 0.0900 | 0.3406 | 0.1332 | 0.1852 | 0.0021 |
| dmiip2024 | 0.0750 | 0.2983 | 0.1123 | 0.1885 | 0.0016 |
| dmiip2024_1 | 0.0767 | 0.2978 | 0.1132 | 0.1905 | 0.0015 |
| dmiip2024_2 | 0.0817 | 0.3180 | 0.1200 | 0.1991 | 0.0018 |
| dmiip2024_3 | 0.0750 | 0.2859 | 0.1113 | 0.1709 | 0.0009 |
| dmiip2024_4 | 0.0767 | 0.2998 | 0.1139 | 0.1763 | 0.0012 |
| bioinfo-0 | 0.0800 | 0.2961 | 0.1191 | 0.1951 | 0.0015 |
| bioinfo-1 | 0.0783 | 0.2977 | 0.1142 | 0.1163 | 0.0013 |
| bioinfo-2 | 0.0867 | 0.3238 | 0.1276 | 0.1959 | 0.0033 |
| bioinfo-3 | 0.0717 | 0.2556 | 0.1028 | 0.1538 | 0.0016 |
| bioinfo-4 | 0.0717 | 0.2556 | 0.1028 | 0.1538 | 0.0016 |
| DS@GT-BioASQ | 0.0733 | 0.1539 | 0.0926 | 0.0956 | 0.0003 |
| llama for 14b b | 0.0250 | 0.0808 | 0.0370 | 0.0523 | 0.0001 |
| DSGTBioasq | 0.0733 | 0.1539 | 0.0926 | 0.0956 | 0.0003 |
| IR_J-1 | 0.0436 | 0.0639 | 0.0436 | 0.0460 | 0.0000 |
| IR_J-2 | 0.0752 | 0.0766 | 0.0651 | 0.0668 | 0.0001 |
| IR_Y-1 | 0.0367 | 0.1341 | 0.0514 | 0.0710 | 0.0001 |
| IR_Y-2 | 0.0367 | 0.1327 | 0.0512 | 0.0718 | 0.0001 |
| pancras_naive | 0.0882 | 0.2472 | 0.1178 | 0.1573 | 0.0012 |
| pancras_crag | 0.1129 | 0.2233 | 0.1298 | 0.1399 | 0.0008 |
| BioXR-GTE | 0.0717 | 0.3022 | 0.1067 | 0.1949 | 0.0015 |
| MedQA-1 | 0.0633 | 0.2139 | 0.0878 | 0.1640 | 0.0008 |
| MedQA-2 | 0.0650 | 0.2195 | 0.0904 | 0.1658 | 0.0008 |
| MedQA-4 | 0.0808 | 0.1689 | 0.0890 | 0.0972 | 0.0004 |
| MedQA-5 | 0.0783 | 0.3027 | 0.1156 | 0.1810 | 0.0025 |
| 1 system | 0.1002 | 0.2130 | 0.1259 | 0.1388 | 0.0009 |
| 2 system | 0.0615 | 0.2447 | 0.0914 | 0.1467 | 0.0008 |
| 3 system | 0.0470 | 0.2038 | 0.0713 | 0.1467 | 0.0004 |
| 4 system | 0.0738 | 0.2715 | 0.1093 | 0.1418 | 0.0011 |
| 5 system | 0.0591 | 0.2559 | 0.0896 | 0.1872 | 0.0010 |
Snippets
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | 0.0326 | 0.0836 | 0.0418 | 0.0468 | 0.0002 |
| UR-IW-5 | 0.0788 | 0.1773 | 0.0955 | 0.1419 | 0.0009 |
| UR-IW-4 | 0.0638 | 0.1814 | 0.0841 | 0.1508 | 0.0005 |
| UR-IW-3 | 0.0681 | 0.1906 | 0.0870 | 0.1387 | 0.0006 |
| UR-IW-2 | 0.0774 | 0.2055 | 0.0992 | 0.1750 | 0.0012 |
| UR-IW-1 | 0.0710 | 0.1887 | 0.0898 | 0.1487 | 0.0006 |
| SATO | 0.0242 | 0.1019 | 0.0300 | 0.0116 | 0.0001 |
| IR2 | 0.0595 | 0.1357 | 0.0692 | 0.0887 | 0.0006 |
| IR3 | 0.0578 | 0.1326 | 0.0669 | 0.0876 | 0.0005 |
| Fleming-1 | 0.0364 | 0.0966 | 0.0442 | 0.0504 | 0.0003 |
| IR1 | 0.0515 | 0.1413 | 0.0640 | 0.0817 | 0.0004 |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| IR5 | 0.0526 | 0.1463 | 0.0650 | 0.0970 | 0.0006 |
| IR4 | 0.0528 | 0.1289 | 0.0636 | 0.0848 | 0.0004 |
| Fleming-2 | 0.0336 | 0.1190 | 0.0472 | 0.0914 | 0.0004 |
| multi-stage rank&llm | 0.0814 | 0.2441 | 0.1062 | 0.1344 | 0.0020 |
| AJDEM | - | - | - | - | - |
| FinalQwen | 0.0054 | 0.0087 | 0.0066 | 0.0025 | 0.0000 |
| health-nlp-1 | 0.0278 | 0.0403 | 0.0289 | 0.0299 | 0.0001 |
| health-nlp-2 | 0.0278 | 0.0403 | 0.0289 | 0.0299 | 0.0001 |
| "RMC_1" | 0.0302 | 0.0196 | 0.0125 | 0.0190 | 0.0000 |
| RMC_2 | 0.0380 | 0.0572 | 0.0352 | 0.0528 | 0.0001 |
| RMC_3 | 0.0244 | 0.0266 | 0.0147 | 0.0250 | 0.0001 |
| RMC_4 | 0.0025 | 0.0028 | 0.0017 | 0.0031 | 0.0000 |
| RMC_5 | 0.0032 | 0.0092 | 0.0029 | 0.0056 | 0.0000 |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-3 | 0.0415 | 0.1013 | 0.0487 | 0.0527 | 0.0004 |
| Fleming-5 | 0.0469 | 0.1234 | 0.0542 | 0.0619 | 0.0005 |
| BM25 baseline retrie | 0.0014 | 0.0017 | 0.0014 | 0.0039 | 0.0000 |
| BM25 + MeSH (14b-A) | 0.0014 | 0.0017 | 0.0014 | 0.0039 | 0.0000 |
| BM25 + PRF(14b-A) | 0.0014 | 0.0017 | 0.0015 | 0.0039 | 0.0000 |
| BM25 + cross-encoder | 0.0053 | 0.0062 | 0.0056 | 0.0132 | 0.0000 |
| lean_rag | 0.0581 | 0.1424 | 0.0693 | 0.0436 | 0.0003 |
| lean_rag_ft | 0.0627 | 0.1442 | 0.0726 | 0.0432 | 0.0003 |
| lean_rag_dprf | 0.0594 | 0.1414 | 0.0699 | 0.0431 | 0.0003 |
| lean_rag_ft_sparse | 0.0612 | 0.1444 | 0.0717 | 0.0415 | 0.0003 |
| lean_rag_ensemble | 0.0525 | 0.1571 | 0.0678 | 0.0422 | 0.0003 |
| BM25 + LTR | 0.0012 | 0.0017 | 0.0013 | 0.0052 | 0.0000 |
| Organization name | 0.0287 | 0.0674 | 0.0370 | 0.0792 | 0.0001 |
| multi-stage rank&ll | 0.0794 | 0.2300 | 0.1037 | 0.1205 | 0.0015 |
| dmiip2024 | 0.0663 | 0.1835 | 0.0849 | 0.1264 | 0.0008 |
| dmiip2024_1 | 0.0617 | 0.1780 | 0.0807 | 0.1191 | 0.0006 |
| dmiip2024_2 | 0.0668 | 0.1986 | 0.0878 | 0.1387 | 0.0007 |
| dmiip2024_3 | 0.0639 | 0.1771 | 0.0813 | 0.1133 | 0.0004 |
| dmiip2024_4 | 0.0709 | 0.2051 | 0.0915 | 0.1255 | 0.0006 |
| bioinfo-0 | 0.0375 | 0.1335 | 0.0525 | 0.0591 | 0.0004 |
| bioinfo-1 | 0.0375 | 0.0978 | 0.0459 | 0.0296 | 0.0002 |
| bioinfo-2 | 0.0533 | 0.1192 | 0.0638 | 0.0495 | 0.0005 |
| bioinfo-3 | 0.0353 | 0.1095 | 0.0452 | 0.0431 | 0.0004 |
| bioinfo-4 | 0.0413 | 0.1235 | 0.0511 | 0.0490 | 0.0006 |
| DS@GT-BioASQ | 0.0227 | 0.0274 | 0.0209 | 0.0356 | 0.0000 |
| llama for 14b b | 0.0119 | 0.0274 | 0.0154 | 0.0198 | 0.0000 |
| DSGTBioasq | 0.0227 | 0.0274 | 0.0209 | 0.0356 | 0.0000 |
| IR_J-1 | 0.0338 | 0.0440 | 0.0347 | 0.0393 | 0.0000 |
| IR_J-2 | 0.0567 | 0.0472 | 0.0434 | 0.0389 | 0.0001 |
| IR_Y-1 | 0.0146 | 0.0603 | 0.0175 | 0.0146 | 0.0000 |
| IR_Y-2 | 0.0131 | 0.0670 | 0.0154 | 0.0119 | 0.0000 |
| pancras_naive | 0.0641 | 0.1744 | 0.0778 | 0.1279 | 0.0008 |
| pancras_crag | 0.0926 | 0.1417 | 0.0869 | 0.0861 | 0.0006 |
| BioXR-GTE | 0.0004 | 0.0015 | 0.0006 | 0.0004 | 0.0000 |
| MedQA-1 | 0.0421 | 0.0730 | 0.0386 | 0.0520 | 0.0002 |
| MedQA-2 | 0.0295 | 0.0574 | 0.0269 | 0.0470 | 0.0001 |
| MedQA-4 | 0.0532 | 0.0941 | 0.0530 | 0.0628 | 0.0002 |
| MedQA-5 | 0.0507 | 0.1267 | 0.0571 | 0.0836 | 0.0004 |
| 1 system | 0.0556 | 0.1660 | 0.0752 | 0.0546 | 0.0006 |
| 2 system | 0.0467 | 0.1923 | 0.0687 | 0.1028 | 0.0007 |
| 3 system | 0.0384 | 0.1741 | 0.0588 | 0.0955 | 0.0004 |
| 4 system | 0.0480 | 0.2083 | 0.0734 | 0.0572 | 0.0006 |
| 5 system | 0.0419 | 0.2237 | 0.0639 | 0.1007 | 0.0008 |
Concepts
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| SATO | - | - | - | - | - |
| IR2 | - | - | - | - | - |
| IR3 | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| IR5 | - | - | - | - | - |
| IR4 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| multi-stage rank&llm | - | - | - | - | - |
| AJDEM | - | - | - | - | - |
| FinalQwen | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| BM25 baseline retrie | - | - | - | - | - |
| BM25 + MeSH (14b-A) | - | - | - | - | - |
| BM25 + PRF(14b-A) | - | - | - | - | - |
| BM25 + cross-encoder | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ensemble | - | - | - | - | - |
| BM25 + LTR | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| multi-stage rank&ll | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| llama for 14b b | - | - | - | - | - |
| DSGTBioasq | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| BioXR-GTE | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| 1 system | - | - | - | - | - |
| 2 system | - | - | - | - | - |
| 3 system | - | - | - | - | - |
| 4 system | - | - | - | - | - |
| 5 system | - | - | - | - | - |
RDF Triples
| System | Mean precision | Recall | F-Measure | MAP | GMAP |
|---|---|---|---|---|---|
| aida_2025_2 | - | - | - | - | - |
| UR-IW-5 | - | - | - | - | - |
| UR-IW-4 | - | - | - | - | - |
| UR-IW-3 | - | - | - | - | - |
| UR-IW-2 | - | - | - | - | - |
| UR-IW-1 | - | - | - | - | - |
| SATO | - | - | - | - | - |
| IR2 | - | - | - | - | - |
| IR3 | - | - | - | - | - |
| Fleming-1 | - | - | - | - | - |
| IR1 | - | - | - | - | - |
| Splade-v3 | - | - | - | - | - |
| Debertav3 | - | - | - | - | - |
| Fully fine-tuned | - | - | - | - | - |
| Recently fine-tuned | - | - | - | - | - |
| IR5 | - | - | - | - | - |
| IR4 | - | - | - | - | - |
| Fleming-2 | - | - | - | - | - |
| multi-stage rank&llm | - | - | - | - | - |
| AJDEM | - | - | - | - | - |
| FinalQwen | - | - | - | - | - |
| health-nlp-1 | - | - | - | - | - |
| health-nlp-2 | - | - | - | - | - |
| "RMC_1" | - | - | - | - | - |
| RMC_2 | - | - | - | - | - |
| RMC_3 | - | - | - | - | - |
| RMC_4 | - | - | - | - | - |
| RMC_5 | - | - | - | - | - |
| dictycite-baseline | - | - | - | - | - |
| dictycite-snippet | - | - | - | - | - |
| dictycite-max | - | - | - | - | - |
| dictycite-max-rew-si | - | - | - | - | - |
| dictycite-max-rew-sl | - | - | - | - | - |
| Fleming-3 | - | - | - | - | - |
| Fleming-5 | - | - | - | - | - |
| BM25 baseline retrie | - | - | - | - | - |
| BM25 + MeSH (14b-A) | - | - | - | - | - |
| BM25 + PRF(14b-A) | - | - | - | - | - |
| BM25 + cross-encoder | - | - | - | - | - |
| lean_rag | - | - | - | - | - |
| lean_rag_ft | - | - | - | - | - |
| lean_rag_dprf | - | - | - | - | - |
| lean_rag_ft_sparse | - | - | - | - | - |
| lean_rag_ensemble | - | - | - | - | - |
| BM25 + LTR | - | - | - | - | - |
| Organization name | - | - | - | - | - |
| multi-stage rank&ll | - | - | - | - | - |
| dmiip2024 | - | - | - | - | - |
| dmiip2024_1 | - | - | - | - | - |
| dmiip2024_2 | - | - | - | - | - |
| dmiip2024_3 | - | - | - | - | - |
| dmiip2024_4 | - | - | - | - | - |
| bioinfo-0 | - | - | - | - | - |
| bioinfo-1 | - | - | - | - | - |
| bioinfo-2 | - | - | - | - | - |
| bioinfo-3 | - | - | - | - | - |
| bioinfo-4 | - | - | - | - | - |
| DS@GT-BioASQ | - | - | - | - | - |
| llama for 14b b | - | - | - | - | - |
| DSGTBioasq | - | - | - | - | - |
| IR_J-1 | - | - | - | - | - |
| IR_J-2 | - | - | - | - | - |
| IR_Y-1 | - | - | - | - | - |
| IR_Y-2 | - | - | - | - | - |
| pancras_naive | - | - | - | - | - |
| pancras_crag | - | - | - | - | - |
| BioXR-GTE | - | - | - | - | - |
| MedQA-1 | - | - | - | - | - |
| MedQA-2 | - | - | - | - | - |
| MedQA-4 | - | - | - | - | - |
| MedQA-5 | - | - | - | - | - |
| 1 system | - | - | - | - | - |
| 2 system | - | - | - | - | - |
| 3 system | - | - | - | - | - |
| 4 system | - | - | - | - | - |
| 5 system | - | - | - | - | - |