BioASQ Participants Area

Test Results for Task 7a

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
BioASQ_Baseline	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
BioASQ_Baseline	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000

The evaluation measures indicating the performance of the systems that submitted results are presented below. The evaluation is incremental; as new MeSH become available the tables are updated.

+ Dry Run 2

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
NLM System 4	0.6561	0.6900	0.6371	0.6449	0.6237	0.5146	0.5090	0.6838	0.6306	0.4920

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
NLM System 4	0.5252	0.8082	0.7248	0.7475	0.5668	0.5121

+ Test batch 1, week 1

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6268	0.6730	0.6050	0.6170	0.6284	0.5552	0.5320	0.6610	0.5960	0.4640
Default MTI	0.6397	0.6419	0.6586	0.6322	0.5937	0.5953	0.5524	0.6328	0.6468	0.4797
DeepMeSH1	0.6628	0.7286	0.6226	0.6564	0.6886	0.5137	0.5139	0.7319	0.6056	0.5053
DeepMeSH2	0.6382	0.7160	0.5883	0.6305	0.6705	0.4526	0.4599	0.7213	0.5724	0.4767
DeepMeSH3	0.6607	0.7260	0.6209	0.6544	0.6870	0.5108	0.5116	0.7293	0.6039	0.5034
MeSHProbeNet-P	0.6849	0.7141	0.6714	0.6753	0.6728	0.5670	0.5556	0.7090	0.6624	0.5264
NLM System 4	0.6515	0.6840	0.6343	0.6404	0.6125	0.5045	0.4967	0.6768	0.6280	0.4873
MeSHProbeNet-P0	0.6848	0.7024	0.6817	0.6753	0.6604	0.5781	0.5609	0.6970	0.6730	0.5262
MeSHProbeNet-P1	0.6839	0.6903	0.6917	0.6746	0.6486	0.5893	0.5657	0.6846	0.6832	0.5252
MeSHProbeNet-P2	0.6849	0.7140	0.6714	0.6753	0.6728	0.5670	0.5556	0.7089	0.6624	0.5264
MeSHProbeNet-P3	0.6843	0.7128	0.6711	0.6746	0.6700	0.5651	0.5529	0.7077	0.6624	0.5256

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5035	0.7889	0.7105	0.7277	0.5508	0.4909
Default MTI	0.5207	0.7601	0.7567	0.7408	0.5358	0.5333
DeepMeSH1	0.5298	0.8304	0.7120	0.7507	0.5905	0.5015
DeepMeSH2	0.5068	0.8239	0.6815	0.7291	0.5772	0.4722
DeepMeSH3	0.5288	0.8293	0.7099	0.7491	0.5895	0.5006
MeSHProbeNet-P	0.5510	0.8186	0.7572	0.7704	0.5874	0.5429
NLM System 4	0.5228	0.8013	0.7231	0.7420	0.5624	0.5130
MeSHProbeNet-P0	0.5523	0.8099	0.7667	0.7715	0.5812	0.5508
MeSHProbeNet-P1	0.5535	0.8011	0.7761	0.7725	0.5746	0.5587
MeSHProbeNet-P2	0.5509	0.8186	0.7572	0.7703	0.5874	0.5429
MeSHProbeNet-P3	0.5509	0.8178	0.7576	0.7701	0.5870	0.5432

+ Test batch 1, week 2

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6272	0.6688	0.6083	0.6160	0.6383	0.5640	0.5421	0.6613	0.5964	0.4644
Default MTI	0.6405	0.6391	0.6621	0.6313	0.6068	0.6072	0.5650	0.6343	0.6469	0.4792
DeepMeSH1	0.6330	0.7105	0.5857	0.6246	0.6636	0.4596	0.4664	0.7177	0.5662	0.4714
DeepMeSH2	0.6382	0.7252	0.5866	0.6313	0.6801	0.4886	0.4915	0.7324	0.5655	0.4786
DeepMeSH3	0.6134	0.7367	0.5462	0.6084	0.6781	0.4732	0.4782	0.7428	0.5223	0.4547
MetaEmb	0.0001	0.0001	0.0001	0.0001	0.0001	0.0004	0.0000	0.0001	0.0001	0.0001
MeSHProbeNet-P	0.6853	0.7109	0.6751	0.6748	0.6828	0.5806	0.5699	0.7090	0.6632	0.5266
NLM System 4	0.6499	0.6898	0.6254	0.6373	0.6281	0.5000	0.4978	0.6855	0.6177	0.4848
MeSHProbeNet-P0	0.6868	0.7108	0.6768	0.6758	0.6855	0.5754	0.5668	0.7090	0.6659	0.5273
MeSHProbeNet-P1	0.6819	0.7027	0.6731	0.6703	0.6801	0.5588	0.5533	0.7005	0.6642	0.5207
MeSHProbeNet-P2	0.6815	0.6837	0.6861	0.6705	0.6557	0.5903	0.5737	0.6891	0.6741	0.5205
MeSHProbeNet-P3	0.6799	0.6888	0.6772	0.6687	0.6701	0.5677	0.5588	0.6939	0.6665	0.5185
baseline	0.0001	0.0001	0.0001	0.0001	0.0001	0.0004	0.0000	0.0001	0.0001	0.0001

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5015	0.7858	0.7097	0.7252	0.5460	0.4913
Default MTI	0.5169	0.7579	0.7567	0.7387	0.5315	0.5311
DeepMeSH1	0.5008	0.8195	0.6812	0.7262	0.5695	0.4687
DeepMeSH2	0.5079	0.8295	0.6937	0.7386	0.5747	0.4763
DeepMeSH3	0.4868	0.8358	0.6636	0.7217	0.5708	0.4457
MetaEmb	0.1224	0.1192	0.1926	0.1429	0.1059	0.1529
MeSHProbeNet-P	0.5501	0.8177	0.7583	0.7701	0.5849	0.5438
NLM System 4	0.5193	0.8089	0.7146	0.7403	0.5648	0.5045
MeSHProbeNet-P0	0.5509	0.8194	0.7596	0.7717	0.5848	0.5449
MeSHProbeNet-P1	0.5474	0.8167	0.7577	0.7694	0.5811	0.5416
MeSHProbeNet-P2	0.5481	0.8005	0.7701	0.7703	0.5703	0.5502
MeSHProbeNet-P3	0.5477	0.8066	0.7637	0.7698	0.5741	0.5455
baseline	0.1211	0.1223	0.1828	0.1421	0.1052	0.1506

+ Test batch 1, week 3

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6191	0.6682	0.5952	0.6083	0.6416	0.5624	0.5423	0.6576	0.5849	0.4556
Default MTI	0.6329	0.6352	0.6521	0.6245	0.6072	0.6058	0.5634	0.6279	0.6379	0.4716
DeepMeSH1	0.6649	0.7277	0.6300	0.6591	0.7049	0.5469	0.5527	0.7309	0.6098	0.5084
DeepMeSH2	0.6647	0.7250	0.6316	0.6587	0.7032	0.5470	0.5533	0.7280	0.6115	0.5079
DeepMeSH3	0.6494	0.7181	0.6093	0.6430	0.6937	0.4991	0.5075	0.7224	0.5898	0.4899
DeepMeSH4	0.6450	0.7170	0.6021	0.6382	0.6912	0.4910	0.5006	0.7215	0.5832	0.4849
DeepMeSH5	0.6453	0.7133	0.6044	0.6381	0.6884	0.4890	0.4981	0.7182	0.5858	0.4848
MeSHProbeNet-P	0.6738	0.7033	0.6634	0.6639	0.6780	0.5674	0.5590	0.6977	0.6515	0.5134
NLM System 4	0.6384	0.6839	0.6145	0.6277	0.6254	0.4911	0.4912	0.6762	0.6045	0.4737
MeSHProbeNet-P0	0.6747	0.6983	0.6694	0.6648	0.6735	0.5673	0.5581	0.6926	0.6577	0.5142
MeSHProbeNet-P1	0.6737	0.6996	0.6661	0.6636	0.6760	0.5589	0.5527	0.6938	0.6547	0.5129
MeSHProbeNet-P2	0.6709	0.6799	0.6727	0.6610	0.6631	0.5699	0.5593	0.6817	0.6605	0.5092
MeSHProbeNet-P3	0.6693	0.6747	0.6750	0.6595	0.6489	0.5849	0.5663	0.6764	0.6622	0.5076
UNCC_IR_01	0.5101	0.5572	0.4855	0.4939	0.5511	0.3250	0.3388	0.5468	0.4781	0.3434

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4924	0.7864	0.7044	0.7229	0.5407	0.4793
Default MTI	0.5077	0.7564	0.7529	0.7366	0.5237	0.5208
DeepMeSH1	0.5252	0.8292	0.7199	0.7542	0.5831	0.5000
DeepMeSH2	0.5253	0.8272	0.7216	0.7541	0.5820	0.5011
DeepMeSH3	0.5122	0.8252	0.7035	0.7427	0.5759	0.4831
DeepMeSH4	0.5083	0.8236	0.6975	0.7384	0.5739	0.4778
DeepMeSH5	0.5084	0.8211	0.6994	0.7384	0.5718	0.4793
MeSHProbeNet-P	0.5361	0.8111	0.7529	0.7630	0.5725	0.5299
NLM System 4	0.5062	0.8038	0.7081	0.7335	0.5543	0.4909
MeSHProbeNet-P0	0.5379	0.8083	0.7580	0.7646	0.5713	0.5342
MeSHProbeNet-P1	0.5375	0.8101	0.7555	0.7641	0.5729	0.5319
MeSHProbeNet-P2	0.5375	0.7965	0.7647	0.7649	0.5632	0.5375
MeSHProbeNet-P3	0.5343	0.7908	0.7663	0.7629	0.5573	0.5373
UNCC_IR_01	0.4107	0.7163	0.5929	0.6212	0.4736	0.3923

+ Test batch 1, week 4

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6202	0.6693	0.6017	0.6137	0.6277	0.5596	0.5364	0.6590	0.5856	0.4623
Default MTI	0.6387	0.6420	0.6622	0.6341	0.5965	0.6000	0.5598	0.6357	0.6419	0.4817
DeepMeSH1	0.6702	0.7368	0.6357	0.6670	0.6986	0.5427	0.5460	0.7403	0.6122	0.5164
DeepMeSH2	0.6687	0.7350	0.6346	0.6654	0.6968	0.5400	0.5429	0.7382	0.6110	0.5147
DeepMeSH3	0.6518	0.7250	0.6088	0.6463	0.6873	0.4903	0.4969	0.7300	0.5887	0.4936
DeepMeSH4	0.6522	0.7246	0.6096	0.6467	0.6863	0.4931	0.4997	0.7292	0.5899	0.4938
MeSHProbeNet-P	0.6816	0.7164	0.6689	0.6747	0.6800	0.5662	0.5583	0.7127	0.6532	0.5253
NLM System 4	0.6476	0.6930	0.6238	0.6380	0.6246	0.4936	0.4914	0.6862	0.6130	0.4843
MeSHProbeNet-P0	0.6831	0.7074	0.6790	0.6761	0.6715	0.5724	0.5614	0.7035	0.6639	0.5265
MeSHProbeNet-P1	0.6829	0.7100	0.6750	0.6754	0.6754	0.5629	0.5551	0.7064	0.6608	0.5257
MeSHProbeNet-P2	0.6819	0.7045	0.6796	0.6751	0.6689	0.5783	0.5652	0.7008	0.6640	0.5255
MeSHProbeNet-P3	0.6693	0.7128	0.6494	0.6620	0.6773	0.5347	0.5288	0.7097	0.6333	0.5113
UNCC_IR_01	0.5249	0.5744	0.5008	0.5120	0.5433	0.3289	0.3377	0.5640	0.4909	0.3595
MeSHedPotato	0.2839	0.7562	0.1770	0.2591	0.6752	0.0523	0.0679	0.7873	0.1732	0.1668
txt_sys0	0.4508	0.4401	0.4851	0.4420	0.2706	0.3207	0.2847	0.4280	0.4760	0.2964
txt_sys1	0.4672	0.5123	0.4444	0.4550	0.3536	0.2818	0.2759	0.5027	0.4363	0.3085

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5038	0.7870	0.7097	0.7273	0.5489	0.4911
Default MTI	0.5212	0.7613	0.7582	0.7424	0.5353	0.5343
DeepMeSH1	0.5370	0.8359	0.7214	0.7584	0.5968	0.5093
DeepMeSH2	0.5356	0.8349	0.7208	0.7576	0.5957	0.5078
DeepMeSH3	0.5207	0.8298	0.6996	0.7426	0.5882	0.4880
DeepMeSH4	0.5209	0.8310	0.6993	0.7431	0.5879	0.4882
MeSHProbeNet-P	0.5514	0.8209	0.7536	0.7694	0.5902	0.5408
NLM System 4	0.5192	0.8082	0.7127	0.7394	0.5654	0.5029
MeSHProbeNet-P0	0.5541	0.8139	0.7619	0.7708	0.5862	0.5488
MeSHProbeNet-P1	0.5532	0.8167	0.7579	0.7699	0.5881	0.5450
MeSHProbeNet-P2	0.5526	0.8117	0.7633	0.7706	0.5836	0.5485
MeSHProbeNet-P3	0.5420	0.8216	0.7366	0.7594	0.5891	0.5255
UNCC_IR_01	0.4281	0.7295	0.6014	0.6340	0.4919	0.4063
MeSHedPotato	0.1959	0.8160	0.2045	0.2963	0.4259	0.1386
txt_sys0	0.3866	0.5834	0.6241	0.5799	0.3904	0.4142
txt_sys1	0.3883	0.6539	0.5656	0.5816	0.4379	0.3757

+ Test batch 1, week 5

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6288	0.6719	0.6132	0.6207	0.6319	0.5629	0.5393	0.6612	0.5995	0.4692
Default MTI	0.6424	0.6431	0.6662	0.6358	0.6003	0.6035	0.5621	0.6361	0.6489	0.4842
DeepMeSH1	0.6857	0.7491	0.6502	0.6805	0.7249	0.5518	0.5579	0.7537	0.6289	0.5329
DeepMeSH2	0.6771	0.7408	0.6409	0.6718	0.7138	0.5290	0.5353	0.7455	0.6202	0.5227
DeepMeSH3	0.6729	0.7431	0.6312	0.6671	0.7206	0.5140	0.5239	0.7488	0.6110	0.5176
DeepMeSH4	0.6728	0.7463	0.6288	0.6669	0.7207	0.5098	0.5202	0.7516	0.6090	0.5175
DeepMeSH5	0.6993	0.7628	0.6638	0.6954	0.7419	0.5677	0.5754	0.7674	0.6423	0.5546
MeSHProbeNet-P	0.6854	0.7146	0.6750	0.6763	0.6787	0.5709	0.5616	0.7109	0.6617	0.5281
NLM System 4	0.6522	0.6926	0.6315	0.6420	0.6260	0.4985	0.4957	0.6860	0.6216	0.4892
MeSHProbeNet-P0	0.6854	0.7025	0.6854	0.6763	0.6670	0.5830	0.5685	0.6991	0.6723	0.5278
MeSHProbeNet-P1	0.6847	0.6905	0.6958	0.6759	0.6542	0.5941	0.5735	0.6869	0.6825	0.5268
MeSHProbeNet-P2	0.6862	0.6997	0.6894	0.6771	0.6667	0.5813	0.5670	0.6960	0.6767	0.5284
MeSHProbeNet-P3	0.6736	0.6999	0.6659	0.6644	0.6649	0.5476	0.5370	0.6963	0.6523	0.5143
UNCC_IR_01	0.5203	0.5323	0.5243	0.5051	0.5083	0.3476	0.3492	0.5244	0.5163	0.3532
MeSHedPotato1	0.3344	0.7613	0.2253	0.3040	0.6267	0.1267	0.1517	0.7445	0.2156	0.2021

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5075	0.7883	0.7163	0.7312	0.5509	0.4976
Default MTI	0.5210	0.7621	0.7621	0.7446	0.5349	0.5359
DeepMeSH1	0.5472	0.8430	0.7344	0.7697	0.6043	0.5218
DeepMeSH2	0.5401	0.8369	0.7279	0.7633	0.5968	0.5148
DeepMeSH3	0.5359	0.8398	0.7186	0.7589	0.5973	0.5073
DeepMeSH4	0.5353	0.8424	0.7165	0.7588	0.5991	0.5051
DeepMeSH5	0.5682	0.8521	0.7448	0.7805	0.6243	0.5424
MeSHProbeNet-P	0.5508	0.8216	0.7593	0.7726	0.5875	0.5441
NLM System 4	0.5199	0.8097	0.7210	0.7449	0.5633	0.5077
MeSHProbeNet-P0	0.5520	0.8122	0.7690	0.7737	0.5807	0.5519
MeSHProbeNet-P1	0.5523	0.8027	0.7784	0.7742	0.5734	0.5587
MeSHProbeNet-P2	0.5527	0.8103	0.7724	0.7746	0.5794	0.5544
MeSHProbeNet-P3	0.5435	0.8142	0.7539	0.7659	0.5791	0.5374
UNCC_IR_01	0.4244	0.6958	0.6323	0.6371	0.4632	0.4224
MeSHedPotato1	0.2323	0.8265	0.2771	0.3638	0.4243	0.1802

+ Test batch 2, week 1

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6265	0.6690	0.6039	0.6161	0.6296	0.5627	0.5394	0.6598	0.5965	0.4635
Default MTI	0.6403	0.6394	0.6590	0.6322	0.5985	0.6051	0.5614	0.6332	0.6476	0.4793
iria-mix	0.5202	0.4616	0.5971	0.5091	0.4434	0.4807	0.4318	0.4658	0.5890	0.3545
DeepMeSH1	0.6917	0.7214	0.6745	0.6841	0.6845	0.5961	0.5863	0.7232	0.6629	0.5364
DeepMeSH2	0.6900	0.7215	0.6711	0.6824	0.6838	0.5907	0.5828	0.7237	0.6593	0.5346
DeepMeSH3	0.6895	0.7214	0.6701	0.6820	0.6834	0.5888	0.5810	0.7239	0.6582	0.5341
DeepMeSH4	0.6786	0.7078	0.6585	0.6690	0.6681	0.5637	0.5561	0.7111	0.6490	0.5188
DeepMeSH5	0.7128	0.7391	0.6959	0.7047	0.7070	0.6228	0.6141	0.7424	0.6855	0.5668
MeSHProbeNet-P	0.6848	0.6897	0.6899	0.6742	0.6563	0.6020	0.5780	0.6865	0.6832	0.5243
NLM System 4	0.6509	0.6901	0.6254	0.6386	0.6198	0.5029	0.4978	0.6840	0.6210	0.4855
MeSHProbeNet-P0	0.6855	0.7017	0.6796	0.6746	0.6679	0.5902	0.5719	0.6986	0.6729	0.5251
MeSHProbeNet-P1	0.6871	0.7104	0.6746	0.6759	0.6776	0.5791	0.5657	0.7072	0.6681	0.5267
MeSHProbeNet-P2	0.6824	0.7002	0.6747	0.6711	0.6655	0.5827	0.5657	0.6974	0.6680	0.5211
MeSHProbeNet-P3	0.6730	0.6977	0.6598	0.6614	0.6616	0.5549	0.5404	0.6943	0.6530	0.5106

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5021	0.7851	0.7076	0.7257	0.5460	0.4899
Default MTI	0.5190	0.7578	0.7567	0.7407	0.5322	0.5322
iria-mix	0.4406	0.6151	0.7302	0.6538	0.4182	0.4882
DeepMeSH1	0.5533	0.8192	0.7579	0.7738	0.5900	0.5412
DeepMeSH2	0.5525	0.8199	0.7552	0.7727	0.5912	0.5387
DeepMeSH3	0.5522	0.8203	0.7537	0.7721	0.5912	0.5380
DeepMeSH4	0.5424	0.8115	0.7458	0.7632	0.5805	0.5296
DeepMeSH5	0.5825	0.8303	0.7748	0.7890	0.6161	0.5714
MeSHProbeNet-P	0.5511	0.8003	0.7742	0.7717	0.5730	0.5548
NLM System 4	0.5169	0.8045	0.7127	0.7377	0.5626	0.5017
MeSHProbeNet-P0	0.5496	0.8091	0.7642	0.7704	0.5791	0.5464
MeSHProbeNet-P1	0.5498	0.8162	0.7589	0.7708	0.5837	0.5428
MeSHProbeNet-P2	0.5464	0.8092	0.7602	0.7681	0.5776	0.5421
MeSHProbeNet-P3	0.5393	0.8094	0.7481	0.7613	0.5754	0.5316

+ Test batch 2, week 2

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6355	0.6747	0.6213	0.6269	0.6375	0.5707	0.5450	0.6638	0.6094	0.4742
Default MTI	0.6456	0.6441	0.6690	0.6390	0.6064	0.6117	0.5669	0.6375	0.6539	0.4856
iria-mix	0.5365	0.4751	0.6227	0.5269	0.4713	0.5036	0.4524	0.4788	0.6099	0.3701
DeepMeSH1	0.6963	0.7228	0.6859	0.6904	0.6898	0.6025	0.5921	0.7241	0.6706	0.5427
DeepMeSH2	0.6961	0.7237	0.6839	0.6897	0.6906	0.5993	0.5901	0.7257	0.6688	0.5421
DeepMeSH3	0.6957	0.7242	0.6834	0.6897	0.6892	0.5982	0.5885	0.7260	0.6678	0.5420
DeepMeSH4	0.6850	0.7126	0.6711	0.6777	0.6755	0.5717	0.5635	0.7149	0.6575	0.5280
DeepMeSH5	0.7288	0.7534	0.7180	0.7232	0.7309	0.6444	0.6356	0.7560	0.7036	0.5917
MeSHProbeNet-P	0.6916	0.7061	0.6931	0.6829	0.6703	0.5949	0.5759	0.7017	0.6818	0.5337
NLM System 4	0.6581	0.6909	0.6405	0.6473	0.6192	0.5133	0.5072	0.6847	0.6335	0.4944
MeSHProbeNet-P0	0.6922	0.7184	0.6829	0.6834	0.6826	0.5833	0.5706	0.7140	0.6716	0.5346
MeSHProbeNet-P1	0.6928	0.7249	0.6778	0.6838	0.6906	0.5729	0.5647	0.7206	0.6671	0.5352
MeSHProbeNet-P2	0.6933	0.7228	0.6801	0.6840	0.6907	0.5705	0.5629	0.7183	0.6700	0.5354
MeSHProbeNet-P3	0.6794	0.7036	0.6720	0.6701	0.6669	0.5583	0.5433	0.6986	0.6613	0.5193

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5078	0.7878	0.7230	0.7348	0.5472	0.5009
Default MTI	0.5215	0.7606	0.7653	0.7461	0.5322	0.5379
iria-mix	0.4520	0.6289	0.7495	0.6701	0.4271	0.5038
DeepMeSH1	0.5593	0.8191	0.7681	0.7791	0.5907	0.5523
DeepMeSH2	0.5581	0.8197	0.7666	0.7785	0.5908	0.5498
DeepMeSH3	0.5576	0.8201	0.7659	0.7783	0.5904	0.5493
DeepMeSH4	0.5474	0.8133	0.7573	0.7704	0.5806	0.5389
DeepMeSH5	0.6071	0.8388	0.7920	0.8024	0.6361	0.6001
MeSHProbeNet-P	0.5555	0.8094	0.7760	0.7765	0.5796	0.5581
NLM System 4	0.5245	0.8032	0.7268	0.7458	0.5632	0.5148
MeSHProbeNet-P0	0.5546	0.8190	0.7662	0.7756	0.5868	0.5503
MeSHProbeNet-P1	0.5552	0.8247	0.7609	0.7753	0.5911	0.5473
MeSHProbeNet-P2	0.5556	0.8233	0.7623	0.7754	0.5904	0.5488
MeSHProbeNet-P3	0.5452	0.8093	0.7592	0.7667	0.5768	0.5422

+ Test batch 2, week 3

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6244	0.6874	0.5905	0.6134	0.6358	0.5381	0.5236	0.6754	0.5805	0.4627
Default MTI	0.6378	0.6453	0.6491	0.6284	0.5969	0.5898	0.5526	0.6400	0.6357	0.4761
iria-mix	0.5324	0.4680	0.6214	0.5214	0.4553	0.4913	0.4419	0.4732	0.6087	0.3656
DeepMeSH1	0.6909	0.7188	0.6755	0.6828	0.6812	0.5895	0.5821	0.7230	0.6614	0.5354
DeepMeSH2	0.6895	0.7180	0.6736	0.6814	0.6806	0.5872	0.5801	0.7227	0.6593	0.5337
DeepMeSH3	0.6898	0.7194	0.6730	0.6817	0.6804	0.5862	0.5797	0.7240	0.6587	0.5343
DeepMeSH4	0.6791	0.7058	0.6636	0.6704	0.6619	0.5634	0.5551	0.7107	0.6503	0.5208
DeepMeSH5	0.7186	0.7461	0.7036	0.7120	0.7212	0.6264	0.6214	0.7504	0.6894	0.5781
MeSHProbeNet-P	0.6865	0.7180	0.6684	0.6761	0.6785	0.5723	0.5630	0.7170	0.6585	0.5282
NLM System 4	0.6541	0.6871	0.6341	0.6422	0.6142	0.5105	0.5048	0.6819	0.6286	0.4895
MeSHProbeNet-P0	0.6871	0.7069	0.6795	0.6769	0.6668	0.5848	0.5696	0.7056	0.6696	0.5287
MeSHProbeNet-P1	0.6869	0.6952	0.6901	0.6769	0.6546	0.5969	0.5756	0.6937	0.6803	0.5284
MeSHProbeNet-P2	0.6880	0.7137	0.6746	0.6776	0.6746	0.5744	0.5639	0.7121	0.6655	0.5294
MeSHProbeNet-P3	0.6880	0.7108	0.6765	0.6771	0.6741	0.5703	0.5609	0.7090	0.6683	0.5286

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5019	0.8047	0.6925	0.7232	0.5603	0.4809
Default MTI	0.5175	0.7681	0.7473	0.7394	0.5380	0.5252
iria-mix	0.4535	0.6292	0.7496	0.6701	0.4290	0.5048
DeepMeSH1	0.5537	0.8223	0.7605	0.7761	0.5896	0.5422
DeepMeSH2	0.5527	0.8216	0.7590	0.7750	0.5893	0.5406
DeepMeSH3	0.5522	0.8224	0.7576	0.7746	0.5889	0.5400
DeepMeSH4	0.5451	0.8137	0.7528	0.7680	0.5811	0.5333
DeepMeSH5	0.5955	0.8406	0.7813	0.7971	0.6291	0.5838
MeSHProbeNet-P	0.5520	0.8250	0.7551	0.7725	0.5910	0.5403
NLM System 4	0.5235	0.8075	0.7224	0.7453	0.5646	0.5109
MeSHProbeNet-P0	0.5536	0.8162	0.7650	0.7739	0.5849	0.5484
MeSHProbeNet-P1	0.5549	0.8067	0.7751	0.7751	0.5783	0.5566
MeSHProbeNet-P2	0.5537	0.8222	0.7604	0.7742	0.5894	0.5446
MeSHProbeNet-P3	0.5540	0.8214	0.7616	0.7746	0.5894	0.5454

+ Test batch 2, week 4

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6383	0.6712	0.6308	0.6305	0.6282	0.5892	0.5581	0.6601	0.6179	0.4794
Default MTI	0.6485	0.6389	0.6826	0.6422	0.5951	0.6304	0.5780	0.6318	0.6660	0.4907
iria-mix	0.5358	0.4672	0.6335	0.5242	0.4583	0.5098	0.4526	0.4719	0.6197	0.3682
DeepMeSH1	0.6925	0.7101	0.6929	0.6862	0.6715	0.6137	0.5969	0.7110	0.6749	0.5391
DeepMeSH2	0.6918	0.7117	0.6902	0.6856	0.6769	0.6084	0.5941	0.7128	0.6720	0.5383
DeepMeSH3	0.6913	0.7128	0.6881	0.6850	0.6765	0.6062	0.5928	0.7137	0.6701	0.5376
DeepMeSH4	0.6783	0.7030	0.6692	0.6702	0.6644	0.5706	0.5613	0.7054	0.6531	0.5205
DeepMeSH5	0.6954	0.7122	0.6955	0.6887	0.6745	0.6176	0.6007	0.7135	0.6782	0.5429
MeSHProbeNet-P	0.6917	0.7147	0.6869	0.6835	0.6709	0.5953	0.5785	0.7097	0.6746	0.5360
NLM System 4	0.6573	0.6899	0.6418	0.6469	0.6137	0.5190	0.5099	0.6836	0.6329	0.4948
MeSHProbeNet-P0	0.6915	0.7089	0.6916	0.6832	0.6650	0.6001	0.5805	0.7040	0.6794	0.5356
MeSHProbeNet-P1	0.6913	0.7028	0.6970	0.6830	0.6596	0.6055	0.5828	0.6979	0.6848	0.5352
MeSHProbeNet-P2	0.6919	0.7203	0.6815	0.6833	0.6791	0.5836	0.5721	0.7156	0.6696	0.5359
MeSHProbeNet-P3	0.6803	0.7006	0.6780	0.6713	0.6538	0.5699	0.5515	0.6953	0.6659	0.5221

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5123	0.7835	0.7289	0.7357	0.5474	0.5087
Default MTI	0.5256	0.7541	0.7730	0.7461	0.5319	0.5470
iria-mix	0.4506	0.6195	0.7544	0.6647	0.4222	0.5098
DeepMeSH1	0.5563	0.8102	0.7724	0.7754	0.5839	0.5545
DeepMeSH2	0.5556	0.8118	0.7700	0.7747	0.5850	0.5520
DeepMeSH3	0.5545	0.8125	0.7682	0.7741	0.5854	0.5498
DeepMeSH4	0.5427	0.8080	0.7532	0.7635	0.5773	0.5352
DeepMeSH5	0.5599	0.8115	0.7745	0.7772	0.5870	0.5583
MeSHProbeNet-P	0.5568	0.8174	0.7682	0.7756	0.5881	0.5534
NLM System 4	0.5260	0.8049	0.7257	0.7451	0.5661	0.5158
MeSHProbeNet-P0	0.5568	0.8128	0.7728	0.7759	0.5846	0.5566
MeSHProbeNet-P1	0.5571	0.8080	0.7775	0.7762	0.5811	0.5600
MeSHProbeNet-P2	0.5560	0.8216	0.7632	0.7746	0.5916	0.5489
MeSHProbeNet-P3	0.5479	0.8093	0.7625	0.7678	0.5791	0.5455

+ Test batch 2, week 5

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6406	0.6869	0.6260	0.6371	0.6425	0.5693	0.5483	0.6726	0.6115	0.4908
Default MTI	0.6450	0.6409	0.6739	0.6387	0.6014	0.6081	0.5644	0.6332	0.6571	0.4875
iria-mix	0.5179	0.4579	0.6037	0.5082	0.4298	0.4757	0.4243	0.4606	0.5915	0.3540
DeepMeSH1	0.6895	0.7181	0.6807	0.6836	0.6855	0.5870	0.5786	0.7178	0.6634	0.5359
DeepMeSH2	0.6880	0.7190	0.6769	0.6819	0.6879	0.5791	0.5731	0.7192	0.6594	0.5341
DeepMeSH3	0.6883	0.7204	0.6758	0.6819	0.6895	0.5797	0.5750	0.7207	0.6586	0.5340
DeepMeSH4	0.6756	0.7108	0.6578	0.6677	0.6748	0.5440	0.5418	0.7122	0.6427	0.5169
DeepMeSH5	0.7120	0.7420	0.7041	0.7085	0.7142	0.6165	0.6095	0.7407	0.6854	0.5730
MeSHProbeNet-P	0.6839	0.6850	0.6986	0.6746	0.6480	0.5985	0.5741	0.6807	0.6872	0.5254
NLM System 4	0.6514	0.6873	0.6329	0.6405	0.6175	0.5024	0.4989	0.6805	0.6246	0.4869
MeSHProbeNet-P0	0.6852	0.7038	0.6828	0.6755	0.6669	0.5817	0.5666	0.6994	0.6716	0.5268
MeSHProbeNet-P1	0.6848	0.7200	0.6673	0.6748	0.6847	0.5631	0.5561	0.7161	0.6562	0.5263
MeSHProbeNet-P2	0.6857	0.7149	0.6727	0.6754	0.6811	0.5647	0.5567	0.7112	0.6620	0.5268
MeSHProbeNet-P3	0.6832	0.6980	0.6848	0.6738	0.6591	0.5872	0.5685	0.6936	0.6731	0.5249

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5260	0.7992	0.7244	0.7424	0.5691	0.5131
Default MTI	0.5246	0.7613	0.7656	0.7463	0.5367	0.5401
iria-mix	0.4401	0.6124	0.7339	0.6531	0.4161	0.4915
DeepMeSH1	0.5535	0.8178	0.7613	0.7739	0.5891	0.5439
DeepMeSH2	0.5513	0.8191	0.7574	0.7723	0.5885	0.5402
DeepMeSH3	0.5515	0.8202	0.7558	0.7718	0.5897	0.5397
DeepMeSH4	0.5366	0.8137	0.7409	0.7602	0.5779	0.5226
DeepMeSH5	0.5903	0.8332	0.7785	0.7914	0.6242	0.5801
MeSHProbeNet-P	0.5520	0.7977	0.7793	0.7722	0.5708	0.5597
NLM System 4	0.5180	0.8052	0.7167	0.7402	0.5607	0.5057
MeSHProbeNet-P0	0.5507	0.8125	0.7646	0.7713	0.5812	0.5481
MeSHProbeNet-P1	0.5476	0.8254	0.7496	0.7689	0.5888	0.5359
MeSHProbeNet-P2	0.5494	0.8215	0.7540	0.7694	0.5873	0.5404
MeSHProbeNet-P3	0.5496	0.8079	0.7670	0.7705	0.5770	0.5495

+ Test batch 3, week 1

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
NLM System 4	0.0967	0.6878	0.5990	0.6183	0.0364	0.4866	0.1232	0.0527	0.5867	0.4653
MTI First Line Index	0.6499	0.6993	0.6377	0.6469	0.6475	0.5872	0.5646	0.6842	0.6189	0.5024
Default MTI	0.6547	0.6519	0.6869	0.6492	0.6037	0.6266	0.5804	0.6436	0.6661	0.4993
iria-mix	0.5221	0.4613	0.6129	0.5122	0.4250	0.4863	0.4335	0.4632	0.5983	0.3582
DeepMeSH1	0.6985	0.7423	0.6818	0.6944	0.6962	0.5994	0.5922	0.7412	0.6604	0.5492
DeepMeSH2	0.6977	0.7418	0.6808	0.6936	0.6986	0.5958	0.5894	0.7407	0.6594	0.5483
DeepMeSH3	0.6992	0.7227	0.6990	0.6947	0.6814	0.6110	0.5971	0.7223	0.6776	0.5492
DeepMeSH4	0.7277	0.7493	0.7261	0.7229	0.7148	0.6429	0.6317	0.7500	0.7068	0.5908
DeepMeSH5	0.7279	0.7671	0.7107	0.7227	0.7292	0.6328	0.6285	0.7684	0.6914	0.5909
MeSHProbeNet-P	0.6912	0.7294	0.6790	0.6841	0.6851	0.5745	0.5647	0.7235	0.6616	0.5375
MeSHProbeNet-P0	0.6921	0.7190	0.6897	0.6850	0.6735	0.5865	0.5717	0.7131	0.6723	0.5382
MeSHProbeNet-P1	0.6926	0.7078	0.7007	0.6855	0.6610	0.5981	0.5780	0.7020	0.6834	0.5385
MeSHProbeNet-P2	0.6925	0.7142	0.6940	0.6853	0.6705	0.5854	0.5707	0.7084	0.6772	0.5382
MeSHProbeNet-P3	0.6913	0.7107	0.6943	0.6839	0.6704	0.5819	0.5683	0.7050	0.6781	0.5363
lcy_test	0.1748	0.3593	0.1338	0.1758	0.2689	0.1668	0.1424	0.3032	0.1228	0.1022

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
NLM System 4	0.5007	0.8007	0.6974	0.7231	0.5559	0.4844
MTI First Line Index	0.5299	0.8030	0.7310	0.7455	0.5733	0.5201
Default MTI	0.5284	0.7619	0.7742	0.7494	0.5389	0.5476
iria-mix	0.4399	0.6113	0.7413	0.6541	0.4135	0.4966
DeepMeSH1	0.5569	0.8311	0.7596	0.7777	0.5988	0.5438
DeepMeSH2	0.5566	0.8318	0.7585	0.7774	0.5990	0.5433
DeepMeSH3	0.5597	0.8156	0.7750	0.7791	0.5887	0.5573
DeepMeSH4	0.6004	0.8327	0.7947	0.7988	0.6273	0.5979
DeepMeSH5	0.5979	0.8469	0.7811	0.7978	0.6362	0.5859
MeSHProbeNet-P	0.5523	0.8259	0.7574	0.7718	0.5932	0.5429
MeSHProbeNet-P0	0.5541	0.8177	0.7675	0.7736	0.5875	0.5511
MeSHProbeNet-P1	0.5557	0.8087	0.7776	0.7750	0.5810	0.5596
MeSHProbeNet-P2	0.5549	0.8146	0.7711	0.7744	0.5851	0.5544
MeSHProbeNet-P3	0.5547	0.8125	0.7718	0.7740	0.5837	0.5549
lcy_test	0.2042	0.6267	0.2584	0.3375	0.3522	0.1596

+ Test batch 3, week 2

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6413	0.6887	0.6304	0.6379	0.6446	0.5767	0.5523	0.6740	0.6116	0.4914
Default MTI	0.6454	0.6392	0.6810	0.6392	0.6015	0.6185	0.5695	0.6317	0.6598	0.4878
iria-mix	0.5139	0.4500	0.6094	0.5039	0.4261	0.4774	0.4231	0.4529	0.5939	0.3500
DeepMeSH1	0.6956	0.7326	0.6832	0.6900	0.7005	0.6006	0.5945	0.7325	0.6622	0.5438
DeepMeSH2	0.6950	0.7180	0.6938	0.6893	0.6945	0.6049	0.5950	0.7183	0.6731	0.5429
DeepMeSH3	0.6965	0.7354	0.6834	0.6917	0.7020	0.6009	0.5953	0.7346	0.6622	0.5464
DeepMeSH4	0.7037	0.7421	0.6907	0.6992	0.7105	0.6098	0.6046	0.7416	0.6695	0.5573
DeepMeSH5	0.7038	0.7300	0.7012	0.6998	0.7064	0.6143	0.6059	0.7290	0.6802	0.5586
Semantic NoSQL KE 1	0.1656	0.1528	0.2576	0.1658	0.2561	0.3119	0.2430	0.1249	0.2453	0.0933
Semantic NoSQL KE 2	0.2090	0.1558	0.4099	0.2147	0.2745	0.5400	0.3618	0.1420	0.3957	0.1235
MeSHProbeNet-P	0.6852	0.6965	0.6948	0.6765	0.6697	0.5945	0.5755	0.6923	0.6782	0.5275
NLM System 4	0.6516	0.6841	0.6394	0.6415	0.6179	0.5067	0.5011	0.6774	0.6276	0.4885
MeSHProbeNet-P0	0.6850	0.6907	0.7002	0.6765	0.6633	0.6002	0.5777	0.6864	0.6836	0.5273
MeSHProbeNet-P1	0.6854	0.7027	0.6895	0.6767	0.6762	0.5885	0.5731	0.6984	0.6728	0.5280
MeSHProbeNet-P2	0.6858	0.7093	0.6834	0.6768	0.6839	0.5763	0.5659	0.7051	0.6675	0.5282
MeSHProbeNet-P3	0.6857	0.7069	0.6847	0.6765	0.6832	0.5728	0.5633	0.7026	0.6696	0.5277
NLM System 2	0.6684	0.7128	0.6464	0.6584	0.6690	0.5152	0.5169	0.7069	0.6339	0.5074

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5221	0.7956	0.7273	0.7397	0.5645	0.5129
Default MTI	0.5200	0.7532	0.7715	0.7431	0.5284	0.5418
iria-mix	0.4334	0.6013	0.7374	0.6461	0.4063	0.4919
DeepMeSH1	0.5547	0.8260	0.7603	0.7755	0.5953	0.5437
DeepMeSH2	0.5547	0.8142	0.7713	0.7763	0.5865	0.5506
DeepMeSH3	0.5575	0.8281	0.7604	0.7767	0.5988	0.5456
DeepMeSH4	0.5684	0.8324	0.7657	0.7819	0.6088	0.5567
DeepMeSH5	0.5708	0.8225	0.7764	0.7837	0.6030	0.5650
Semantic NoSQL KE 1	0.2352	0.3469	0.5326	0.3891	0.1968	0.3436
Semantic NoSQL KE 2	0.2471	0.3387	0.6666	0.4324	0.1851	0.4278
MeSHProbeNet-P	0.5481	0.8020	0.7743	0.7698	0.5726	0.5532
NLM System 4	0.5169	0.8004	0.7251	0.7419	0.5569	0.5084
MeSHProbeNet-P0	0.5487	0.7971	0.7793	0.7702	0.5692	0.5573
MeSHProbeNet-P1	0.5476	0.8067	0.7694	0.7693	0.5762	0.5491
MeSHProbeNet-P2	0.5471	0.8124	0.7633	0.7688	0.5802	0.5446
MeSHProbeNet-P3	0.5472	0.8117	0.7645	0.7692	0.5794	0.5455
NLM System 2	0.5281	0.8211	0.7251	0.7513	0.5771	0.5126

+ Test batch 3, week 3

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6596	0.7017	0.6474	0.6552	0.6437	0.5812	0.5583	0.6871	0.6343	0.5102
Default MTI	0.6586	0.6492	0.6895	0.6507	0.5989	0.6187	0.5735	0.6430	0.6751	0.4994
iria-mix	0.5443	0.4729	0.6464	0.5317	0.4607	0.5143	0.4579	0.4784	0.6313	0.3750
DeepMeSH1	0.7083	0.7575	0.6802	0.7010	0.7221	0.5821	0.5837	0.7605	0.6627	0.5568
DeepMeSH2	0.7100	0.7526	0.6872	0.7026	0.7183	0.5918	0.5909	0.7551	0.6701	0.5587
DeepMeSH3	0.7109	0.7659	0.6792	0.7051	0.7281	0.5812	0.5844	0.7676	0.6619	0.5629
DeepMeSH4	0.7124	0.7609	0.6858	0.7065	0.7243	0.5905	0.5915	0.7619	0.6690	0.5645
DeepMeSH5	0.7286	0.7853	0.6994	0.7262	0.7494	0.6034	0.6083	0.7855	0.6793	0.5942
Semantic NoSQL KE 1	0.2704	0.3575	0.2371	0.2650	0.4076	0.3864	0.3439	0.3392	0.2247	0.1610
Semantic NoSQL KE 2	0.2754	0.3158	0.2686	0.2713	0.3844	0.4262	0.3634	0.2983	0.2559	0.1645
Semantic NoSQL KE 3	0.2594	0.2323	0.3275	0.2573	0.3472	0.4806	0.3828	0.2206	0.3148	0.1530
Semantic NoSQL KE 4	0.2458	0.2025	0.3480	0.2438	0.3356	0.4911	0.3839	0.1939	0.3356	0.1433
Semantic NoSQL KE 5	0.2368	0.1872	0.3598	0.2346	0.3297	0.4941	0.3834	0.1796	0.3474	0.1369
MeSHProbeNet-P	0.6981	0.7098	0.7001	0.6885	0.6666	0.5993	0.5822	0.7079	0.6886	0.5407
NLM System 4	0.6629	0.6936	0.6477	0.6517	0.6227	0.5147	0.5082	0.6885	0.6392	0.4993
MeSHProbeNet-P0	0.6971	0.6965	0.7103	0.6871	0.6526	0.6105	0.5874	0.6949	0.6993	0.5388
MeSHProbeNet-P1	0.6991	0.7219	0.6904	0.6892	0.6802	0.5868	0.5750	0.7202	0.6792	0.5418
MeSHProbeNet-P2	0.6992	0.7174	0.6939	0.6891	0.6766	0.5872	0.5750	0.7157	0.6835	0.5416
MeSHProbeNet-P3	0.6984	0.7152	0.6938	0.6881	0.6755	0.5819	0.5711	0.7135	0.6840	0.5405
NLM System 2	0.6788	0.7202	0.6544	0.6674	0.6671	0.5235	0.5238	0.7155	0.6457	0.5175

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5391	0.8056	0.7423	0.7555	0.5780	0.5295
Default MTI	0.5321	0.7624	0.7796	0.7547	0.5396	0.5513
iria-mix	0.4586	0.6256	0.7680	0.6740	0.4292	0.5197
DeepMeSH1	0.5635	0.8446	0.7561	0.7831	0.6127	0.5430
DeepMeSH2	0.5666	0.8407	0.7635	0.7855	0.6102	0.5506
DeepMeSH3	0.5693	0.8504	0.7548	0.7854	0.6210	0.5460
DeepMeSH4	0.5722	0.8464	0.7618	0.7876	0.6183	0.5533
DeepMeSH5	0.6017	0.8636	0.7699	0.8006	0.6517	0.5784
Semantic NoSQL KE 1	0.2746	0.6309	0.4253	0.4813	0.3467	0.2515
Semantic NoSQL KE 2	0.2816	0.5829	0.4795	0.5018	0.3141	0.2836
Semantic NoSQL KE 3	0.2792	0.4753	0.5757	0.5001	0.2514	0.3515
Semantic NoSQL KE 4	0.2713	0.4265	0.6052	0.4822	0.2281	0.3755
Semantic NoSQL KE 5	0.2639	0.3987	0.6198	0.4675	0.2138	0.3869
MeSHProbeNet-P	0.5595	0.8119	0.7798	0.7804	0.5842	0.5610
NLM System 4	0.5284	0.8080	0.7315	0.7503	0.5673	0.5189
MeSHProbeNet-P0	0.5593	0.8021	0.7892	0.7807	0.5755	0.5684
MeSHProbeNet-P1	0.5582	0.8206	0.7696	0.7789	0.5903	0.5531
MeSHProbeNet-P2	0.5598	0.8186	0.7737	0.7803	0.5886	0.5573
MeSHProbeNet-P3	0.5602	0.8185	0.7746	0.7808	0.5885	0.5579
NLM System 2	0.5399	0.8276	0.7328	0.7597	0.5854	0.5249

+ Test batch 3, week 4

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6437	0.6991	0.6229	0.6397	0.6490	0.5627	0.5442	0.6838	0.6082	0.4915
Default MTI	0.6512	0.6544	0.6727	0.6446	0.6090	0.6051	0.5646	0.6473	0.6552	0.4930
iria-mix	0.2782	0.2650	0.3188	0.2747	0.4362	0.4116	0.3536	0.2564	0.3041	0.1659
DeepMeSH1	0.7012	0.7527	0.6745	0.6958	0.7216	0.5779	0.5786	0.7530	0.6561	0.5509
DeepMeSH2	0.7000	0.7583	0.6675	0.6941	0.7255	0.5696	0.5733	0.7591	0.6494	0.5489
DeepMeSH3	0.7015	0.7549	0.6739	0.6966	0.7232	0.5775	0.5787	0.7544	0.6556	0.5522
DeepMeSH4	0.7004	0.7605	0.6671	0.6951	0.7268	0.5694	0.5733	0.7607	0.6490	0.5505
DeepMeSH5	0.7332	0.7900	0.7022	0.7294	0.7667	0.6117	0.6188	0.7913	0.6830	0.6018
Semantic NoSQL KE 1	0.2707	0.3681	0.2358	0.2673	0.4191	0.3701	0.3309	0.3482	0.2215	0.1624
Semantic NoSQL KE 2	0.2768	0.3237	0.2685	0.2744	0.3993	0.4121	0.3538	0.3060	0.2528	0.1668
Semantic NoSQL KE 3	0.2623	0.2387	0.3273	0.2614	0.3603	0.4718	0.3779	0.2270	0.3107	0.1562
Semantic NoSQL KE 4	0.2486	0.2075	0.3466	0.2474	0.3489	0.4820	0.3784	0.1993	0.3302	0.1460
Semantic NoSQL KE 5	0.2391	0.1907	0.3579	0.2376	0.3437	0.4844	0.3775	0.1840	0.3412	0.1389
MeSHProbeNet-P	0.6926	0.7168	0.6866	0.6842	0.6843	0.5799	0.5689	0.7127	0.6736	0.5359
NLM System 4	0.6560	0.6885	0.6409	0.6453	0.6202	0.5034	0.4964	0.6819	0.6319	0.4920
MeSHProbeNet-P0	0.6924	0.7108	0.6914	0.6839	0.6772	0.5861	0.5722	0.7068	0.6785	0.5354
MeSHProbeNet-P1	0.6917	0.6991	0.7010	0.6833	0.6653	0.5978	0.5785	0.6952	0.6882	0.5345
MeSHProbeNet-P2	0.6928	0.7229	0.6804	0.6839	0.6919	0.5660	0.5596	0.7192	0.6682	0.5355
MeSHProbeNet-P3	0.6930	0.7209	0.6818	0.6838	0.6897	0.5632	0.5572	0.7173	0.6703	0.5354
NLM System 2	0.6735	0.7183	0.6480	0.6626	0.6719	0.5129	0.5132	0.7123	0.6387	0.5120
miao-taskA-B3W4	0.0449	0.0512	0.0430	0.0433	0.0924	0.0382	0.0462	0.0480	0.0421	0.0232

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5251	0.8045	0.7197	0.7414	0.5725	0.5093
Default MTI	0.5279	0.7663	0.7623	0.7465	0.5436	0.5404
iria-mix	0.2934	0.4869	0.5543	0.4982	0.2802	0.3399
DeepMeSH1	0.5612	0.8419	0.7492	0.7774	0.6119	0.5395
DeepMeSH2	0.5576	0.8456	0.7421	0.7748	0.6127	0.5329
DeepMeSH3	0.5622	0.8433	0.7486	0.7777	0.6137	0.5395
DeepMeSH4	0.5590	0.8469	0.7415	0.7752	0.6148	0.5335
DeepMeSH5	0.6117	0.8669	0.7682	0.8006	0.6634	0.5871
Semantic NoSQL KE 1	0.2764	0.6339	0.4212	0.4798	0.3539	0.2499
Semantic NoSQL KE 2	0.2842	0.5860	0.4749	0.4999	0.3201	0.2830
Semantic NoSQL KE 3	0.2809	0.4765	0.5712	0.4993	0.2549	0.3489
Semantic NoSQL KE 4	0.2731	0.4289	0.5997	0.4825	0.2315	0.3712
Semantic NoSQL KE 5	0.2655	0.4000	0.6147	0.4678	0.2165	0.3830
MeSHProbeNet-P	0.5567	0.8180	0.7641	0.7740	0.5901	0.5506
NLM System 4	0.5262	0.8052	0.7255	0.7450	0.5667	0.5155
MeSHProbeNet-P0	0.5569	0.8138	0.7690	0.7747	0.5865	0.5542
MeSHProbeNet-P1	0.5574	0.8047	0.7783	0.7754	0.5793	0.5614
MeSHProbeNet-P2	0.5560	0.8229	0.7579	0.7728	0.5938	0.5462
MeSHProbeNet-P3	0.5569	0.8226	0.7598	0.7737	0.5942	0.5475
NLM System 2	0.5379	0.8265	0.7268	0.7551	0.5872	0.5202
miao-taskA-B3W4	0.1637	0.2397	0.2558	0.2313	0.1643	0.1842

+ Test batch 3, week 5

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.6510	0.6877	0.6374	0.6424	0.6442	0.5825	0.5586	0.6772	0.6268	0.4944
Default MTI	0.6551	0.6447	0.6877	0.6471	0.6028	0.6269	0.5808	0.6393	0.6716	0.4968
iria-mix	0.5410	0.4707	0.6413	0.5296	0.4743	0.5196	0.4649	0.4755	0.6274	0.3729
DeepMeSH1	0.7029	0.7485	0.6761	0.6940	0.7141	0.5900	0.5896	0.7515	0.6601	0.5496
DeepMeSH2	0.7024	0.7465	0.6769	0.6935	0.7149	0.5883	0.5878	0.7495	0.6609	0.5489
DeepMeSH3	0.7038	0.7512	0.6760	0.6955	0.7154	0.5898	0.5897	0.7537	0.6600	0.5519
DeepMeSH4	0.7033	0.7492	0.6767	0.6950	0.7160	0.5879	0.5879	0.7517	0.6607	0.5512
DeepMeSH5	0.7279	0.7753	0.7038	0.7233	0.7482	0.6201	0.6221	0.7762	0.6853	0.5925
Semantic NoSQL KE 1	0.2809	0.3747	0.2468	0.2761	0.4185	0.3902	0.3477	0.3546	0.2325	0.1688
Semantic NoSQL KE 2	0.2883	0.3310	0.2819	0.2842	0.3947	0.4294	0.3668	0.3136	0.2667	0.1737
Semantic NoSQL KE 3	0.2721	0.2435	0.3436	0.2701	0.3547	0.4851	0.3863	0.2323	0.3283	0.1620
Semantic NoSQL KE 4	0.2559	0.2102	0.3642	0.2542	0.3421	0.4945	0.3862	0.2019	0.3494	0.1505
Semantic NoSQL KE 5	0.2443	0.1912	0.3765	0.2424	0.3356	0.4970	0.3851	0.1844	0.3618	0.1421
MeSHProbeNet-P	0.6926	0.7067	0.6909	0.6815	0.6678	0.5917	0.5766	0.7054	0.6802	0.5336
NLM System 4	0.6520	0.6818	0.6375	0.6393	0.6120	0.5109	0.5037	0.6758	0.6299	0.4867
MeSHProbeNet-P0	0.6921	0.7173	0.6804	0.6808	0.6802	0.5799	0.5693	0.7161	0.6697	0.5330
MeSHProbeNet-P1	0.6926	0.6960	0.7019	0.6819	0.6575	0.6041	0.5830	0.6943	0.6909	0.5339
MeSHProbeNet-P2	0.6920	0.7127	0.6839	0.6805	0.6777	0.5795	0.5680	0.7112	0.6738	0.5325
MeSHProbeNet-P3	0.6908	0.7089	0.6851	0.6794	0.6749	0.5741	0.5636	0.7072	0.6753	0.5310
NLM System 2	0.6690	0.7096	0.6446	0.6557	0.6551	0.5182	0.5171	0.7046	0.6368	0.5051
mesh class	0.0781	0.0460	0.2580	0.0769	0.0015	0.0075	0.0011	0.0455	0.2746	0.0409

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.5263	0.7946	0.7355	0.7445	0.5648	0.5194
Default MTI	0.5293	0.7589	0.7776	0.7499	0.5365	0.5518
iria-mix	0.4557	0.6237	0.7620	0.6706	0.4268	0.5161
DeepMeSH1	0.5603	0.8388	0.7530	0.7766	0.6083	0.5435
DeepMeSH2	0.5607	0.8374	0.7542	0.7768	0.6070	0.5444
DeepMeSH3	0.5628	0.8408	0.7528	0.7777	0.6114	0.5452
DeepMeSH4	0.5631	0.8394	0.7540	0.7778	0.6102	0.5460
DeepMeSH5	0.6038	0.8567	0.7741	0.7982	0.6487	0.5864
Semantic NoSQL KE 1	0.2795	0.6401	0.4314	0.4883	0.3563	0.2536
Semantic NoSQL KE 2	0.2881	0.5917	0.4864	0.5084	0.3241	0.2880
Semantic NoSQL KE 3	0.2863	0.4778	0.5829	0.5052	0.2593	0.3552
Semantic NoSQL KE 4	0.2767	0.4253	0.6122	0.4843	0.2327	0.3793
Semantic NoSQL KE 5	0.2679	0.3928	0.6282	0.4666	0.2161	0.3930
MeSHProbeNet-P	0.5549	0.8089	0.7705	0.7720	0.5812	0.5570
NLM System 4	0.5191	0.7985	0.7244	0.7396	0.5575	0.5129
MeSHProbeNet-P0	0.5534	0.8173	0.7611	0.7705	0.5872	0.5490
MeSHProbeNet-P1	0.5564	0.8009	0.7813	0.7740	0.5753	0.5652
MeSHProbeNet-P2	0.5543	0.8147	0.7646	0.7713	0.5853	0.5522
MeSHProbeNet-P3	0.5545	0.8138	0.7659	0.7714	0.5850	0.5530
NLM System 2	0.5311	0.8173	0.7254	0.7488	0.5775	0.5187
mesh class	0.1399	0.1096	0.5303	0.1783	0.0862	0.4034

Platinum sponsors of the BioASQ Challenge between 2012 and 2023

Google was a proud sponsor of the BioASQ Challenge from 2018 to 2022.
BioASQ was supported by the National Library of Medicine of the National Institutes of Health under award number R13LM012214. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
The research leading to these results has received funding from the European Commission's Seventh Framework Programme (FP7/2007-2013, ICT-2011.4.4(d), Intelligent Information Management, Targeted Competition Framework) under grant agreement n° 318652.

BioASQ Participants Area

Test Results for Task 7a

Annotated articles:16780/17711

Flat Measures

Hierarchical Measures

+ Dry Run 2

Annotated articles:5408/5577

Flat Measures

Hierarchical Measures

+ Test batch 1, week 1

Annotated articles:7194/7358

Flat Measures

Hierarchical Measures

+ Test batch 1, week 2

Annotated articles:7021/7166

Flat Measures

Hierarchical Measures

+ Test batch 1, week 3

Annotated articles:10831/11019

Flat Measures

Hierarchical Measures

+ Test batch 1, week 4

Annotated articles:5482/5566

Flat Measures

Hierarchical Measures

+ Test batch 1, week 5

Annotated articles:6353/6729

Flat Measures

Hierarchical Measures

+ Test batch 2, week 1

Annotated articles:6098/6380

Flat Measures

Hierarchical Measures

+ Test batch 2, week 2

Annotated articles:6621/6785

Flat Measures

Hierarchical Measures

+ Test batch 2, week 3

Annotated articles:5927/6207

Flat Measures

Hierarchical Measures

+ Test batch 2, week 4

Annotated articles:7079/7382

Flat Measures

Hierarchical Measures

+ Test batch 2, week 5

Annotated articles:6756/7240

Flat Measures

Hierarchical Measures

+ Test batch 3, week 1

Annotated articles:5835/6266

Flat Measures

Hierarchical Measures

+ Test batch 3, week 2

Annotated articles:10386/11455

Flat Measures

Hierarchical Measures

+ Test batch 3, week 3

Annotated articles:3947/4750

Flat Measures

Hierarchical Measures

+ Test batch 3, week 4

Annotated articles:5021/7338

Flat Measures

Hierarchical Measures

+ Test batch 3, week 5

Annotated articles:4554/6920

Flat Measures

Hierarchical Measures