BioASQ Participants Area

Test Results for Task 4a

The evaluation measures indicating the performance of the systems that submitted results are presented below. The evaluation is incremental; as new MeSH become available the tables are updated.

+ Dry Run

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
BioASQ GrantID	0.0002	0.0003	0.0002	0.0002	0.0004	0.0000	0.0001	0.0004	0.0001	0.0001
MTI First Line Index	0.5510	0.6286	0.5178	0.5478	0.5599	0.4758	0.4595	0.6184	0.4969	0.3926
Default MTI	0.5660	0.5965	0.5671	0.5637	0.5322	0.5214	0.4920	0.5910	0.5431	0.4071
auth1	0.0871	0.6767	0.0523	0.0956	0.6767	0.0002	0.0002	0.6767	0.0466	0.0523

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
BioASQ GrantID	0.0981	0.1608	0.0879	0.1014	0.1554	0.0827
MTI First Line Index	0.4504	0.7651	0.6452	0.6796	0.5129	0.4262
Default MTI	0.4641	0.7350	0.6922	0.6948	0.4934	0.4630
auth1	0.0678	0.7031	0.0595	0.1084	0.2825	0.0393

+ Test batch 1, week 1

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5702	0.6432	0.5341	0.5609	0.5862	0.4765	0.4666	0.6365	0.5163	0.4067
Default MTI	0.5795	0.6129	0.5740	0.5710	0.5580	0.5161	0.4933	0.6067	0.5547	0.4161
auth1	0.5940	0.6059	0.5965	0.5826	0.6086	0.4562	0.4480	0.6094	0.5793	0.4254
MeSHLabeler	0.6282	0.6682	0.6139	0.6201	0.6260	0.5210	0.5139	0.6661	0.5944	0.4654
MeSHLabeler-1	0.6190	0.6612	0.6033	0.6114	0.6092	0.5120	0.5044	0.6605	0.5824	0.4559

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4519	0.7721	0.6508	0.6828	0.5144	0.4301
Default MTI	0.4634	0.7461	0.6899	0.6949	0.4987	0.4621
auth1	0.4678	0.7388	0.7013	0.6995	0.4982	0.4684
MeSHLabeler	0.4926	0.7842	0.7102	0.7250	0.5367	0.4820
MeSHLabeler-1	0.4825	0.7804	0.6980	0.7168	0.5301	0.4694

+ Test batch 1, week 2

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5852	0.6527	0.5480	0.5734	0.5769	0.4750	0.4593	0.6469	0.5343	0.4204
Default MTI	0.5928	0.6228	0.5853	0.5825	0.5504	0.5149	0.4874	0.6184	0.5692	0.4288
auth1	0.6050	0.6143	0.6017	0.5912	0.5906	0.4465	0.4368	0.6222	0.5887	0.4361
auth2	0.6060	0.6550	0.5672	0.5907	0.6226	0.4215	0.4190	0.6660	0.5559	0.4367
MeSHLabeler	0.6424	0.6829	0.6228	0.6333	0.6252	0.5157	0.5069	0.6843	0.6054	0.4807
MeSHLabeler-1	0.6332	0.6738	0.6129	0.6239	0.6055	0.5102	0.4982	0.6765	0.5951	0.4710
BioASQ Filtering	0.5958	0.6124	0.5977	0.5839	0.5594	0.4753	0.4565	0.6087	0.5836	0.4288

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4699	0.7816	0.6655	0.6964	0.5328	0.4480
Default MTI	0.4807	0.7557	0.7041	0.7081	0.5161	0.4786
auth1	0.4828	0.7502	0.7107	0.7123	0.5132	0.4809
auth2	0.4806	0.7804	0.6760	0.7061	0.5394	0.4576
MeSHLabeler	0.5135	0.8008	0.7215	0.7420	0.5582	0.4994
MeSHLabeler-1	0.5072	0.7980	0.7100	0.7344	0.5550	0.4903
BioASQ Filtering	0.4771	0.7505	0.6993	0.7026	0.5121	0.4770

+ Test batch 1, week 3

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5669	0.6397	0.5376	0.5593	0.5815	0.4963	0.4775	0.6322	0.5139	0.4059
Default MTI	0.5782	0.6119	0.5831	0.5727	0.5534	0.5374	0.5073	0.6036	0.5549	0.4182
auth1	0.5874	0.6089	0.5852	0.5763	0.6047	0.4573	0.4473	0.6138	0.5632	0.4211
auth2	0.5876	0.6515	0.5514	0.5755	0.6335	0.4336	0.4305	0.6582	0.5307	0.4214
MeSHLabeler	0.6241	0.6632	0.6171	0.6171	0.6158	0.5297	0.5150	0.6610	0.5911	0.4631
MeSHLabeler-1	0.6162	0.6607	0.6047	0.6096	0.6027	0.5190	0.5054	0.6597	0.5780	0.4551
BioASQ Filtering	0.5830	0.6056	0.5932	0.5747	0.5675	0.5004	0.4790	0.5982	0.5685	0.4191

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4545	0.7637	0.6502	0.6774	0.5169	0.4354
Default MTI	0.4656	0.7398	0.6930	0.6913	0.4997	0.4672
auth1	0.4653	0.7410	0.6899	0.6932	0.5013	0.4638
auth2	0.4611	0.7702	0.6550	0.6856	0.5255	0.4386
MeSHLabeler	0.4933	0.7791	0.7118	0.7215	0.5345	0.4865
MeSHLabeler-1	0.4848	0.7799	0.6938	0.7124	0.5324	0.4729
BioASQ Filtering	0.4651	0.7377	0.6909	0.6889	0.5008	0.4665

+ Test batch 1, week 4

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5598	0.6509	0.5176	0.5543	0.5979	0.4633	0.4551	0.6427	0.4958	0.3986
Default MTI	0.5737	0.6203	0.5626	0.5696	0.5682	0.5050	0.4862	0.6140	0.5384	0.4125
auth1	0.5966	0.6425	0.5736	0.5890	0.6299	0.4406	0.4410	0.6449	0.5550	0.4319
auth2	0.5915	0.6789	0.5375	0.5819	0.6561	0.4135	0.4194	0.6832	0.5216	0.4257
MeSHLabeler	0.6180	0.6904	0.5817	0.6123	0.6432	0.4920	0.4919	0.6896	0.5599	0.4555
MeSHLabeler-1	0.6246	0.6943	0.5920	0.6200	0.6495	0.4966	0.4952	0.6918	0.5693	0.4639
BioASQ Filtering	0.5692	0.6067	0.5635	0.5634	0.5621	0.4741	0.4602	0.5997	0.5417	0.4066
UCSDLogReg	0.1842	0.4877	0.1160	0.1790	0.0123	0.0006	0.0006	0.4718	0.1144	0.1037

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4514	0.7851	0.6341	0.6798	0.5249	0.4225
Default MTI	0.4647	0.7582	0.6780	0.6959	0.5079	0.4556
auth1	0.4755	0.7759	0.6831	0.7086	0.5261	0.4569
auth2	0.4669	0.8013	0.6457	0.6965	0.5436	0.4311
MeSHLabeler	0.4855	0.8138	0.6764	0.7204	0.5515	0.4573
MeSHLabeler-1	0.4951	0.8139	0.6911	0.7292	0.5562	0.4700
BioASQ Filtering	0.4560	0.7518	0.6744	0.6901	0.4978	0.4484
UCSDLogReg	0.1644	0.6384	0.1284	0.2049	0.4632	0.1050

+ Test batch 1, week 5

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5710	0.6489	0.5434	0.5672	0.5873	0.4676	0.4539	0.6372	0.5173	0.4161
Default MTI	0.5800	0.6156	0.5818	0.5769	0.5582	0.5081	0.4840	0.6082	0.5542	0.4247
auth1	0.5893	0.6066	0.5893	0.5801	0.5846	0.4422	0.4323	0.6095	0.5704	0.4253
BioASQ Filtering	0.5840	0.6063	0.5937	0.5778	0.5740	0.4759	0.4591	0.5993	0.5694	0.4233

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4635	0.7724	0.6583	0.6856	0.5250	0.4455
Default MTI	0.4730	0.7446	0.6965	0.6979	0.5049	0.4749
auth1	0.4685	0.7377	0.6921	0.6945	0.5030	0.4659
BioASQ Filtering	0.4688	0.7438	0.6933	0.6956	0.5033	0.4716

+ Test batch 2, week 1

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5756	0.6397	0.5520	0.5678	0.5824	0.4738	0.4608	0.6343	0.5269	0.4159
Default MTI	0.5843	0.6044	0.5939	0.5769	0.5468	0.5209	0.4939	0.6019	0.5678	0.4241
auth1	0.5907	0.6094	0.6000	0.5830	0.5874	0.4547	0.4440	0.6067	0.5755	0.4278
auth2	0.5676	0.6370	0.5360	0.5611	0.6127	0.4236	0.4190	0.6354	0.5129	0.4055
MeSHLabeler	0.6235	0.6850	0.6005	0.6186	0.6306	0.4885	0.4856	0.6875	0.5705	0.4665
MeSHLabeler-1	0.6194	0.6812	0.5966	0.6148	0.6223	0.4911	0.4880	0.6851	0.5653	0.4624
MeSHLabeler-2	0.6232	0.6700	0.6126	0.6188	0.6149	0.5020	0.4921	0.6666	0.5852	0.4665
MeSHLabeler-3	0.6178	0.6646	0.6059	0.6122	0.6028	0.5022	0.4930	0.6622	0.5790	0.4589
iria-1	0.4226	0.3760	0.5041	0.4142	0.3237	0.3545	0.3206	0.3759	0.4825	0.2741
BioASQ Filtering	0.5902	0.6001	0.6076	0.5808	0.5659	0.4909	0.4714	0.5964	0.5840	0.4268

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4565	0.7718	0.6631	0.6876	0.5147	0.4413
Default MTI	0.4677	0.7374	0.7070	0.6994	0.4950	0.4735
auth1	0.4680	0.7390	0.7038	0.7000	0.4996	0.4692
auth2	0.4542	0.7650	0.6614	0.6880	0.5166	0.4315
MeSHLabeler	0.4903	0.8013	0.6944	0.7229	0.5453	0.4725
MeSHLabeler-1	0.4858	0.8018	0.6868	0.7191	0.5433	0.4668
MeSHLabeler-2	0.4918	0.7900	0.7086	0.7257	0.5356	0.4820
MeSHLabeler-3	0.4851	0.7869	0.6994	0.7189	0.5321	0.4742
iria-1	0.3709	0.5325	0.6522	0.5657	0.3530	0.4232
BioASQ Filtering	0.4687	0.7408	0.7066	0.6997	0.4978	0.4745

+ Test batch 2, week 2

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5806	0.6496	0.5512	0.5743	0.5866	0.4785	0.4635	0.6425	0.5296	0.4211
Default MTI	0.5774	0.6066	0.5770	0.5724	0.5440	0.5202	0.4922	0.6019	0.5548	0.4199
auth1	0.5981	0.6153	0.5993	0.5897	0.6024	0.4639	0.4559	0.6187	0.5788	0.4333
auth2	0.5700	0.6390	0.5333	0.5630	0.6315	0.4318	0.4290	0.6435	0.5116	0.4057
MeSHLabeler	0.6193	0.7208	0.5703	0.6154	0.6671	0.4698	0.4725	0.7217	0.5424	0.4625
MeSHLabeler-1	0.6083	0.7163	0.5597	0.6060	0.6495	0.4669	0.4687	0.7134	0.5302	0.4520
MeSHLabeler-2	0.6249	0.6847	0.6039	0.6226	0.6308	0.5059	0.4997	0.6834	0.5757	0.4679
MeSHLabeler-3	0.6139	0.6780	0.5902	0.6118	0.6134	0.4950	0.4887	0.6780	0.5608	0.4563
iria-1	0.4384	0.3895	0.5224	0.4313	0.3343	0.3656	0.3328	0.3920	0.4973	0.2870
BioASQ Filtering	0.5488	0.5751	0.5458	0.5400	0.5221	0.4791	0.4562	0.5709	0.5283	0.3883

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4674	0.7734	0.6672	0.6939	0.5252	0.4483
Default MTI	0.4699	0.7395	0.7002	0.6993	0.4978	0.4718
auth1	0.4789	0.7389	0.7066	0.7031	0.5056	0.4806
auth2	0.4628	0.7623	0.6654	0.6900	0.5231	0.4392
MeSHLabeler	0.4892	0.8187	0.6680	0.7140	0.5650	0.4568
MeSHLabeler-1	0.4758	0.8145	0.6548	0.7042	0.5545	0.4415
MeSHLabeler-2	0.4982	0.7920	0.7066	0.7267	0.5488	0.4819
MeSHLabeler-3	0.4918	0.7905	0.6914	0.7182	0.5463	0.4724
iria-1	0.3882	0.5450	0.6689	0.5820	0.3658	0.4435
BioASQ Filtering	0.4469	0.7217	0.6772	0.6773	0.4760	0.4498

+ Test batch 2, week 3

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5784	0.6515	0.5481	0.5707	0.5963	0.4884	0.4758	0.6471	0.5229	0.4197
Default MTI	0.5850	0.6149	0.5854	0.5782	0.5580	0.5263	0.5008	0.6125	0.5599	0.4253
auth1	0.6015	0.6211	0.6104	0.5951	0.5972	0.4801	0.4671	0.6235	0.5811	0.4390
auth2	0.5753	0.6503	0.5429	0.5701	0.6239	0.4436	0.4377	0.6524	0.5145	0.4139
MeSHLabeler	0.6340	0.7006	0.6092	0.6307	0.6557	0.5125	0.5098	0.7051	0.5760	0.4787
MeSHLabeler-1	0.3437	0.8233	0.2310	0.3385	0.7400	0.1181	0.1304	0.8279	0.2169	0.2192
MeSHLabeler-2	0.6336	0.6876	0.6145	0.6295	0.6426	0.5213	0.5165	0.6896	0.5860	0.4779
MeSHLabeler-3	0.6270	0.6834	0.6071	0.6237	0.6320	0.5142	0.5087	0.6851	0.5781	0.4715
iria-1	0.4344	0.3852	0.5179	0.4263	0.3334	0.3723	0.3378	0.3885	0.4926	0.2839
BioASQ Filtering	0.5841	0.6005	0.5922	0.5746	0.5629	0.4863	0.4657	0.5992	0.5698	0.4202

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4603	0.7723	0.6579	0.6862	0.5229	0.4389
Default MTI	0.4700	0.7376	0.6995	0.6959	0.5030	0.4706
auth1	0.4736	0.7409	0.7099	0.7022	0.5027	0.4777
auth2	0.4556	0.7684	0.6687	0.6917	0.5161	0.4349
MeSHLabeler	0.4966	0.8057	0.6979	0.7268	0.5519	0.4775
MeSHLabeler-1	0.2521	0.9108	0.2603	0.3802	0.5594	0.1740
MeSHLabeler-2	0.4978	0.7936	0.7079	0.7285	0.5453	0.4843
MeSHLabeler-3	0.4933	0.7957	0.6987	0.7241	0.5470	0.4748
iria-1	0.3849	0.5350	0.6622	0.5720	0.3648	0.4375
BioASQ Filtering	0.4655	0.7331	0.6926	0.6890	0.4972	0.4671

+ Test batch 2, week 4

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5586	0.6301	0.5317	0.5464	0.5737	0.4763	0.4614	0.6168	0.5105	0.3956
Default MTI	0.5695	0.6043	0.5713	0.5588	0.5498	0.5168	0.4917	0.5936	0.5472	0.4073
auth1	0.5852	0.5949	0.5908	0.5706	0.5894	0.4697	0.4563	0.6008	0.5704	0.4168
auth2	0.5649	0.6249	0.5315	0.5517	0.6185	0.4378	0.4294	0.6324	0.5105	0.3978
iria-1	0.4175	0.3574	0.5141	0.4050	0.3312	0.3755	0.3385	0.3615	0.4940	0.2678
BioASQ Filtering	0.5700	0.5914	0.5798	0.5566	0.5607	0.4826	0.4632	0.5816	0.5588	0.4040
LABDA baseline	0.4752	0.5265	0.4588	0.4643	0.4846	0.4666	0.4439	0.5227	0.4357	0.3185

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4385	0.7477	0.6411	0.6603	0.5002	0.4238
Default MTI	0.4494	0.7242	0.6781	0.6722	0.4876	0.4524
auth1	0.4567	0.7168	0.6901	0.6800	0.4881	0.4608
auth2	0.4418	0.7404	0.6481	0.6667	0.5017	0.4236
iria-1	0.3675	0.5054	0.6590	0.5515	0.3407	0.4333
BioASQ Filtering	0.4469	0.7224	0.6750	0.6684	0.4849	0.4529
LABDA baseline	0.3814	0.6776	0.6048	0.6108	0.4239	0.3797

+ Test batch 2, week 5

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5845	0.6337	0.5737	0.5756	0.5724	0.5104	0.4958	0.6230	0.5505	0.4264
Default MTI	0.5866	0.5915	0.6137	0.5773	0.5324	0.5510	0.5196	0.5841	0.5890	0.4246
auth1	0.6050	0.5941	0.6263	0.5897	0.5734	0.5030	0.4841	0.5997	0.6104	0.4352
auth2	0.6047	0.6437	0.5832	0.5898	0.6058	0.4740	0.4631	0.6499	0.5654	0.4363
MeSHLabeler	0.6404	0.6721	0.6336	0.6304	0.6154	0.5381	0.5261	0.6740	0.6100	0.4776
MeSHLabeler-2	0.6347	0.6667	0.6325	0.6261	0.6073	0.5354	0.5219	0.6644	0.6076	0.4721
MeSHLabeler-3	0.6287	0.6579	0.6262	0.6206	0.6027	0.5305	0.5161	0.6589	0.6012	0.4667
iria-1	0.4434	0.3764	0.5477	0.4303	0.3392	0.3951	0.3556	0.3816	0.5293	0.2894
BioASQ Filtering	0.5853	0.5784	0.6205	0.5734	0.5382	0.5129	0.4866	0.5709	0.6005	0.4198
UCSDLogReg	0.5250	0.6341	0.4614	0.4952	0.5683	0.2614	0.2654	0.6134	0.4588	0.3488
LABDA baseline	0.4841	0.5264	0.4819	0.4768	0.4774	0.4901	0.4654	0.5174	0.4549	0.3284
LABDA ElasticSearch	0.3036	0.2871	0.3459	0.2954	0.1769	0.2121	0.1989	0.2782	0.3341	0.1859

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4704	0.7590	0.6976	0.7023	0.5121	0.4667
Default MTI	0.4672	0.7216	0.7341	0.7035	0.4808	0.4870
auth1	0.4738	0.7216	0.7402	0.7110	0.4867	0.4913
auth2	0.4701	0.7641	0.6870	0.7017	0.5159	0.4599
MeSHLabeler	0.4929	0.7770	0.7407	0.7382	0.5262	0.4918
MeSHLabeler-2	0.4922	0.7738	0.7403	0.7354	0.5249	0.4926
MeSHLabeler-3	0.4900	0.7706	0.7339	0.7318	0.5219	0.4899
iria-1	0.3881	0.5324	0.7012	0.5865	0.3571	0.4557
BioASQ Filtering	0.4643	0.7153	0.7269	0.6957	0.4771	0.4888
UCSDLogReg	0.3919	0.7704	0.5347	0.5934	0.4996	0.3563
LABDA baseline	0.3875	0.6849	0.6493	0.6394	0.4138	0.3965
LABDA ElasticSearch	0.3115	0.4730	0.5451	0.4805	0.3061	0.3506

+ Test batch 3, week 1

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5299	0.6170	0.4892	0.5212	0.5427	0.4124	0.4048	0.6037	0.4721	0.3714
Default MTI	0.5458	0.5879	0.5370	0.5387	0.5154	0.4595	0.4441	0.5790	0.5161	0.3861
auth1	0.5701	0.5915	0.5659	0.5594	0.5664	0.4301	0.4203	0.5963	0.5461	0.4045
auth2	0.1141	0.1130	0.1165	0.1078	0.0056	0.0038	0.0039	0.1169	0.1114	0.0612
auth5	0.5744	0.5949	0.5694	0.5628	0.5651	0.4546	0.4449	0.6008	0.5502	0.4067
MeSHLabeler	0.6106	0.6842	0.5794	0.6070	0.6379	0.4624	0.4629	0.6832	0.5519	0.4520
MeSHLabeler-2	0.6048	0.6822	0.5690	0.5998	0.6366	0.4576	0.4580	0.6810	0.5440	0.4449
MeSHLabeler-3	0.5942	0.6725	0.5580	0.5875	0.6195	0.4478	0.4468	0.6729	0.5319	0.4320
BioASQ Filtering	0.5553	0.5879	0.5500	0.5447	0.5451	0.4319	0.4163	0.5814	0.5314	0.3911
UCSDLogReg	0.4939	0.6350	0.4152	0.4647	0.5663	0.2475	0.2517	0.6176	0.4115	0.3224
LABDA baseline	0.4477	0.5218	0.4189	0.4404	0.4654	0.4037	0.3946	0.5123	0.3976	0.2965
LABDA ElasticSearch	0.3049	0.3007	0.3304	0.2978	0.1850	0.1983	0.1911	0.2925	0.3184	0.1854
LargeElasticLABDA	0.3100	0.2988	0.3314	0.2971	0.1934	0.2143	0.2042	0.3000	0.3206	0.1852
d33p	0.4939	0.6350	0.4152	0.4647	0.5663	0.2475	0.2517	0.6176	0.4115	0.3224

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4395	0.7613	0.6024	0.6463	0.5185	0.4078
Default MTI	0.4492	0.7302	0.6484	0.6628	0.4928	0.4414
auth1	0.4547	0.7283	0.6653	0.6736	0.4973	0.4428
auth2	0.1612	0.2252	0.2171	0.2066	0.1750	0.1672
auth5	0.4580	0.7359	0.6731	0.6828	0.4981	0.4473
MeSHLabeler	0.4904	0.8002	0.6701	0.7072	0.5585	0.4623
MeSHLabeler-2	0.4813	0.7945	0.6622	0.6998	0.5453	0.4542
MeSHLabeler-3	0.4769	0.8001	0.6486	0.6919	0.5507	0.4464
BioASQ Filtering	0.4537	0.7422	0.6465	0.6664	0.5017	0.4433
UCSDLogReg	0.3739	0.7931	0.4924	0.5662	0.5026	0.3257
LABDA baseline	0.3834	0.7006	0.5800	0.6081	0.4373	0.3716
LABDA ElasticSearch	0.3223	0.5002	0.5277	0.4891	0.3291	0.3446
LargeElasticLABDA	0.3252	0.5112	0.5309	0.4956	0.3340	0.3447
d33p	0.3739	0.7931	0.4924	0.5662	0.5026	0.3257

+ Test batch 3, week 2

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5797	0.6537	0.5561	0.5742	0.5776	0.4571	0.4446	0.6410	0.5291	0.4206
Default MTI	0.5836	0.6196	0.5818	0.5761	0.5437	0.4845	0.4665	0.6118	0.5579	0.4211
auth1	0.6003	0.6171	0.6086	0.5896	0.5744	0.4656	0.4514	0.6176	0.5839	0.4325
auth2	0.6090	0.6267	0.6167	0.5982	0.5699	0.4879	0.4732	0.6266	0.5924	0.4424
MeSHLabeler	0.6358	0.7071	0.6125	0.6317	0.6449	0.4851	0.4825	0.7053	0.5787	0.4775
MeSHLabeler-2	0.6334	0.7028	0.6125	0.6290	0.6347	0.4856	0.4812	0.6992	0.5790	0.4753
MeSHLabeler-3	0.6236	0.6930	0.6025	0.6200	0.6134	0.4784	0.4749	0.6899	0.5690	0.4660
iria-1	0.4425	0.3890	0.5263	0.4311	0.3412	0.3679	0.3366	0.3930	0.5062	0.2887
BioASQ Filtering	0.5828	0.5978	0.5923	0.5706	0.5541	0.4569	0.4449	0.5922	0.5736	0.4148
UCSDLogReg	0.5235	0.6486	0.4642	0.5019	0.5687	0.2602	0.2651	0.6227	0.4516	0.3535
d33p	0.5257	0.6366	0.4641	0.5046	0.5032	0.2437	0.2443	0.6185	0.4571	0.3545

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4507	0.7684	0.6624	0.6851	0.5166	0.4324
Default MTI	0.4556	0.7421	0.6938	0.6936	0.4938	0.4550
auth1	0.4655	0.7473	0.7092	0.7065	0.4987	0.4670
auth2	0.4716	0.7514	0.7143	0.7109	0.5021	0.4753
MeSHLabeler	0.4923	0.8102	0.6991	0.7280	0.5555	0.4739
MeSHLabeler-2	0.4951	0.8075	0.7019	0.7274	0.5521	0.4790
MeSHLabeler-3	0.4886	0.8039	0.6915	0.7219	0.5495	0.4695
iria-1	0.3791	0.5514	0.6734	0.5861	0.3610	0.4298
BioASQ Filtering	0.4503	0.7371	0.6904	0.6895	0.4855	0.4509
UCSDLogReg	0.3874	0.7942	0.5329	0.5994	0.5092	0.3482
d33p	0.3962	0.7805	0.5430	0.6086	0.5060	0.3544

+ Test batch 3, week 3

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5736	0.6427	0.5306	0.5583	0.6103	0.4627	0.4556	0.6422	0.5183	0.4096
Default MTI	0.5832	0.6142	0.5691	0.5684	0.5810	0.5021	0.4868	0.6149	0.5546	0.4170
auth1	0.5739	0.5848	0.5730	0.5607	0.5812	0.4532	0.4431	0.5903	0.5583	0.4074
auth2	0.5820	0.5945	0.5782	0.5679	0.5797	0.4760	0.4666	0.5987	0.5662	0.4145
MeSHLabeler	0.6294	0.6869	0.5971	0.6183	0.6544	0.4991	0.4956	0.6925	0.5768	0.4672
MeSHLabeler-2	0.6234	0.6953	0.5864	0.6152	0.6587	0.4911	0.4896	0.6955	0.5648	0.4633
MeSHLabeler-3	0.6138	0.6821	0.5774	0.6044	0.6377	0.4820	0.4802	0.6878	0.5542	0.4523
iria-1	0.4108	0.3575	0.4943	0.4010	0.3349	0.3665	0.3353	0.3603	0.4777	0.2637
BioASQ Filtering	0.5730	0.5930	0.5705	0.5583	0.5701	0.4583	0.4447	0.5891	0.5578	0.4037
UCSDLogReg	0.4960	0.6411	0.4116	0.4676	0.5866	0.2427	0.2474	0.6272	0.4103	0.3253
LABDA baseline	0.4865	0.5351	0.4616	0.4715	0.5003	0.4452	0.4315	0.5357	0.4456	0.3248
LABDA ElasticSearch	0.2973	0.2005	0.6670	0.2980	0.1727	0.5401	0.3824	0.1914	0.6651	0.1805
LargeElasticLABDA	0.2969	0.2007	0.6808	0.2991	0.1731	0.5619	0.3971	0.1901	0.6773	0.1817
d33p	0.2094	0.3504	0.1518	0.1984	0.0198	0.0022	0.0014	0.3230	0.1549	0.1185
CSX-1	0.4003	0.7665	0.2834	0.3814	0.7381	0.1722	0.1826	0.7486	0.2732	0.2552

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4588	0.7816	0.6415	0.6798	0.5283	0.4327
Default MTI	0.4661	0.7565	0.6810	0.6926	0.5123	0.4574
auth1	0.4610	0.7339	0.6896	0.6919	0.4939	0.4566
auth2	0.4597	0.7366	0.6881	0.6926	0.4937	0.4554
MeSHLabeler	0.5004	0.8073	0.6907	0.7247	0.5593	0.4758
MeSHLabeler-2	0.4913	0.8101	0.6820	0.7199	0.5569	0.4635
MeSHLabeler-3	0.4852	0.8044	0.6700	0.7100	0.5553	0.4549
iria-1	0.3701	0.5300	0.6540	0.5677	0.3490	0.4211
BioASQ Filtering	0.4578	0.7451	0.6690	0.6792	0.5051	0.4494
UCSDLogReg	0.3679	0.7842	0.4822	0.5625	0.5109	0.3138
LABDA baseline	0.3971	0.7098	0.6160	0.6342	0.4463	0.3864
LABDA ElasticSearch	0.3229	0.3513	0.8140	0.4747	0.2394	0.5506
LargeElasticLABDA	0.3250	0.3486	0.8265	0.4742	0.2393	0.5643
d33p	0.1866	0.5281	0.1657	0.2396	0.3588	0.1348
CSX-1	0.2918	0.8562	0.3328	0.4469	0.5192	0.2199

+ Test batch 3, week 4

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5970	0.6414	0.5749	0.5778	0.5727	0.4808	0.4651	0.6392	0.5599	0.4286
Default MTI	0.6013	0.6030	0.6134	0.5822	0.5459	0.5222	0.4949	0.6075	0.5953	0.4304
auth1	0.6020	0.6118	0.6083	0.5914	0.5738	0.4663	0.4535	0.6174	0.5873	0.4386
auth2	0.6126	0.6210	0.6169	0.6002	0.5721	0.4929	0.4768	0.6283	0.5976	0.4480
auth3	0.1088	0.1046	0.1014	0.0969	0.0031	0.0036	0.0028	0.1113	0.1063	0.0549
auth5	0.1085	0.1040	0.1016	0.0967	0.0036	0.0038	0.0030	0.1106	0.1065	0.0548
MeSHLabeler	0.6482	0.6893	0.6329	0.6374	0.6312	0.5098	0.5012	0.6955	0.6069	0.4875
MeSHLabeler-1	0.6374	0.6784	0.6200	0.6258	0.6163	0.5017	0.4954	0.6820	0.5982	0.4744
MeSHLabeler-2	0.6399	0.6910	0.6142	0.6297	0.6315	0.4911	0.4848	0.6985	0.5903	0.4801
MeSHLabeler-3	0.6338	0.6836	0.6112	0.6250	0.6182	0.4885	0.4838	0.6895	0.5864	0.4746
iria-1	0.4222	0.3637	0.5142	0.4100	0.3079	0.3552	0.3194	0.3671	0.4967	0.2722
BioASQ Filtering	0.5953	0.5824	0.6203	0.5758	0.5511	0.4835	0.4616	0.5869	0.6039	0.4218
UCSDLogReg	0.5197	0.6653	0.4391	0.4889	0.5623	0.2466	0.2509	0.6387	0.4381	0.3436
LABDA baseline	0.5053	0.5370	0.5017	0.4926	0.4827	0.4731	0.4492	0.5346	0.4790	0.3411
LABDA ElasticSearch	0.3764	0.2683	0.6618	0.3693	0.2308	0.4957	0.3819	0.2647	0.6516	0.2346
LargeElasticLABDA	0.3783	0.2662	0.6774	0.3694	0.2295	0.5205	0.4014	0.2642	0.6661	0.2346
d33p	0.5197	0.6653	0.4391	0.4889	0.5623	0.2466	0.2509	0.6387	0.4381	0.3436
CSX-1	0.4291	0.7811	0.3104	0.4095	0.7294	0.1638	0.1766	0.7717	0.2971	0.2789

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4624	0.7593	0.6790	0.6877	0.5142	0.4533
Default MTI	0.4695	0.7249	0.7222	0.6967	0.4964	0.4821
auth1	0.4700	0.7279	0.7104	0.6979	0.4993	0.4701
auth2	0.4754	0.7326	0.7219	0.7066	0.5010	0.4795
auth3	0.1618	0.2226	0.2143	0.2032	0.1759	0.1655
auth5	0.1619	0.2214	0.2146	0.2030	0.1757	0.1659
MeSHLabeler	0.5001	0.7912	0.7215	0.7314	0.5492	0.4896
MeSHLabeler-1	0.4913	0.7847	0.7083	0.7217	0.5420	0.4789
MeSHLabeler-2	0.4949	0.7900	0.7093	0.7254	0.5486	0.4787
MeSHLabeler-3	0.4950	0.7886	0.7043	0.7221	0.5482	0.4775
iria-1	0.3720	0.5070	0.6673	0.5561	0.3452	0.4347
BioASQ Filtering	0.4660	0.7162	0.7196	0.6912	0.4879	0.4827
UCSDLogReg	0.3783	0.7729	0.4995	0.5671	0.5111	0.3325
LABDA baseline	0.4048	0.6841	0.6543	0.6413	0.4395	0.4114
LABDA ElasticSearch	0.3550	0.4122	0.7863	0.5237	0.2814	0.5289
LargeElasticLABDA	0.3562	0.4090	0.8024	0.5252	0.2801	0.5389
d33p	0.3783	0.7729	0.4995	0.5671	0.5111	0.3325
CSX-1	0.3066	0.8614	0.3547	0.4657	0.5361	0.2336

+ Test batch 3, week 5

System	MiF	EBP	EBR	EBF	MaP	MaR	MaF	MiP	MiR	Acc.
MTI First Line Index	0.5818	0.6331	0.5603	0.5663	0.5640	0.4837	0.4709	0.6259	0.5435	0.4131
Default MTI	0.5854	0.6036	0.5934	0.5711	0.5369	0.5173	0.4960	0.5967	0.5745	0.4165
auth1	0.5954	0.5887	0.6133	0.5793	0.5659	0.4776	0.4593	0.5948	0.5959	0.4247
auth2	0.5984	0.5922	0.6174	0.5826	0.5564	0.4971	0.4774	0.5979	0.5990	0.4285
MeSHLabeler	0.6295	0.6628	0.6226	0.6174	0.6135	0.5119	0.5017	0.6683	0.5949	0.4632
MeSHLabeler-1	0.6253	0.6593	0.6145	0.6126	0.6065	0.5080	0.5008	0.6673	0.5882	0.4583
MeSHLabeler-2	0.6239	0.6634	0.6118	0.6126	0.6100	0.4982	0.4897	0.6673	0.5858	0.4590
MeSHLabeler-3	0.6201	0.6581	0.6094	0.6107	0.5982	0.5003	0.4926	0.6634	0.5822	0.4567
BioASQ Filtering	0.5817	0.5843	0.5994	0.5641	0.5481	0.4821	0.4634	0.5794	0.5841	0.4091
UCSDLogReg	0.5183	0.6540	0.4365	0.4855	0.5856	0.2469	0.2530	0.6365	0.4372	0.3403
LABDA baseline	0.5018	0.5910	0.4784	0.4997	0.5432	0.4387	0.4287	0.5715	0.4473	0.3476
LABDA ElasticSearch	0.4348	0.3291	0.6618	0.4221	0.3272	0.5223	0.4386	0.3262	0.6514	0.2782
LargeElasticLABDA	0.4420	0.3314	0.6792	0.4285	0.3265	0.5490	0.4593	0.3306	0.6667	0.2829
d33p	0.5746	0.6150	0.5473	0.5507	0.5626	0.3897	0.3811	0.6143	0.5397	0.3978
CSX-1	0.4303	0.7842	0.3091	0.4102	0.7486	0.1866	0.1987	0.7784	0.2973	0.2800

System	LCA-F	HiP	HiR	HiF	LCA-P	LCA-R
MTI First Line Index	0.4574	0.7646	0.6738	0.6865	0.5141	0.4468
Default MTI	0.4661	0.7357	0.7085	0.6930	0.4992	0.4731
auth1	0.4703	0.7214	0.7171	0.6961	0.4906	0.4850
auth2	0.4709	0.7182	0.7223	0.6971	0.4865	0.4880
MeSHLabeler	0.4906	0.7818	0.7188	0.7232	0.5325	0.4893
MeSHLabeler-1	0.4895	0.7843	0.7087	0.7198	0.5343	0.4840
MeSHLabeler-2	0.4853	0.7769	0.7114	0.7182	0.5278	0.4807
MeSHLabeler-3	0.4876	0.7793	0.7072	0.7197	0.5309	0.4808
BioASQ Filtering	0.4566	0.7323	0.6959	0.6839	0.4886	0.4663
UCSDLogReg	0.3825	0.7801	0.5034	0.5727	0.5149	0.3362
LABDA baseline	0.4111	0.7412	0.6263	0.6485	0.4745	0.3970
LABDA ElasticSearch	0.3874	0.4901	0.7821	0.5812	0.3267	0.5240
LargeElasticLABDA	0.3884	0.4866	0.7894	0.5818	0.3249	0.5317
d33p	0.4458	0.7517	0.6443	0.6630	0.5069	0.4308
CSX-1	0.3063	0.8767	0.3570	0.4726	0.5308	0.2334

Platinum sponsors of the BioASQ Challenge between 2012 and 2023

Google was a proud sponsor of the BioASQ Challenge from 2018 to 2022.
BioASQ was supported by the National Library of Medicine of the National Institutes of Health under award number R13LM012214. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
The research leading to these results has received funding from the European Commission's Seventh Framework Programme (FP7/2007-2013, ICT-2011.4.4(d), Intelligent Information Management, Targeted Competition Framework) under grant agreement n° 318652.

BioASQ Participants Area

Test Results for Task 4a

+ Dry Run

Annotated articles:1389/2877

Flat Measures

Hierarchical Measures

+ Test batch 1, week 1

Annotated articles:1853/3740

Flat Measures

Hierarchical Measures

+ Test batch 1, week 2

Annotated articles:1578/2872

Flat Measures

Hierarchical Measures

+ Test batch 1, week 3

Annotated articles:1115/2599

Flat Measures

Hierarchical Measures

+ Test batch 1, week 4

Annotated articles:1436/3294

Flat Measures

Hierarchical Measures

+ Test batch 1, week 5

Annotated articles:1181/3210

Flat Measures

Hierarchical Measures

+ Test batch 2, week 1

Annotated articles:1080/3212

Flat Measures

Hierarchical Measures

+ Test batch 2, week 2

Annotated articles:901/3213

Flat Measures

Hierarchical Measures

+ Test batch 2, week 3

Annotated articles:850/2831

Flat Measures

Hierarchical Measures

+ Test batch 2, week 4

Annotated articles:800/3111

Flat Measures

Hierarchical Measures

+ Test batch 2, week 5

Annotated articles:688/2470

Flat Measures

Hierarchical Measures

+ Test batch 3, week 1

Annotated articles:305/2994

Flat Measures

Hierarchical Measures

+ Test batch 3, week 2

Annotated articles:507/3044

Flat Measures

Hierarchical Measures

+ Test batch 3, week 3

Annotated articles:501/3351

Flat Measures

Hierarchical Measures

+ Test batch 3, week 4

Annotated articles:514/2630

Flat Measures

Hierarchical Measures

+ Test batch 3, week 5

Annotated articles:627/3130

Flat Measures

Hierarchical Measures