Participants Selection for From-Scratch Mobile Crowdsensing via Reinforcement Learning:18th Annual IEEE International Conference on Pervasive Computing and Communications, PerCom 2020

Hu, Y. and Wang, J. and Wu, B. and Helal, S. (2020) Participants Selection for From-Scratch Mobile Crowdsensing via Reinforcement Learning:18th Annual IEEE International Conference on Pervasive Computing and Communications, PerCom 2020. In: 18th Annual IEEE International Conference on Pervasive Computing and Communications, 2020-03-232020-03-27.

Full text not available from this repository.


Participant selection is a major research challenge in Mobile Crowdsensing (MCS). Previous approaches commonly assume that adequately long and fixed periods of candidate participants' historical mobility trajectories are available before the selection process. This enables the frameworks to accurately model mobility which enables the optimization of selection. However, this assumption may not be realistic for newly-released MCS applications or platforms because the candidates have just boarded without previous mobility profiles. The sparsity or even absence of mobility traces will incur inaccurate location prediction of the individual participant, thus imposing negative effects on the participant selection process and hindering the practical deployment of new MCS applications. To this end, this paper investigates a novel problem called "From-Scratch MCS" (FS-MCS for short), in which we study how to intelligently select participants to minimize such "cold-start" effect. Specifically, we propose a novel framework based on reinforcement learning, which we name RL-Recruiter. With the gradual accumulation of mobility trajectories over time, RL-Recruiter can make a good sequence of participant selection decisions for each sensing slot by incrementally extracting and utilizing the collective mobility patterns of all candidate participants, thus avoiding the prediction of individual participant's location that is very inaccurate when the training data is sparse. We test our approach experimentally based on two real-world mobility datasets. Our experiment results demonstrate that RL-Recruiter outperforms the baseline approaches under various settings. © 2020 IEEE.

Item Type:
Contribution to Conference (Paper)
Journal or Publication Title:
18th Annual IEEE International Conference on Pervasive Computing and Communications
Additional Information:
Conference code: 161543 Export Date: 10 August 2020 Funding details: National Natural Science Foundation of China, NSFC Funding details: National Natural Science Foundation of China, NSFC, 61872010 Funding text 1: VIII. ACKNOWLEDGMENTS This work was supported by NSFC (National Natural Science Foundation of China) under Grant No. 61872010. References: Ganti, R.K., Ye, F., Lei, H., Mobile crowdsensing: Current state and future challenges (2011) IEEE Communications Magazine, 49, pp. 32-39; Guo, B., Wang, Z., Yu, Z., Mobile crowd sensing and computing: The review of an emerging human-powered sensing paradigm (2015) ACM Computing Surveys (CSUR), 48 (1), p. 7; Wang, J., Wang, L., Wang, Y., Zhang, D., Kong, L., Task allocation in mobile crowd sensing: State of the art and future opportunities (2018) IEEE Internet of Things Journal 2018, 5 (5), pp. 3747-3757; Reddy, S., Shilton, K., Burke, J., Estrin, D., Hansen, M., Srivastava, M., Using context annotated mobility profiles to recruit data collectors in participatory sensing (2009) Location and Context Awareness, pp. 52-69. , Springer; Estrin, R.D., Srivastava, M., Recruitment framework for participatory sensing data collections (2010) Proceedings of Pervasive, pp. 138-155; Cardone, G., Foschini, L., Bellavista, P., Corradi, A., Borcea, C., Talasila, M., Curtmola, R., Fostering participation in smart cities: A geo-social crowdsensing platform (2013) Communications Magazine, IEEE, 51 (6); Zhang, M., Yang, P., Tian, C., Tang, S., Quality-aware sensing coverage in budget constrained mobile crowdsensing networks (2015) IEEE Transactions on Vehicular Technology, p. 1; Zhang, D., Xiong, H., Wang, L., Chen, G., Crowdrecruiter: Selecting participants for piggyback crowdsensing under probabilistic coverage constraint (2014) Proc. ACM Joint Conference on Pervasive and Ubiquitous Computing (Ubicomp); Guo, B., Liu, Y., Wu, W., Activecrowd: A framework for optimized multitask allocation in mobile crowdsensing systems (2017) IEEE Transactions on Human-Machine Systems, 47 (3), pp. 392-403; Lane, N.D., Chon, Y., Zhou, L., Piggyback CrowdSensing (PCS): Energy efficient crowdsourcing of mobile sensor data by exploiting smartphone app opportunities (2013) Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems, p. 7. , November. ACM; Wang, L., Zhang, D., Wang, Y., Sparse mobile crowdsensing: Challenges and opportunities (2016) IEEE Communications Magazine, 54 (7), pp. 161-167; Song, Z., Liu, C.H., Wu, J., QoI-Aware multitask-oriented dynamic participant selection with budget constraints (2014) IEEE Transactions on Vehicular Technology, 63, pp. 4618-4632; Wang, J., Wang, Y., Zhang, D., Fine-grained multi-task allocation for participatory sensing with a shared budget (2016) Internet of Things Journal (In Press); Wang, J., Wang, Y., Zhang, D., PSAllocator: Multi-task allocation for participatory sensing with sensing capability constraints The ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 2017); Kazemi, L., Shahabi, C., Geocrowd: Enabling query answering with spatial crowdsourcing (2012) SIGSPATIAL GIS; Kazemi, L., Shahabi, C., Chen, L., Geotrucrowd: Trustworthy query answering with spatial crowdsourcing (2013) Proceedings of the 21st Sigspatial International Conference on Advances in Geographic Information Systems, pp. 314-323. , November. ACM; Cheng, P., Lian, X., Chen, L., Shahabi, C., Prediction-based task assignment in spatial crowdsourcing (2017) IEEE 33rd International Conference on Data Engineering, ICDE 2017, pp. 997-1008. , April. IEEE; Cheng, P., Lian, X., Chen, Z., Reliable diversity-based spatial crowdsourcing by moving workers VLDB; Liu, Q., Abdessalem, T., Wu, H., Yuan, Z., Brssan, S., Cost minimization and social fairness for spatial crowdsourcing tasks (2016) DASFAA; Hanshang, L., Li, T., Wang, Y., Dynamic participant recruitment of mobile crowd sensing for heterogeneous sensing tasks (2015) Mobile Ad Hoc and Sensor Systems (MASS), 2015 IEEE 12th International Conference On. IEEE; Li, H., Zhu, H., Du, S., Privacy leakage of location sharing in mobile social networks: Attacks and defense (2016) IEEE Transactions on Dependable and Secure Computing; Bilogrevic, I., Huguenin, K., Agir, B., A machine-learning based approach to privacy-aware information-sharing in mobile social networks (2016) Pervasive and Mobile Computing, 25, pp. 125-142; Wang, J., Wang, Y., Zhang, D., Learning-assisted optimization in mobile crowd sensing: A survey (2019) IEEE Transactions on Industrial Informatics, 15 (1), pp. 15-22; Karaliopoulos, M., Koutsopoulos, I., Titsias, M., First learn then earn: Optimizing mobile crowdsensing campaigns through data-driven user profiling (2016) Proceedings of the 17th ACM International Symposium on Mobile Ad Hoc Networking and Computing, pp. 271-280. , July. ACM; Han, K., Zhang, C., Luo, J., BLISS: Budget limited robust crowdsensing through online learning (2014) 2014 Eleventh Annual IEEE International Conference on Sensing, Communication, and Networking (SECON), pp. 555-563. , June. IEEE; Li, H., Li, T., Li, F., Cumulative participant selection with switch costs in large-scale mobile crowd sensing (2018) 27th International Conference on Computer Communication and Networks (ICCCN). IEEE, pp. 1-9; Liu, Y., Liu, M., An online learning approach to improving the quality of crowd-sourcing (2015) ACM SIGMETRICS Performance Evaluation Review. ACM, 43 (1), pp. 217-230; Zhang, X., Wu, Y., Huang, L., Expertise-aware truth analysis and task allocation in mobile crowdsourcing (2017) IEEE 37th International Conference on Distributed Computing Systems (ICDCS). IEEE, pp. 922-932; Restuccia, F., Ghosh, N., Bhattacharjee, S., Quality of information in mobile crowdsensing: Survey and research challenges (2017) ACM Transactions on Sensor Networks (TOSN), 13 (4), p. 34; Wang, J., Wang, Y., Zhang, D., Multi-task allocation in mobile crowd sensing with individual task quality assurance (2018) IEEE Transactions on Mobile Computing, 17 (9), pp. 2101-2113; Mnih, V., Kavukcuoglu, K., Silver, D., Human-level control through deep reinforcement learning (2015) Nature, 518 (7540), p. 529; Eunjoon, C., Myers, S.A., Leskovec, J., Friendship and mobility: User movement in location-based social networks (2011) Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM; Zheng, Y., Zhang, L., Xie, X., Ma, W., Mining interesting locations and travel sequences from GPS trajectories Proceedings of International Conference on World Wild Web (WWW 2009), Madrid Spain. ACM Press, pp. 791-800; Zhang, D., Zhao, J., Zhang, F., He, T., Urbancps: A cyber-physical system based on multi-source big infrastructure data for heterogeneous model integration (2015) The 6th ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS'15); Lika, B., Kolomvatsos, K., Hadjiefthymiades, S., Facing the cold start problem in recommender systems (2014) Expert Systems with Applications, 41 (4), pp. 2065-2073. , Mar 1; Devarakonda, S., Sevusu, P., Liu, H., Liu, R., Iftode, L., Nath, B., Real-time air quality monitoring through mobile sensing in metropolitan areas (2013) UrbComp, pp. 151-158; Hasenfratz, D., Saukh, O., Sturzenegger, S., Thiele, L., Participatory air pollution monitoring using smartphones (2012) 2nd International Workshop on Mobile Sensing; -
ID Code:
Deposited By:
Deposited On:
23 Jun 2021 14:30
Last Modified:
20 Oct 2021 06:30