A framework of energy efficient mobile sensing for automatic user state recognition

ABSTRACT

Urban sensing, participatory sensing, and user activity recognition can provide rich contextual information for mobile applications such as social networking and location-based services. However, continuously capturing this contextual information on mobile devices consumes huge amount of energy. In this paper, we present a novel design framework for an Energy Efficient Mobile Sensing System (EEMSS). EEMSS uses hierarchical sensor management strategy to recognize user states as well as to detect state transitions. By powering only a minimum set of sensors and using appropriate sensor duty cycles EEMSS significantly improves device battery life. We present the design, implementation, and evaluation of EEMSS that automatically recognizes a set of users' daily activities in real time using sensors on an off-the-shelf high-end smart phone. Evaluation of EEMSS with 10 users over one week shows that our approach increases the device battery life by more than 75% while maintaining both high accuracy and low latency in identifying transitions between end-user activities.

REFERENCES

• 1: Andrew T. Campbell , Shane B. Eisenman , Kristíf Fodor , Nicholas D. Lane , Hong Lu , Emiliano Miluzzo , Mirco Musolesi , Ronald A. Peterson , Xiao Zheng, Transforming the social networking experience with sensing presence from mobile phones, Proceedings of the 6th ACM conference on Embedded network sensor systems, November 05-07, 2008, Raleigh, NC, USA [doi>10.1145/1460412.1460455]
• 2: Baik Hoh , Marco Gruteser , Ryan Herring , Jeff Ban , Daniel Work , Juan-Carlos Herrera , Alexandre M. Bayen , Murali Annavaram , Quinn Jacobson, Virtual trip lines for distributed privacy-preserving traffic monitoring, Proceeding of the 6th international conference on Mobile systems, applications, and services, June 17-20, 2008, Breckenridge, CO, USA [doi>10.1145/1378600.1378604]
• 3: ]]Facebook. http://www.facebook.com.
• 4: ]]MySpace. http://www.myspace.com.
• 5: Hans W. Gellersen , Albercht Schmidt , Michael Beigl, Multi-sensor context-awareness in mobile devices and smart artifacts, Mobile Networks and Applications, v.7 n.5, p.341-351, October 2002 [doi>10.1023/A:1016587515822]
• 6: Thomas Stiefmeier , Daniel Roggen , Georg Ogris , Paul Lukowicz , Gerhard Tröster, Wearable Activity Tracking in Car Manufacturing, IEEE Pervasive Computing, v.7 n.2, p.42-50, April 2008 [doi>10.1109/MPRV.2008.40]
• 7: Adrienne Andrew , Yaw Anokwa , Karl Koscher , Jonathan Lester , Gaetano Borriello, Context to Make You More Aware, Proceedings of the 27th International Conference on Distributed Computing Systems Workshops, p.49, June 22-29, 2007 [doi>10.1109/ICDCSW.2007.30]
• 8: ]]J. Lester, B. Hannaford, and G. Borriello. Are you with me?-using accelerometers to determine if two devices are carried by the same person. In Pervasive Computing pages 33--50, 2004.
• 9: Tanzeem Choudhury , Gaetano Borriello , Sunny Consolvo , Dirk Haehnel , Beverly Harrison , Bruce Hemingway , Jeffrey Hightower , Predrag Pedja Klasnja , Karl Koscher , Anthony LaMarca , James A. Landay , Louis LeGrand , Jonathan Lester , Ali Rahimi , Adam Rea , Danny Wyatt, The Mobile Sensing Platform: An Embedded Activity Recognition System, IEEE Pervasive Computing, v.7 n.2, p.32-41, April 2008 [doi>10.1109/MPRV.2008.39]
• 10: Nicholas D. Lane , Hong Lu , Shane B. Eisenman , Andrew T. Campbell, Cooperative Techniques Supporting Sensor-Based People-Centric Inferencing, Proceedings of the 6th International Conference on Pervasive Computing, May 19-22, 2008, Sydney, Australia [doi>10.1007/978-3-540-79576-6_5]
• 11: ]]P. Zappi, T. Stiefmeier, E. Farella, D. Roggen, L. Benini, and G. Troster. Activity recognition from on-body sensors by classifier fusion:sensor scalability and robustness. In Proceedings of ISSNIP 2007.
• 12: ]]L. Bao and S. S. Intille. Activity recognition from user-annotated acceleration data. Pervasive Computing pages 1--17, 2004.
• 13: Albrecht Schmidt , Kofi Asante Aidoo , Antti Takaluoma , Urpo Tuomela , Kristof Van Laerhoven , Walter Van de Velde, Advanced Interaction in Context, Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing, p.89-101, September 27-29, 1999, Karlsruhe, Germany
• 14: ]]J. Burke, D. Estrin, M. Hansen, A. Parker, N. Ramanathan, S. Reddy, and M. B. Srivastava. Participatory sensing. In WSW Workshop at SenSys Boulder, Colorado, USA, 2006.
• 15: Daniel Siewiorek , Asim Smailagic , Junichi Furukawa , Andreas Krause , Neema Moraveji , Kathryn Reiger , Jeremy Shaffer , Fei Lung Wong, SenSay: A Context-Aware Mobile Phone, Proceedings of the 7th IEEE International Symposium on Wearable Computers, p.248, October 21-23, 2003
• 16: ]]E. Miluzzo, N. D. Lane, S. B. Eisenman, and A. T. Campbell. Cenceme -injecting sensing presence into social networking applications. In Gerd Kortuem, Joe Finney, Rodger Lea, and Vasughi Sundramoorthy, editors, EuroSSC volume 4793 of Lecture Notes in Computer Science pages 1--28. Springer, 2007.
• 17: Emiliano Miluzzo , Nicholas D. Lane , Kristóf Fodor , Ronald Peterson , Hong Lu , Mirco Musolesi , Shane B. Eisenman , Xiao Zheng , Andrew T. Campbell, Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application, Proceedings of the 6th ACM conference on Embedded network sensor systems, November 05-07, 2008, Raleigh, NC, USA [doi>10.1145/1460412.1460445]
• 18: Shravan Gaonkar , Jack Li , Romit Roy Choudhury , Landon Cox , Al Schmidt, Micro-Blog: sharing and querying content through mobile phones and social participation, Proceeding of the 6th international conference on Mobile systems, applications, and services, June 17-20, 2008, Breckenridge, CO, USA [doi>10.1145/1378600.1378620]
• 19: ]]E. Welbourne, J. Lester, A. LaMarca, and G. Borriello. Mobile context inference using low-cost sensors. In Workshop on Location- and Context-Awareness Boulder, Colorado, USA, 2005.
• 20: Prashanth Mohan , Venkata N. Padmanabhan , Ramachandran Ramjee, Nericell: rich monitoring of road and traffic conditions using mobile smartphones, Proceedings of the 6th ACM conference on Embedded network sensor systems, November 05-07, 2008, Raleigh, NC, USA [doi>10.1145/1460412.1460444]
• 21: ]]K. Whitesell, B. Kutler, N. Ramanathan, and D. Estrin. Determining indoor air quality from images of an air filter captured on cell phones. In ImageSense Workshop at SenSys Raleigh, NC, USA, 2008.
• 22: ]]J. Lester, T. choudhury, G. Borriello, S. Consolvo, J. Landay, K. Everitt, and I. Smith. Sensing and modeling activities to support physical fitness. In Proceedings of UbiComp Tokyo, Japan, 2005.
• 23: Muhannad Quwaider , Subir Biswas, Body posture identification using hidden Markov model with a wearable sensor network, Proceedings of the ICST 3rd international conference on Body area networks, March 13-17, 2008, Tempe, Arizona
• 24: ]]M. Annavaram, N. Medvidovic, U. Mitra, S. Narayanan, D. Spruijt-Metz, G. Sukhatme, Z. Meng, S. Qiu, R. Kumar, and G. Thatte. Multimodal sensing for pediatric obesity applications. In UrbanSense08 Workshop at SenSys Raleigh, NC, USA, November 2008.
• 25: ]]T. Gao, C. Pesto, L. Selavo, Y. Chen, J. Ko, J. Kim, A. Terzis, A. Watt, J. Jeng, B. Chen, K. Lorincz, and M. Welsh. Wireless medical sensor networks in emergency response:Implementation and pilot results. In HST Waltham, MA, USA, May 2008.
• 26: ]]D. Jea, J. Liu, T. Schmid, and M. Srivastava. Hassle free fitness monitoring. In HealthNet Workshop at MobiSys Brekenridge, CO, USA, 2008.
• 27: Winston Wu , Lawrence Au , Brett Jordan , Thanos Stathopoulos , Maxim Batalin , William Kaiser , Alireza Vahdatpour , Majid Sarrafzadeh , Meika Fang , Joshua Chodosh, The SmartCane system: an assistive device for geriatrics, Proceedings of the ICST 3rd international conference on Body area networks, March 13-17, 2008, Tempe, Arizona
• 28: Marc A Viredaz , Lawrence S Brakmo , William R Hamburgen, Energy Management on Handheld Devices, Queue, v.1 n.7, 10-01-2003 [doi>10.1145/957717.957768]
• 29: Andreas Krause , Matthias Ihmig , Edward Rankin , Derek Leong , Smriti Gupta , Daniel Siewiorek , Asim Smailagic , Michael Deisher , Uttam Sengupta, Trading off Prediction Accuracy and Power Consumption for Context-Aware Wearable Computing, Proceedings of the Ninth IEEE International Symposium on Wearable Computers, p.20-26, October 18-21, 2005 [doi>10.1109/ISWC.2005.52]
• 30: Padmanabhan Pillai , Kang G. Shin, Real-time dynamic voltage scaling for low-power embedded operating systems, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 31: Eugene Shih , Paramvir Bahl , Michael J. Sinclair, Wake on wireless: an event driven energy saving strategy for battery operated devices, Proceedings of the 8th annual international conference on Mobile computing and networking, September 23-28, 2002, Atlanta, Georgia, USA [doi>10.1145/570645.570666]
• 32: Jacob Sorber , Nilanjan Banerjee , Mark D. Corner , Sami Rollins, Turducken: hierarchical power management for mobile devices, Proceedings of the 3rd international conference on Mobile systems, applications, and services, June 06-08, 2005, Seattle, Washington [doi>10.1145/1067170.1067198]
• 33: Seungwoo Kang , Jinwon Lee , Hyukjae Jang , Hyonik Lee , Youngki Lee , Souneil Park , Taiwoo Park , Junehwa Song, SeeMon: scalable and energy-efficient context monitoring framework for sensor-rich mobile environments, Proceeding of the 6th international conference on Mobile systems, applications, and services, June 17-20, 2008, Breckenridge, CO, USA [doi>10.1145/1378600.1378630]
• 34: ]]Nokia Energy Profiler. http://www.forum.nokia.com/main/resources/user experience/powermanagement/nokia energy profiler/.
• 35: ]]SKYHOOK Wireless. http://www.skyhookwireless.com/.
• 36: ]]G. Lu and T. Hankinson. A technique towards automatic audio classification and retrieval. In Proceedings of ICSP Beijing, China, 1998.
• 37: ]]B. Gajic and K. K. Paliwal. Robust speech recognition in noisy environments based on subband spectral centroid histograms. In IEEE Transactions on speech and audio processing pages 600--608, 2006.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.3 SPECIAL-PURPOSE AND APPLICATION-BASED SYSTEMS

General Terms:
Design, Experimentation, Measurement, Performance

Keywords:
eemss, energy efficiency, human state recognition, mobile sensing