On Platforms and Algorithms for Human-Centric Sensing

Abstract

The decreasing cost of chip manufacturing has greatly increased their distribution and availability such that sensors have become embedded in virtually all physical objects and are able to send and receive data -- giving rise to the Internet of Things (IoT). These embedded sensors are typically endowed with intelligent algorithms to transform information into real-time actionable insights. Recently, humans have taken on a larger role in the information-to-action path with the emergence of human-centric sensing. This has made it possible to observe various processes and infer information in complex personal and social spaces that may not be possible to obtain otherwise. However, a caveat of human-centric sensing is the high cost associated with high precision systems.

In this dissertation, we present two low cost and high performing end-to-end solutions for human-centric sensing of physiological phenomena. Additionally, we present a post-hoc data-driven sensor synchronization framework that exploits independent, omni-present information in the data to synchronize multiple sensors. We first propose XTREMIS -- a low-cost and portable ECG/EMG/EEG platform with a small form factor that has a sample rate comparable to research-grade EMG machines. We evaluate XTREMIS on a signal level as well as utilize it in tandem with a Gaussian Mixture Hidden Markov Model to detect finger movements in a rapid, fine-grained activity -- typing on a keyboard. Experiments show that not only does XTREMIS functionally outperforms current wearable technologies, its signal quality is high enough to achieve classification accuracy similar to research-grade EMG machines, making it a suitable platform for further research. We then present SiCILIA -- a platform that extracts physical and personal variables of a user's thermal environment to infer their clothing insulation. An individual's thermal sensation is directly correlated with the amount of clothing they are wearing. Indeed, a person's thermal comfort is crucial to their productivity and physical wellness, and is directly correlated with morale. Therefore it becomes important to be aware of actions such as adding or removing clothing as they are indicators of current thermal sensation. The proposed inference algorithm builds upon theories of body heat transfer, and is corroborated by empirical data. SiCILIA was tested in a vehicle with a passenger-controlled HVAC system. Experimental results show that the algorithm is capable of accurately predicting an occupant's thermal insulation with a low mean prediction error. In the third part of the thesis we present CRONOS -- a sensor data synchronization framework that takes advantage of events observed by two or more sensors to synchronize their internal clocks using only their data streams. Experimental results on pairwise and multi-sensor synchronization show a significant drift improvement for total drift and a very low mean absolute synchronization error for multi-sensor synchronization.