Projects
Structure-Augmented Intelligent Surfaces
Augment elastic surface with Miura-Ori Origami metastructure
Latest paper:
Rohal, Shubham, Carlos Ruiz, Yue Zhang, and Shijia Pan. "MOOCA: Muira-Ori Origami-Based Configurable Shelf-Liner for Autonomous Retail." In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems, pp. 776-777. 2022.
Augment rigid surface with the arc to change the propagation path
Latest paper:
Zhang, Yue, Carlos Ruiz, Shubham Rohal, and Shijia Pan. "CPA: Cyber-Physical Augmentation for Vibration Sensing in Autonomous Retails." In Proceedings of the 24th International Workshop on Mobile Computing Systems and Applications, pp. 8-14. 2023.
Vibrations of Everything
Physical and physiological information is essential for indoor human monitoring applications. In order to capture such information non-intrusively, we utilize/design sensors that can capture the vibration induced by people/body parts to infer a variance of activities (over different scales, both infrastructure and wearable) in the physical world. We explore new opportunities to utilize complementary information over different scales (on-body, room, city, etc.) to achieve accurate inference.
In-home activities of daily living (ADL) monitoring
Latest paper:
Hu, Zhizhang, Yue Zhang, Tong Yu, and Shijia Pan. "VMA: Domain Variance-and Modality-Aware Model Transfer for Fine-Grained Occupant Activity Recognition." In 2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), pp. 259-270. IEEE, 2022.
Retainer formed vibration sensor capturing oral activities induced vibration
Latest paper:
Pan, Shijia, Dong Yoon Lee, Jun Ho Lee, and Phuc Nguyen. "TeethVib: Monitoring Teeth Functional Occlusion Through Retainer Vibration Sensing." In 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE), pp. 92-96. IEEE, 2021.
Using vibrotactile inputs for fine-grained muscle profiling
Latest paper:
Rohal, Shubham, Shreya Shriram, V. P. Nguyen, and Shijia Pan. "FinePose: Fine-Grained Postural Muscle Profiling via Haptic Vibration Signals." In Proceedings of the 2022 Workshop on Body-centric Computing Systems, pp. 19-24. 2022.
AIoT Enabled Augmented Air Quality Monitoring
Coming Soon!
Sensing Quality Assessment and Augmentation
Data acquisition quality directly affects the information representative and the model accuracy in applications of real-world deployed cyber-physical systems. We combine physical and data-driven knowledge to design metrics and methods to assess the signal and dataset quality for particular sensing tasks.
Papers:
Zhang, Yue, Abdias Tellez Benitez, Reza Ehsani, and Shijia Pan. "DaQual: Data Quality Assessment for Tree Trunk Relative Water Content Sensors in a Pomegranate Orchard." In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems, pp. 1096-1101. 2022.
Hu, Zhizhang, Yue Zhang, and Shijia Pan. "Footstep-Induced Floor Vibration Dataset: Reusability and Transferability Analysis." In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems, pp. 546-551. 2021.
Zhang, Yue, Zhizhang Hu, Susu Xu, and Shijia Pan. "AutoQual: task-oriented structural vibration sensing quality assessment leveraging co-located mobile sensing context." CCF Transactions on Pervasive Computing and Interaction 3 (2021): 378-396.
Yu, Tong, Yue Zhang, Zhizhang Hu, Susu Xu, and Shijia Pan. "Vibration-based indoor human sensing quality reinforcement via Thompson sampling." In Proceedings of the First International Workshop on Cyber-Physical-Human System Design and Implementation, pp. 33-38. 2021.
Continual Multimodal Learning for CPS-IoT
The heterogeneity of cyber-physical systems brings challenges and opportunities for various applications. Our goal is to explore new methods to combine the complementary characteristics of multiple sensing modalities for accurate fine-grained learning with limited (labeled) data.
Papers:
Zhang, Yue, Zhizhang Hu, Uri Berger, and Shijia Pan. "CMA: Cross-Modal Association Between Wearable and Structural Vibration Signal Segments for Indoor Occupant Sensing." In The 22nd International Conference on Information Processing in Sensor Networks, pp. 96-109. 2023.
Hu, Zhizhang, Yue Zhang, Tong Yu, and Shijia Pan. "VMA: Domain Variance-and Modality-Aware Model Transfer for Fine-Grained Occupant Activity Recognition." In 2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), pp. 259-270. IEEE, 2022.
Pan, Shijia, Mario Berges, Juleen Rodakowski, Pei Zhang, and Hae Young Noh. "Fine-Grained Activity of Daily Living (ADL) Recognition Through Heterogeneous Sensing Systems With Complementary Spatiotemporal Characteristics." Frontiers in Built Environment 6 (2020): 560497.