Projects

Structure-Augmented Intelligent Surfaces

Augment elastic surface with Miura-Ori Origami metastructure

Latest  paper:
Rohal, Shubham, Carlos Ruiz, Yue Zhang, and Shijia Pan. "MOOCA: Muira-Ori Origami-Based Configurable Shelf-Liner for Autonomous Retail." In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems, pp. 776-777. 2022.

Augment rigid surface with the arc to change the propagation path

Latest  paper:
Zhang, Yue, Carlos Ruiz, Shubham Rohal, and Shijia Pan. "CPA: Cyber-Physical Augmentation for Vibration Sensing in Autonomous Retails." In Proceedings of the 24th International Workshop on Mobile Computing Systems and Applications, pp. 8-14. 2023.

Vibrations of Everything

Physical​ and physiological information is essential for indoor human monitoring applications. In order to capture such information non-intrusively, we utilize/design sensors that can capture the vibration induced by people/body parts to infer a variance of activities (over different scales, both infrastructure and wearable) in the physical world. We explore new opportunities to utilize complementary information over different scales (on-body, room, city, etc.) to achieve accurate inference.

In-home activities of daily living (ADL) monitoring

Latest paper:
Hu, Zhizhang, Yue Zhang, Tong Yu, and Shijia Pan. "VMA: Domain Variance-and Modality-Aware Model Transfer for Fine-Grained Occupant Activity Recognition." In 2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), pp. 259-270. IEEE, 2022.

Retainer formed vibration sensor capturing oral activities induced vibration

Latest paper:
Pan, Shijia, Dong Yoon Lee, Jun Ho Lee, and Phuc Nguyen. "TeethVib: Monitoring Teeth Functional Occlusion Through Retainer Vibration Sensing." In 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE), pp. 92-96. IEEE, 2021.

Using vibrotactile inputs for fine-grained muscle profiling 

Latest paper:
Rohal, Shubham, Shreya Shriram, V. P. Nguyen, and Shijia Pan. "FinePose: Fine-Grained Postural Muscle Profiling via Haptic Vibration Signals." In Proceedings of the 2022 Workshop on Body-centric Computing Systems, pp. 19-24. 2022.

AIoT Enabled Augmented Air Quality Monitoring

Coming Soon!

Sensing Quality Assessment and Augmentation

Data acquisition quality directly affects the information representative and the model accuracy in applications of real-world deployed cyber-physical systems. We combine physical and data-driven knowledge to design metrics and methods to assess the signal and dataset quality for particular sensing tasks.

Papers:
Zhang, Yue, Abdias Tellez Benitez, Reza Ehsani, and Shijia Pan. "DaQual: Data Quality Assessment for Tree Trunk Relative Water Content Sensors in a Pomegranate Orchard." In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems, pp. 1096-1101. 2022.

Hu, Zhizhang, Yue Zhang, and Shijia Pan. "Footstep-Induced Floor Vibration Dataset: Reusability and Transferability Analysis." In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems, pp. 546-551. 2021.

Zhang, Yue, Zhizhang Hu, Susu Xu, and Shijia Pan. "AutoQual: task-oriented structural vibration sensing quality assessment leveraging co-located mobile sensing context." CCF Transactions on Pervasive Computing and Interaction 3 (2021): 378-396.

Yu, Tong, Yue Zhang, Zhizhang Hu, Susu Xu, and Shijia Pan. "Vibration-based indoor human sensing quality reinforcement via Thompson sampling." In Proceedings of the First International Workshop on Cyber-Physical-Human System Design and Implementation, pp. 33-38. 2021.

Continual Multimodal Learning for CPS-IoT

The heterogeneity of cyber-physical systems brings challenges and opportunities for various applications. Our goal is to explore new methods to combine the complementary characteristics of multiple sensing modalities for accurate fine-grained learning with limited (labeled) data.

Papers:
Zhang, Yue, Zhizhang Hu, Uri Berger, and Shijia Pan. "CMA: Cross-Modal Association Between Wearable and Structural Vibration Signal Segments for Indoor Occupant Sensing." In The 22nd International Conference on Information Processing in Sensor Networks, pp. 96-109. 2023.

Hu, Zhizhang, Yue Zhang, Tong Yu, and Shijia Pan. "VMA: Domain Variance-and Modality-Aware Model Transfer for Fine-Grained Occupant Activity Recognition." In 2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), pp. 259-270. IEEE, 2022.

Pan, Shijia, Mario Berges, Juleen Rodakowski, Pei Zhang, and Hae Young Noh. "Fine-Grained Activity of Daily Living (ADL) Recognition Through Heterogeneous Sensing Systems With Complementary Spatiotemporal Characteristics." Frontiers in Built Environment 6 (2020): 560497.