Recent Projects


Overview of recent projects

Full Publication List

2024

 

WatchLink: Enhancing Smartwatches with Sensor Add-Ons via ECG Interface

Anandghan Waghmare, Ishan Chatterjee, Vikram Iyer, Shwetak Patel
Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology
PDF Video

 

From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models

Zachary Englhardt, Jack (Chengqian) Ma, Margaret E Morris, Chun-Cheng Chang, Xuhai "Orson" Xu, Lianhui Qin, Daniel McDuff, Xin Liu, Shwetak Patel, Vikram Iyer
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2024
PDF Code

 

LabelAId: Just-in-time AI Interventions for Improving Human Labeling Quality and Domain Knowledge in Crowdsourcing Systems

Chu Li, Zhihan Zhang, Michael Saugstad, Esteban Safranchik, Minchu Kulkarni, Xiaoyu Huang, Shwetak Patel, Vikram Iyer, Tim Althoff, Jon Froehlich
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI), 2024
PDF

 

"I will just have to keep driving": A Mixed-methods Investigation of Lack of Agency within the Thai Motorcycle Rideshare Driver Community

Nussara Tienklin, Joseph Breda, Tim Althoff, Kurtis Heimerl
Proceedings of the ACM conference on Computer Supported Cooperative Work (CSCW1), 2024
PDF

 

Recyclable vitrimer-based printed circuit boards for sustainable electronics

Zhihan Zhang, Agni K. Biswal, Ankush Nandi, Kali Frost, Jake A. Smith, Bichlien H. Nguyen, Shwetak Patel, Aniruddh Vashisth, Vikram Iyer
Nature Sustainability, 2024
PDF Page

 

DeltaLCA: Comparative Life-Cycle Assessment for Electronics Design

Zhihan Zhang, Felix Hähnlein, Yuxuan Mei, Zachary Englhardt, Shwetak Patel, Adriana Schulz, Vikram Iyer
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2024
PDF

 

Thermal Earring: Low-power Wireless Earring for Longitudinal Earlobe Temperature Sensing

Qiuyue (Shirley) Xue, Yujia (Nancy) Liu, Joseph Breda, Mastafa Springston, Vikram Iyer, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2024
PDF

2023

 

BigSmall: Efficient Multi-Task Learning for Disparate Spatial and Temporal Physiological Measurements

Girish Narayanswamy, Yujia (Nancy) Liu, Yuzhe Yang, Jack (Chengqian) Ma, Xin Liu, Daniel McDuff, Shwetak Patel
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2024)
PDF Page Code

 

Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurement

Akshay Paruchuri, Xin Liu, Yulu Pan, Shwetak Patel, Daniel McDuff, Soumyadip Sengupta
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2024), Oral, Top 2.7%, 53 out of 2042 Submissions
PDF Page Code

 

BusStopCV: A Real-time AI Assistant for Labeling Bus Stop Accessibility Features in Streetscape Imagery

Minchu Kulkarni, Chu Li, Jaye Jungmin Ahn, Katrina Oi Yau Ma, Zhihan Zhang, Michael Saugstad, Kevin Wu, Yochai Eisenberg, Valerie Novack, Brent Chamberlain, Jon Froehlich
Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS), 2023
PDF

 

OptiRing: Low-Resolution Optical Sensing for Subtle Thumb-to-Index Micro-Interactions

Anandghan Waghmare, Roger Boldu, Eric Whitmire, Wolf Kienzle
SUI '23: Proceedings of the 2023 ACM Symposium on Spatial User Interaction
PDF Video

 

MilliMobile: An Autonomous Battery-free Wireless Microrobot

Kyle Johnson, Zachary Englhardt, Vicente Arroyos, Dennis Yin, Shwetak Patel, Vikram Iyer
Proceedings of the 29th Annual International Conference on Mobile Computing and Networking (MobiCom 2023)
PDF Video

 

MMTSA: Multi-Modal Temporal Segment Attention Network for Efficient Human Activity Recognition

Ziqi Gao, Yuntao Wang, Jiaguo Chen, Junliang Xing, Shwetak Patel, Xin Liu, Yuanchun Shi
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2023
PDF

 

rPPG-Toolbox: Deep Remote PPG Toolbox

Xin Liu, Girish Narayanswamy, Akshay Paruchuri, Xiaoyu Zhang, Jiankai Tang, Yuzhe Zhang, Yuntao Wang, Soumyadip Sengupta, Shwetak Patel, Daniel McDuff
Conference on Neural Information Processing Systems (NeurIPS’ 23) Datasets and Benchmarks Track
PDF Code

 

MMPD: Multi-Domain Mobile Video Physiology Dataset

Jiankai Tang, Kequan Chen, Yuntao Wang, Yuanchun Shi, Shwetak Patel, Daniel McDuff, Xin Liu
45th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2023
PDF Code

 

Z-Ring: Single-Point Bio-Impedance Sensing for Gesture, Touch, Object and User Recognition

Anandghan Waghmare, Youssef Ben Taleb, Ishan Chatterjee, Arjun Narendra, Shwetak Patel
Conference on Human Factors in Computing Systems (CHI), 2023
PDF Video

 

Understanding People’s Concerns and Attitudes Toward Smart Cities

Pardis Emami-Naeini, Joseph Breda, Wei Dai, Tadayoshi Kohno, Kim Laine, Shwetak Patel, Franziska Roesner
Conference on Human Factors in Computing Systems (CHI), 2023
PDF

 

AdHocProx: Sensing Mobile, Ad-Hoc Collaborative Device Formations using Dual Ultra-Wideband Radios

Richard Li, Teddy Seyed, Nicolai Marquardt, Eyal Ofek, Steve Hodges, Mike Sinclair, Hugo Romat, Michel Pahud, Jatin Sharma, William A.S. Buxton, Ken Hinckley, Nathalie Riche
Conference on Human Factors in Computing Systems (CHI), 2023
PDF

 

GlucoScreen: A Smartphone-based Readerless Glucose Test Strip for Prediabetes Screening

Anandghan Waghmare, Farshid Salemi Parizi, Jason Hoffman, Yuntao Wang, Matthew Thompson, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/Ubicomp 2023)
PDF Video

 

FeverPhone: Accessible Core-Body Temperature Sensing for Fever Monitoring Using Commodity Smartphones

Joseph Breda, Mastafa Springston, Alex Mariakakis, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/Ubicomp 2023), Distinguished Paper Award
PDF

 

GLOBEM: Cross-Dataset Generalization of Longitudinal Human Behavior Modeling

Xuhai Xu, Xin Liu, Han Zhang, Weichen Wang, Subigya Kumar Nepal, Kevin S. Kuehn, Jeremy F Huckins, Margaret E Morris, Paula S. Nurius, Eve Ann Riskin, Shwetak Patel, Tim Althoff, Andrew Campbell, Anind Dey, Jennifer Mankoff
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/Ubicomp 2023), Distinguished Paper Award / Best Paper Award
PDF Code

 

Evaluating a Novel, Portable, Self-Administrable Device (“Beacon”) That Measures Critical Flicker Frequency as a Test for Hepatic Encephalopathy

Philip Vutien, Richard Li, Ravi Karkar, Sean A. Munson, James Fogarty, Kara Walter, Michael Yacoub, George Lounnou
The American Journal of GASTROENTEROLOGY
PDF

 

Efficientphys: Enabling simple, fast and accurate camera-based vitals measurement

Xin Liu, Brian Hill, Ziheng Jiang, Shwetak Patel, Daniel McDuff
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2023)
PDF

2022

 

SCAMPS: Synthetics for Camera Measurement of Physiological Signals

Daniel McDuff, Miah Wander, Xin Liu, Brian Hill, Javier Hernandez, Jonathan Lester, Tadas Baltrusaitis
Conference on Neural Information Processing Systems (NeurIPS' 22) Datasets and Benchmarks Track
PDF Code

 

GLOBEM Dataset: Multi-Year Datasets for Longitudinal Human Behavior Modeling Generalization

Xuhai Xu, Han Zhang, Yasaman S Sefidgar, Yiyi Ren, Xin Liu, Woosuk Seo, Jennifer Brown, Kevin Scott Kuehn, Mike A Merrill, Paula S Nurius, Shwetak Patel, Tim Althoff, Margaret E Morris, Eve A. Riskin, Jennifer Mankoff, Anind Dey
Conference on Neural Information Processing Systems (NeurIPS' 22) Datasets and Benchmarks Track
PDF Code

 

Smartphone camera oximetry in an induced hypoxemia study

Jason Hoffman, Varun Viswanath, Caiwei Tian, Xinyi Ding, Matthew J. Thompson, Eric C. Larson, Shwetak Patel, Edward Wang
npj Digital Medicine, 2022
PDF Code

 

Automatic Classification of Audio Uroflowmetry with a Smartwatch

Girish Narayanswamy, Laura Arjona, Luis E. Diez, Alfonso Bahillo, Shwetak Patel
44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2022
PDF

 

ClearBuds: wireless binaural earbuds for learning-based speech enhancement

Ishan Chatterjee, Maruchi Kim, Vivek Jayaram, Shyamnath Gollakota, Ira Kemelmacher, Shwetak Patel, Steven M. Seitz
Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services (MobiSys '22)
PDF Video

 

Passively Sensing SARS-CoV-2 RNA in Public Transit Buses

Jason Hoffman, Matthew Hirano, Nuttada Panpradist, Joseph Breda, Parker Ruth, Yuanyi Xu, Jonathan Lester, Bichlien H. Nguyen, Luis Ceze, Shwetak Patel
Science of The Total Environment, 2022
PDF

 

LuckyChirp: Opportunistic Respiration Sensing Using Cascaded Sonar on Commodity Devices

Qiuyue (Shirley) Xue, D Shin, Anupam Pathak, Jake Garrison, Jonathan Hsu, Mark Malhotra, Shwetak Patel
IEEE Percom, 2022
PDF Video

 

FaceOri: Tracking Head Position and Orientation Using Ultrasonic Ranging on Earphones

Yuntao Wang, Jiexin Deng, Ishan Chatterjee, Farshid Salemi Parizi, Yuzhou Zhuang, Yukang Yan, Shwetak Patel, Yuanchun Shi
Conference on Human Factors in Computing Systems (CHI), 2022
PDF

 

Federated Remote Physiological Measurement with Imperfect Data

Xin Liu, Mingchuan Zhang, Ziheng Jiang, Shwetak Patel, Daniel McDuff
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2022
PDF

 

Using High-Fidelity Avatars to Advance Camera-based Cardiac Pulse Measurement

Daniel McDuff, Javier Hernandez, Xin Liu, Erroll Wood, Tadas Baltrusaitis
IEEE Transactions on Biomedical Engineering, 2022
PDF

 

MobilePhys: Personalized Mobile Camera-Based Contactless Physiological Sensing

Xin Liu, Yuntao Wang, Sinan Xie, Xiaoyu Zhang, Zixian Ma, Daniel McDuff, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2022
PDF

 

O-pH: Optical pH Monitor to Measure Oral Biofilm Acidity and Assist in Enamel Health Monitoring

Manuja Sharma, Lauren K. Lee, Matthew D. Carson, David S. Park, Se W. An, Micah G. Bovenkamp, Jess J. Cayetano, Ian A. Berude, Leonard Y. Nelson, Zheng Xu, Alireza Sadr, Shwetak Patel, Eric J. Seibel
IEEE Transactions on Biomedical Engineering, 2022, Featured Article of the Issue
PDF

2021

 

Reliable and Trustworthy Machine Learning for Health Using Dataset Shift Detection

Chunjong Park, Anas Awadalla, Tadayoshi Kohno, Shwetak Patel
Conference on Neural Information Processing Systems (NeurIPS 2021)
PDF

 

FRILL: A Non-Semantic Speech Embedding for Mobile Devices

Jacob Peplinski, Joel Shor, Sachin Joglekar, Jake Garrison, Shwetak Patel
INTERSPEECH, 2021
PDF

 

Augmented Silkscreen: Designing AR Interactions for Debugging Printed Circuit Boards

Ishan Chatterjee, Olga Khvan, Tadeusz Pforte, Richard Li, Shwetak Patel
ACM Designing Interactive Systems Conference (DIS), 2021
PDF Video

 

Synthetic Data for Multi-Parameter Camera-Based Physiological Sensing

Daniel McDuff, Xin Liu, Javier Hernandez, Erroll Wood, Tadas Baltrusaitis
43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2021
PDF

 

Facilitating Text Entry on Smartphones with QWERTY Keyboard for Users with Parkinson’s Disease

Yuntao Wang, Ao Yu, Xin Yi, Yuanwei Zhang, Ishan Chatterjee, Shwetak Patel, Yuanchun Shi
Conference on Human Factors in Computing Systems (CHI), 2021
PDF Video

 

Understanding the Design Space of Mouth Microgestures

Victor Chen, Xuhai Xu, Richard Li, Yuanchun Shi, Shwetak Patel, Yuntao Wang
ACM Designing Interactive Systems Conference (DIS), 2021
PDF

 

Online Mobile App Usage as an Indicator of Sleep Behavior and Job Performance

Chunjong Park, Morelle Arian, Xin Liu, Leon Sasson, Jeffrey Kahn, Alex Mariakakis, Shwetak Patel, Tim Althoff
The Web Conference (WWW), 2021
PDF

 

The Design and Evaluation of a Mobile System for Rapid Diagnostic Test Interpretation

Chunjong Park, Hung Ngo, Libby Lavitt, Vincent Karuri, Shiven Bhatt, Peter Lubell-Doughtie, Anuraj H. Shankar, Leonard Ndwiga, Victor Osoti, Juliana K. Wambua, Philip Bejon, Lynette Isabella Ochola-Oyier, Monique Chilver, Nigel Stocks, Victoria Lyon, Barry R. Lutz, Matthew Thompson, Alex Mariakakis, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2021
PDF

 

MetaPhys: Few-Shot Adaptation for Non-Contact Physiological Measurement

Xin Liu, Ziheng Jiang, Josh Fromm, Xuhai Xu, Shwetak Patel, Daniel McDuff
ACM Conference on Health, Inference, and Learning (ACM-CHIL), 2021
PDF

 

SplitSR: An End-to-End Approach to Super-Resolution on Mobile Devices

Xin Liu, Yuang Li, Josh Fromm, Yuntao Wang, Ziheng Jiang, Alex Mariakakis, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2021
PDF

2020

 

Optical Gaze Tracking with Spatially-Sparse Single-Pixel Detectors

Richard Li, Eric Whitmire, Michael Stengel, Ben Boudaoud, Jan Kautz, David Luebke, Shwetak Patel, Kaan Akşit
2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
PDF Video

 

ePerceptive: Energy Reactive Embedded Intelligence for Batteryless Sensors

Alessandro Montanari, Manuja Sharma, Dainius Jenkus, Mohammed Alloulah, Lorena Qendro, and Fahim Kawsar
ACM SenSys 2020
PDF

 

Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement

Xin Liu, Josh Fromm, Shwetak Patel, Daniel McDuff
Conference on Neural Information Processing Systems (NeurIPS 2020), Oral, Top 1%, 105 out of 9454 Submissions
PDF Code

 

Multi-Channel Facial Photoplethysmography Sensing

Parker Ruth, Jerry Cao, Millicent Li, Edward Wang, Jacob Sunshine, Shwetak Patel
42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2020
PDF Video

 

Supporting Smartphone-Based Image Capture of Rapid Diagnostic Tests in Low-Resource Settings

Chunjong Park, Alex Mariakakis, Jane Yang, Diego Lassala, Yasamba Djiguiba, Youssouf Keita, Hawa Diarra, Beatrice Wasunna, Fatou Fall, Marème Soda Gaye, Bara Ndiaye, Ari Johnson, Isaac Holeman, Shwetak Patel
International Conference on Information and Communication Technologies and Development (ICTD), 2020
PDF

 

Whosecough: In-the-Wild Cougher Verification Using Multitask Learning

Matt Whitehill, Jake Garrison, Shwetak Patel
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020
PDF

 

MoveVR: Enabling Multiform Force Feedback in Virtual Reality using Household Cleaning Robot

Yuntao Wang, Zichao (Tyson) Chen, Hanchuan Li, Zhengyi Cao, Huiyi Luo, Tengxiang Zhang, Ke Ou, John Raiti, Chun Yu, Shwetak Patel, Yuanchun Shi
Conference on Human Factors in Computing Systems (CHI), 2020
PDF

 

UbiquiTouch: Self Sustaining Ubiquitous Touch Interfaces

Anandghan Waghmare, Qiuyue (Shirley) Xue, Dingtian Zhang, Yuhui Zhao, Shivan Mittal, Nivedita Arora, C. Byrne, Thad Starner, G. Abowd
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2020
PDF Video

 

Riptide: Fast End-to-End Binarized Neural Networks

Josh Fromm, Meghan Cowan, Matthai Philipose, Luis Ceze, Shwetak Patel
Proceedings of Machine Learning and Systems, 2020
PDF

2019

 

AuraRing: Precise Electromagnetic Finger Tracking

Farshid Salemi Parizi, Eric Whitmire, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2020
PDF Video

 

FlexTouch: Enabling Large-Scale Interaction Sensing Beyond Touchscreens Using Flexible and Conductive Materials

Yuntao Wang, Jianyu Zhou, Hanchuan Li, Tengxiang Zhang, Minxuan Gao, Zhuolin Cheng, Chun Yu, Shwetak Patel, Yuanchun Shi
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2019
PDF

 

Challenges in Realizing Smartphone-based Health Sensing

Alex Mariakakis, Edward Wang, Mayank Goel, Shwetak Patel
IEEE Pervasive Computing, 2019, Best Paper Runner-Up
PDF

 

Aura: Inside-out Electromagnetic Controller Tracking

Eric Whitmire, Farshid Salemi Parizi, Shwetak Patel
17th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys), 2019
PDF Video

 

IDCam: Precise Item Identification for AR Enhanced Object Interactions

Hanchuan Li, Eric Whitmire, Alex Mariakakis, Victor Chan, Alanson P. Sample, Shwetak Patel
13th Annual IEEE International Conference on RFID, 2019, Best Paper Nominee
PDF Video

 

IDAct: Towards Unobtrusive Recognition of User Presence and Daily Activities

Hanchuan Li, Chieh-yih Wan, Rahul C. Shah, Alanson P. Sample, Shwetak Patel
13th Annual IEEE International Conference on RFID, 2019
PDF

 

Optical pH measurement system using a single fluorescent dye for assessing susceptibility to dental caries

Manuja Sharma, Jasmine Y. Graham, Philip A. Walczak, Ryan M. Nguyen, Lauren K. Lee, Matthew D. Carson, Leonard Y. Nelson, Shwetak Patel, Zheng Xu, Eric J. Seibel
Journal of Biomedical Optics, 2019
PDF

2018

 

Heterogeneous Bitwidth Binarization in Convolutional Neural Networks

Josh Fromm, Shwetak Patel, Matthai Philipose
Conference on Neural Information Processing Systems (NeurIPS 2018)
PDF

 

FarmChat: A Conversational Agent to Answer Farmer Queries

Mohit Jain, Pratyush Kumar, Ishita Bhansali, Q. Vera Liao, Khai Truong, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2018
PDF Video

 

RoyalFlush: Non-Invasive Water Level Monitor to Prevent Toilet Overflows

Farshid Salemi Parizi, Josh Fromm, Shantanu Deshpande, Shwetak Patel
Proceedings of the 8th International Conference on the Internet of Things, 2018
PDF

 

CASPER: Capacitive Serendipitous Power Transfer for Through-body Charging of Multiple Wearable Devices

Edward Wang, Manuja Sharma, Yiran Zhao, Shwetak Patel
ACM International Symposium on Wearable Computers (ISWC), 2018
PDF

 

CapHarvester: A Stick-on Capacitive Energy Harvester Using Stray Electric Field from AC Power Lines

Manoj Gulati, Farshid Salemi Parizi, Eric Whitmire, Sidhant Gupta, Shobha Ram, Amarjeet Singh, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2018
PDF

 

SpiroConfidence: Determining the Validity of Smartphone Based Spirometry Using Machine Learning

Varun Viswanath, Jake Garrison, Shwetak Patel
Engineering in Medicine and Biology Conference (EMBC) 2018
PDF

 

Evaluating and Informing the Design of Chatbots

Mohit Jain, Pratyush Kumar, Ramachandra Kota, Shwetak Patel
ACM Conference on Designing Interactive Systems (DIS), 2018
PDF

 

Drunk User Interfaces: Determining Blood Alcohol Level through Everyday Smartphone Tasks

Alex Mariakakis, Sayna Parsi, Shwetak Patel, Jacob O. Wobbrock
Conference on Human Factors in Computing Systems (CHI), 2018
PDF

 

Convey: Exploring the Use of a Context View for Chatbots

Mohit Jain, Ramachandra Kota, Pratyush Kumar, Shwetak Patel
Conference on Human Factors in Computing Systems (CHI), 2018
PDF Video

 

Seismo: Blood Pressure Monitoring using Built-in Smartphone Accelerometer and Camera

Edward Wang, Junyi Zhu, Mohit Jain, Tien-jui Lee, Elliot Saba, Lama Nachman, Shwetak Patel
Conference on Human Factors in Computing Systems (CHI), 2018, Honorable Mention Award
PDF Video

 

Opportunistic Sensing with Mic Arrays on Smart Speakers for Distal Interaction and Exercise Tracking

Anup Agarwal, Mohit Jain, Pratyush Kumar, Shwetak Patel
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2018
PDF

 

Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller

Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, Mike Sinclair
Conference on Human Factors in Computing Systems (CHI), 2018, Honorable Mention Award
PDF Video

2017

 

Carpacio: Repurposing Capacitive Sensors to Distinguish Driver and Passenger Touches on In-Vehicle Screens

Edward Wang, Jake Garrison, Eric Whitmire, Mayank Goel, Shwetak Patel
30th Annual ACM Symposium on User Interface Software and Technology (UIST), 2017
PDF Video

 

DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-mounted Displays

Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, Mayank Goel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2017
PDF Video

 

Noninvasive Hemoglobin Measurement using Unmodified Smartphone Camera and White Flash

Edward Wang, Junyi Zhu, William Li, Rajneil Rana, Shwetak Patel
39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2017
PDF

 

Automatic Characterization of User Errors in Spirometry

Andrew Luo, Eric Whitmire, James W. Stout, Drew Martenson, Shwetak Patel
39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2017
PDF

 

PupilScreen: Using Smartphones to Assess Traumatic Brain Injury

Alex Mariakakis, Jacob Baudin, Eric Whitmire, Vardhman Mehta, Megan A Banks, Anthony Law, Lynn McGrath, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2017
PDF Video

 

Glabella: Continuously Sensing Blood Pressure Behavior using an Unobtrusive Wearable Device

Christian Holz, Edward Wang
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2017, Best Paper Award
PDF

 

BiliScreen: Smartphone-Based Scleral Jaundice Monitoring for Liver and Pancreatic Disorders

Alex Mariakakis, Megan A. Banks, Lauren Phillipi, Lei Yu, James Taylor, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2017
PDF Video

 

Making Sense of Sleep Sensors: How Sleep Sensing Technologies Support and Undermine Sleep Health

Ruth Ravichandran, Sang-Wha Sien, Shwetak Patel, Julie A. Kientz, Laura R. Pina
Conference on Human Factors in Computing Systems (CHI), 2017
PDF

2016

 

EyeContact: Scleral Coil Eye Tracking for Virtual Reality

Eric Whitmire, Laura Trutoiu, Robert Cavin, David Perek, Brian Scally, James O. Phillips, Shwetak Patel
ACM International Symposium on Wearable Computers (ISWC), 2016, Best Paper Award
PDF Video

 

HemaApp: Noninvasive Blood Screening of Hemoglobin Using Smartphone Cameras

Edward Wang, William Li, Doug Hawkins, Terry Gernsheimer, Colette Norby-Slycord, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2016, Best Paper Award
PDF Video

 

A Smartphone-Based System for Assessing Intraocular Pressure

Alex Mariakakis, Edward Wang, Shwetak Patel, Joanne Wen
EMBC '16
PDF

 

SpiroCall: Measuring Lung Function over a Phone Call

Mayank Goel, Elliot Saba, Maia Stiber, Eric Whitmire, Josh Fromm, Eric Larson, Gaetano Borriello, Shwetak Patel
Conference on Human Factors in Computing Systems (CHI), 2016, Honorable Mention Award
PDF Video

 

PaperID: A Technique for Drawing Functional Battery-Free Wireless Interfaces on Paper

Hanchuan Li, Eric Brockmeyer, Elizabeth J. Carter, Josh Fromm, Scott E. Hudson, Shwetak Patel, Alanson Sample
Conference on Human Factors in Computing Systems (CHI), 2016
PDF Video

 

ID-Match: A Hybrid Computer Vision and RFID System for Recognizing Individuals in Groups

Hanchuan Li, Peijin Zhang, Samer Al Moubayed, Shwetak Patel, Alanson P. Sample
Conference on Human Factors in Computing Systems (CHI), 2016
PDF Video

 

Finexus: Tracking Precise Motions of Multiple Fingertips Using Magnetic Sensing

Keyu Chen, Shwetak Patel, Sean Keller
Conference on Human Factors in Computing Systems (CHI), 2016, Honorable Mention Award
PDF Video

2015

 

MagnifiSense: Inferring Device Interaction Using Wrist-worn Passive Magneto-inductive Sensors

Edward Wang, Tien-jui Lee, Alex Mariakakis, Mayank Goel, Sidhant Gupta, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2015
PDF

 

EVHomeShifter: Evaluating Intelligent Techniques for Using Electrical Vehicle Batteries to Shift when Homes Draw Energy from the Grid

A. J. Bernheim Brush, John Krumm, Sidhant Gupta, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2015
PDF

 

DoppleSleep: A Contactless Unobtrusive Sleep Sensing System Using Short-range Doppler Radar

Tauhidur Rahman, Alexander T. Adams, Ruth Vinisha Ravichandran, Mi Zhang, Shwetak Patel, Julie A. Kientz, Tanzeem Choudhury
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2015, Honorable Mention Award
PDF

 

HyperCam: Hyperspectral Imaging for Ubiquitous Computing Applications

Mayank Goel, Eric Whitmire, Alex Mariakakis, Scott Saponas, Neel Joshi, Dan Morris, Brian Guenter, Marcel Gavriliu, Gaetano Borriello, Shwetak Patel
UbiComp '15, Honorable Mention Award
PDF

 

Tongue-in-Cheek: Using Wireless Signals to Enable Non-Intrusive and Flexible Facial Gestures Detection

Mayank Goel, Chen Zhao, Ruth Vinisha, Shwetak Patel
Conference on Human Factors in Computing Systems (CHI), 2015, Honorable Mention Award
PDF Video

 

How Good is 85%?: A Survey Tool to Connect Classifier Evaluation to Acceptability of Accuracy

Matthew Kay, Shwetak Patel, Julie A. Kientz
Conference on Human Factors in Computing Systems (CHI), 2015
PDF

 

SwitchBack: Using Focus and Saccade Tracking to Guide Users’ Attention for Mobile Task Resumption

Alex Mariakakis, Mayank Goel, Md. Tanvir Islam Aumi, Shwetak Patel, Jacob Wobbrock
CHI '15
PDF

 

Wibreathe: Estimating respiration rate using wireless signals in natural settings in the home

Ruth Ravichandran, Elliot Saba, Keyu Chen, Mayank Goel, Sidhant Gupta, Shwetak Patel
IEEE International Conference on Pervasive Computing and Communications (PerCom), 2015, Honorable Mention Award
PDF Video

 

DOSE: Detecting user-driven operating states of electronic devices from a single sensing point

Keyu Chen, Sidhant Gupta, Eric Larson, Shwetak Patel
IEEE International Conference on Pervasive Computing and Communications (PerCom), 2015
PDF Video

2014

 

SideSwipe: Detecting In-air Gestures Around Mobile Devices Using Actual GSM Signal

Chen Zhao, Keyu Chen, Md Tanvir Islam Aumi, Shwetak Patel, Matthew S. Reynolds
ACM symposium on User Interface Software and Technology (UIST), 2014
PDF

 

Powering Wireless Sensor Nodes with Ambient Temperature Changes

Chen Zhao, Sam Yisrael, Joshua R. Smith, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2014, Honorable Mention Award
PDF Video

 

BiliCam: Using Mobile Phones to Monitor Newborn Jaundice

Lilian de Greef, Mayank Goel, Min Joon Seo, Eric Larson, James W. Stout, James A. Taylor, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2014, Honorable Mention Award
PDF Video

 

AirLink: Sharing Files Between Multiple Devices Using In-air Gestures

Keyu Chen, Daniel Ashbrook, Mayank Goel, Sung-Hyuck Lee, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2014
PDF Video

 

A Self-calibrating Approach to Whole-home Contactless Power Consumption Sensing

Md Tanvir Islam Aumi, Sidhant Gupta, Cameron Pickett, Matt Reynolds, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2014
PDF

 

SurfaceLink: Using Inertial and Acoustic Sensing to Enable Multi-device Interaction on a Surface

Mayank Goel, Brendan Lee, Md Tanvir Islam Aumi, Shwetak Patel, Gaetano Borriello, Stacie Hibino, Bo Begole
Conference on Human Factors in Computing Systems (CHI), 2014
PDF Video

2013

 

Experimental Security Analyses of Non-Networked Compact Fluorescent Lamps: A Case Study of Home Automation Security

Temitope Oluwafemi, Tadayoshi Kohno, Sidhant Gupta, Shwetak Patel
USENIX Learning from Authoritative Security Experiment Results (LASER), 2013
PDF

 

uTrack: 3D Input Using Two Magnetic Sensors

Keyu Chen, Kent Lyons, Sean White, Shwetak Patel
ACM symposium on User Interface Software and Technology (UIST), 2013
PDF

 

Good Vibrations: An Evaluation of Vibrotactile Impedance Matching for Low Power Wearable Applications

Jack Lindsay, Iris Jiang, Eric Larson, Richard Adams, Shwetak Patel, Blake Hannaford
ACM symposium on User Interface Software and Technology (UIST), 2013
PDF

 

The Sound of Touch: On-body Touch and Gesture Sensing Based on Transdermal Ultrasound Propagation

Adiyan Mujibiya, Xiang Cao, Desney S. Tan, Dan Morris, Shwetak Patel, Jun Rekimoto
ITS '13, 10-Year Impact Award from ACM Interactive Surfaces and Spaces Conference (ISS 2022)
PDF

 

Whole-home Gesture Recognition Using Wireless Signals

Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, Shwetak Patel
ACM Annual International Conference on Mobile Computing and Networking (MobiCom), 2013, Best Paper Award
PDF

 

uLocate: A Ubiquitous Location Tracking System for People Aging with Disabilities

Keyu Chen, Mark Harniss, Justin Haowei Lim, Youngjun Han, Kurt L. Johnson, Shwetak Patel
International Conference on Body Area Networks (BodyNets), 2013
PDF

 

DopLink: Using the Doppler Effect for Multi-device Interaction

Md Tanvir Islam Aumi, Sidhant Gupta, Mayank Goel, Eric Larson, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2013
PDF

 

AirWave: Non-contact Haptic Feedback Using Air Vortex Rings

Sidhant Gupta, Dan Morris, Shwetak Patel, Desney Tan
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2013
PDF

 

uTouch: Sensing Touch Gestures on Unmodified LCDs

Keyu Chen, Gabe Cohn, Sidhant Gupta, Shwetak Patel
Conference on Human Factors in Computing Systems (CHI), 2013
PDF

 

ContextType: Using Hand Posture Information to Improve Mobile Touch Screen Text Entry

Mayank Goel, Alex Jansen, Travis Mandel, Shwetak Patel, Jacob O. Wobbrock
Conference on Human Factors in Computing Systems (CHI), 2013
PDF

 

Tracking Lung Function on Any Phone

Eric Larson, Mayank Goel, Morgan Redfield, Gaetano Boriello, Margaret Rosenfeld, Shwetak Patel
ACM DEV '13
PDF

2012

 

GripSense: Using Built-in Sensors to Detect Hand Posture and Pressure on Commodity Mobile Phones

Mayank Goel, Jacob Wobbrock, Shwetak Patel
ACM symposium on User Interface Software and Technology (UIST), 2012
PDF

 

SpiroSmart: Using a Microphone to Measure Lung Function on a Mobile Phone

Eric Larson, Mayank Goel, Gaetano Boriello, Sonya Heltshe, Margaret Rosenfeld, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2012, Honorable Mention Award
PDF

 

Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies

Eun Kyoung Choe, Sunny Consolvo, Jaeyeon Jung, Beverly Harrison, Shwetak Patel, Julie A. Kientz
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2012, Honorable Mention Award
PDF

 

An Ultra-low-power Human Body Motion Sensor Using Static Electric Field Sensing

Gabe Cohn, Sidhant Gupta, Tien-jui Lee, Dan Morris, Joshua R. Smith, Matthew S. Reynolds, Desney S. Tan, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2012, Best Paper Award
PDF

 

SoundWave: Using the Doppler Effect to Sense Gestures

Sidhant Gupta, Daniel Morris, Shwetak Patel, Desney Tan
Conference on Human Factors in Computing Systems (CHI), 2012
PDF

 

Humantenna: Using the Body As an Antenna for Real-time Whole-body Interaction

Gabe Cohn, Daniel Morris, Shwetak Patel, Desney Tan
Conference on Human Factors in Computing Systems (CHI), 2012, Honorable Mention Award
PDF

 

GyroTab: A Handheld Device That Provides Reactive Torque Feedback

Akash Badshah, Sidhant Gupta, Daniel Morris, Shwetak Patel, Desney Tan
Conference on Human Factors in Computing Systems (CHI), 2012
PDF

 

The Design and Evaluation of Prototype Eco-feedback Displays for Fixture-level Water Usage Data

Jon Froehlich, Leah Findlater, Marilyn Ostergren, Solai Ramanathan, Josh Peterson, Inness Wragg, Eric Swanson, Fabia Fu, Mazhengmin Bai, Shwetak Patel, James A. Landay
Conference on Human Factors in Computing Systems (CHI), 2012, Honorable Mention Award
PDF

2011

 

Televisions, Video Privacy, and Powerline Electromagnetic Interference

Miro Enev, Sidhant Gupta, Tadayoshi Kohno, Shwetak Patel
ACM Conference on Computer and Communications Security (CCS), 2011
PDF

 

LightWave: Using Compact Fluorescent Lights As Sensors

Sidhant Gupta, Keyu Chen, Matthew S. Reynolds, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2011, Honorable Mention Award
PDF

 

Accurate and Privacy Preserving Cough Sensing Using a Low-cost Microphone

Eric Larson, Tien-jui Lee, Sean Liu, Margaret Rosenfeld, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2011
PDF

 

A Longitudinal Study of Pressure Sensing to Infer Real-world Water Usage Events in the Home

Jon Froehlich, Eric Larson, Elliot Saba, Tim Campbell, Les Atlas, James Fogarty, Shwetak Patel
International Conference on Pervasive Computing (Pervasive), 2011
PDF Video

 

Your Noise is My Command: Sensing Gestures Using the Body As an Antenna

Gabe Cohn, Daniel Morris, Shwetak Patel, Desney S. Tan
Conference on Human Factors in Computing Systems (CHI), 2011, Best Paper Award
PDF

 

The Haptic Laser: Multi-sensation Tactile Feedback for At-a-distance Physical Space Perception and Interaction

Fran Iannacci, Erik Turnquist, Daniel Avrahami, Shwetak Patel
Conference on Human Factors in Computing Systems (CHI), 2011
PDF

 

Interactive Generator: A Self-powered Haptic Feedback Device

Akash Badshah, Sidhant Gupta, Gabe Cohn, Nicolas Villar, Steve Hodges, Shwetak Patel
Conference on Human Factors in Computing Systems (CHI), 2011, Best Paper Award
PDF

 

HeatWave: Thermal Imaging for Surface User Interaction

Eric Larson, Gabe Cohn, Sidhant Gupta, Xiaofeng Ren, Beverly Harrison, Dieter Fox, Shwetak Patel
Conference on Human Factors in Computing Systems (CHI), 2011, Honorable Mention Award
PDF

2010

 

SqueezeBlock: Using Virtual Springs in Mobile Devices for Eyes-free Interaction

Sidhant Gupta, Tim Campbell, Jeffrey R. Hightower, Shwetak Patel
ACM symposium on User Interface Software and Technology (UIST), 2010
PDF

 

WATTR: A Method for Self-powered Wireless Sensing of Water Activity in the Home

Tim Campbell, Eric Larson, Gabe Cohn, Jon Froehlich, Ramses Alcaide, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2010
PDF

 

SNUPI: Sensor Nodes Utilizing Powerline Infrastructure

Gabe Cohn, Erich Stuntebeck, Jagdish Pandey, Brian Otis, Gregory D. Abowd, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2010, Honorable Mention Award
PDF

 

ElectriSense: Single-point Sensing Using EMI for Electrical Event Detection and Classification in the Home

Sidhant Gupta, Matthew S. Reynolds, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2010, Best Paper Award
PDF

 

Studying the Use and Utility of an Indoor Location Tracking System for Non-experts

Shwetak Patel, Julie A. Kientz, Sidhant Gupta
International Conference on Pervasive Computing (Pervasive), 2010
PDF

 

GasSense: Appliance-level, Single-point Sensing of Gas Activity in the Home

Gabe Cohn, Sidhant Gupta, Jon Froehlich, Eric Larson, Shwetak Patel
International Conference on Pervasive Computing (Pervasive), 2010
PDF

 

The Design and Evaluation of an End-user-deployable, Whole House, Contactless Power Consumption Sensor

Shwetak Patel, Sidhant Gupta, Matthew S. Reynolds
Conference on Human Factors in Computing Systems (CHI), 2010, Honorable Mention Award
PDF

 

Automatic Classification of Daily Fluid Intake

Jonathan Lester, Desney Tan, Shwetak Patel, A.J. Brush
IEEE 4th International Conference on Pervasive Computing for Healthcare (PervasiveHealth), 2010, Best Paper Award
PDF

2009

 

HydroSense: Infrastructure-mediated Single-point Sensing of Whole-home Water Activity

Jon Froehlich, Eric Larson, Tim Campbell, Conor Haggerty, James Fogarty, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2009, Honorable Mention Award
PDF Video

 

PL-Tags: Detecting Batteryless Tags Through the Power Lines in a Building

Shwetak Patel, Erich P. Stuntebeck, Thomas Robertson
Pervasive
PDF

 

Detecting Human Movement by Differential Air Pressure Sensing in HVAC System Ductwork: An Exploration in Infrastructure Mediated Sensing

Shwetak Patel, Matthew S. Reynolds, Gregory D. Abowd
Pervasive, Ubicomp 10 year impact award
PDF

2008

 

Are You Sleeping?: Sharing Portrayed Sleeping Status Within a Social Network

Sunyoung Kim, Julie A. Kientz, Shwetak Patel, Gregory D. Abowd
CSCW '08
PDF

 

Wideband Powerline Positioning for Indoor Localization

Erich P. Stuntebeck, Shwetak Patel, Thomas Robertson, Matthew S. Reynolds, Gregory D. Abowd
UbiComp
PDF

 

A Quantitative Investigation of Inertial Power Harvesting for Human-powered Devices

Jaeseok Yun, Shwetak Patel, Matt Reynolds, Gregory Abowd
UbiComp
PDF

2007

 

Blui: Low-cost Localized Blowable User Interfaces

Shwetak Patel, Gregory D. Abowd
ACM symposium on User Interface Software and Technology (UIST), 2007
PDF

 

At the Flick of a Switch: Detecting and Classifying Unique Electrical Events on the Residential Power Line

Shwetak Patel, Thomas Robertson, Julie A. Kientz, Matthew S. Reynolds, Gregory D. Abowd
UbiComp, Ubicomp 10 year impact award
PDF