Ideas made tangible.

Systems and prototypes connecting sensing to human interaction.

The research behind the work

Visual detail, haptic feedback, and physiological interpretation.

MicroCam (IMWUT ’23) project illustration

MicroCam (IMWUT ’23)

Turns a smartphone microscope camera into a low-cost sensor for recognizing contact surfaces and their fine-grained context.

  • vision-based sensing
  • mobile computing
  • context awareness
Ambient2Hap (ICME ’26) project illustration

Ambient2Hap (ICME ’26)

Accepted, in press

Transforms visual and auditory ambient cues into somatosensory electrical stimulation, extending haptic feedback in virtual reality.

  • multimodal interaction
  • virtual reality
  • haptics
MultiEEG-GPT (UbiComp/ISWC ’24) project illustration

MultiEEG-GPT (UbiComp/ISWC ’24)

UbiComp/ISWC Companion · Exploratory study

Explores EEG with facial or speech-derived context in language-model classification benchmarks, without claiming clinical validation.

The related IntervEEG-LLM framework explores how multimodal interpretations can inform supportive dialogue. Its example cases are not evidence of clinical effectiveness.

  • EEG
  • large language models
  • mental health

Across sensing and interaction.

Multimodal reasoning, extended reality, accessibility, and tools.

MultiSurf-GPT (MobileHCI ’24) project illustration

MultiSurf-GPT (MobileHCI ’24)

Uses large-language-model agents to reason over multimodal surface-sensing signals for context-aware applications.

  • surface sensing
  • LLM agents
  • context awareness
RadarFoot (UIST ’23) project illustration

RadarFoot (UIST ’23)

Embeds radar sensing in a smart shoe to recognize fine-grained ground-surface context during everyday movement.

  • radar
  • wearable sensing
  • surface context
Generative AI for Spatial AR (ISMAR ’23) project illustration

Generative AI for Spatial AR (ISMAR ’23)

Investigates how generative AI can facilitate image creation for spatial augmented-reality experiences.

  • generative AI
  • spatial AR
  • content creation
GenAIR (SUI ’23) project illustration

GenAIR (SUI ’23)

Explores the design factors involved in employing generative AI for augmented-reality content and interaction.

  • generative AI
  • augmented reality
  • design factors
Motion-Adaptive GUI (IUI ’23) project illustration

Motion-Adaptive GUI (IUI ’23)

Adapts mobile interfaces to a user’s motion state so interaction remains legible and usable in dynamic settings.

  • adaptive interfaces
  • mobile HCI
  • human motion
SmartRecorder (IUI ’23) project illustration

SmartRecorder (IUI ’23)

Helps people without video-editing expertise create clear tutorial videos for smartphone interaction tasks.

  • interactive tools
  • tutorial creation
  • mobile interaction
FootUI (ASSETS ’22) project illustration

FootUI (ASSETS ’22)

Designs and recognizes foot gestures that help people with upper-body motor impairments use smartphones while in bed.

  • accessibility
  • foot interaction
  • gesture sensing
Auth+Track (CHI ’21) project illustration

Auth+Track (CHI ’21)

Combines sparse authentication with continuous user tracking to reduce repeated smartphone authentication in everyday use.

  • authentication
  • user tracking
  • ubiquitous computing
WallBot (CHI ’21 EA) project illustration

WallBot (CHI ’21 EA)

Extends tangible interaction from horizontal surfaces to walls through a responsive, wall-climbing robotic interface.

  • tangible interaction
  • robotics
  • interactive surfaces

Ongoing explorations.

EmotionalDiffusion (ongoing) project illustration

EmotionalDiffusion (ongoing)

This project aims to facilitate content creation in projection scenarios by combining visual (depth dimension) and textual modalities.

  • generative AI
  • context creation
  • projection
Survey on Radar Sensing in HCI (ongoing) project illustration

Survey on Radar Sensing in HCI (ongoing)

How is radar sensing employed in HCI? How is it different from vision-based sensing methods?

  • radar
  • survey
Speech2Pro (IJHCS · R&R) project illustration

Speech2Pro (IJHCS · R&R)

Revise and resubmit · Not yet accepted

Combines spoken intent with RGB, infrared, and depth information for projection authoring and iterative user refinement.

  • speech interaction
  • multimodal authoring
  • projection

Earlier projects.

Foundations in hardware, accessible media, modeling, and networks.

Hierarchical Video Encryption with Quantum Key Distribution project illustration

Hierarchical Video Encryption with Quantum Key Distribution

Explored how limited quantum keys can protect the most semantically important information in video content.

  • semantic encryption
  • quantum encryption
Touch to See (Stanford SUGAR Expo) project illustration

Touch to See (Stanford SUGAR Expo)

Created a pipeline for translating ordinary images into tactile graphics for accessible books.

  • tactile graphics
  • accessibility
Dynamic Network Planning for Ebola Eradication project illustration

Dynamic Network Planning for Ebola Eradication

A mathematical model balancing disease spread, medicine supply, delivery systems, and manufacturing capacity.

  • mathematical modeling
Remote Interactive RF Experimental Platform project illustration

Remote Interactive RF Experimental Platform

Designed FM modulation and demodulation circuits and evaluated them with NI ELVIS virtual instruments.

  • RF circuit
  • experimental platform
Networked Mobile-Robot Monitoring and Anti-Collision project illustration

Networked Mobile-Robot Monitoring and Anti-Collision

Built a web monitoring tool for inspecting and controlling a mobile robot’s operating state.

  • robotics
  • remote monitoring
RF Amplifier for Internet-of-Things Applications project illustration

RF Amplifier for Internet-of-Things Applications

Designed and evaluated a low-noise RF amplifier using vector network analysis.

  • RF amplifier
  • hardware

Capabilities & Tools

ML & LLM Frameworks
ML & LLM FrameworksLangChain · PyTorch · TensorFlow · ML algorithms
Programming Languages
Programming LanguagesPython · MATLAB · C/C++ · Java · JavaScript · HTML
User & Data Analysis
User & Data AnalysisQuantitative · Qualitative · Power BI · SQL · Observer XT
Mobile & Embedded Systems
Mobile & Embedded SystemsAndroid · MSP430 · PCB · Altium Designer · EAGLE
XR & Interaction Design
XR & Interaction DesignUnity · Blender · Photoshop · Illustrator · Figma