Hello! I am a Ph.D. student in the department of computer science at the University of Maryland, College Park. I work with professor Jon Froehlich in Human Computer Interaction Lab abd Makeability Lab. My research interest is to design and develop interactive systems with emphases on natural user interface and mixed reality. I am currently investigating user interaction in design prototyping activities in context of learning, and buildling an intelligent system that understands visual information and provides personalized AR feedback.
SharedPhys View Video »
This project introduces three different mixed-reality tools that support new forms of embodied interaction, scientific inquiry, and collaborative learning on human body systems. These tools tightly integrates real-time physiological sensing, whole-body interaction, and responsive large-screen visualizations so as to provide learners with immersive learning experience.
I Like This Shirt
we explore the translation of the dynamics of the virtual-based social interactions into the physical world. Specifically, by creating everyday physical objects that can be “liked” in the physical world as if they existed in the virtual world, we study wearers’ and viewers’ reactions and experiences.
Kids in Fairytales
We introduce an immersive learning system that combines mixed reality experience and interactive storytelling to engage young children more in reading. By interacting with virtual objects and immerse themsevles in responsive 3D scene, young users can develop their own fairytales and become deeply intersted in the stories. We deployed the system at 20+ national children's libraries for 5 years along with 10+ immersive 3D fairytales.
Tangible User Interface
AccStick is a tangible computing interface which assists desktop computing with accessibility functions. Each stick is mapped to an accessibility function such as screen magnifier, screen resolution change, display brightness adjustment, cursor size change, and volume control. By plugging or bending AccSticks, users can easily use the computing functions.
City Light from Windmills is a interactive and visual art that displays how our city turns up the lights with electricity generated by windmills. The user can light up city building by blowing windmills and change its color/brightness. The colors and brightness of LEDs are adjusted according to the rotational speeds of each windmill.
Tint Picker is a tangible color picker that allows you to save any colors in your life and build your color palette to use in the future design, painting, or fun. Tint Picker sensors RGB/light value at its tip and send the data to application server through Bluetooth embedded in Arduino Blend Micro. Our application visualizes the color picked with colorful balls and presents the recent colors at your palette.
Ukulele Player allows you to play a ukulele with no expertise required - just wave your arms to strum and change chords. Servo motors mounted above the instrument activate to strum the strings, and rotate gears to press down on the fretboard. A Kinect is used for gesture recognition, so that moving your right arm up and down strums, and left arm back and forth switches between chords.
Flappy hat is a intelligent hat that sensors user enviroment (UV level, temperature, and humidity) and visualize them. As a form of social interaction, the wearer can spread the climate information and benefit nearby people
