Hello! I am a Ph.D. candidate in Computer Science at the University of Maryland, College Park, advised by Prof. Jon Froehlich in HCIL and Makeability Lab. My research interests include Human-Computer Interaction, Augmented Reality, and STEM Education Technology. My dissertation explores AR user interaction techniques that use physiological sensing, free-form material (e.g., craft paper), and everyday objects, leveraging machine learning and computer vision. During my PhD, I interned at Microsoft Research, Cambridge (2017) working on physical-and-digital construction kit. Before joining UMD, I was a research scientist at ETRI, a national research lab in Korea, developing mixed-reality system software including human image segmentation, whole-body gesture recognition, and motion-based natural user interface for 5 years.
PrototypAR View Video »
SharedPhys View Video »
I Like This Shirt
Kids in Fairytales
Tangible User Interface
AccStick is a tangible computing interface which assists desktop computing with accessibility functions. Each stick is mapped to an accessibility function such as screen magnifier, screen resolution change, display brightness adjustment, cursor size change, and volume control. By plugging or bending AccSticks, users can easily use the computing functions.
City Light from Windmills is a interactive and visual art that displays how our city turns up the lights with electricity generated by windmills. The user can light up city building by blowing windmills and change its color/brightness. The colors and brightness of LEDs are adjusted according to the rotational speeds of each windmill.
Tint Picker is a tangible color picker that allows you to save any colors in your life and build your color palette to use in the future design, painting, or fun. Tint Picker sensors RGB/light value at its tip and send the data to application server through Bluetooth embedded in Arduino Blend Micro. Our application visualizes the color picked with colorful balls and presents the recent colors at your palette.
Ukulele Player allows you to play a ukulele with no expertise required - just wave your arms to strum and change chords. Servo motors mounted above the instrument activate to strum the strings, and rotate gears to press down on the fretboard. A Kinect is used for gesture recognition, so that moving your right arm up and down strums, and left arm back and forth switches between chords.
Flappy hat is a intelligent hat that sensors user enviroment (UV level, temperature, and humidity) and visualize them. As a form of social interaction, the wearer can spread the climate information and benefit nearby people