Use of a Smartphone App to Assess Neonatal Jaundice

James A. Taylor, James W. Stout, Lilian de Greef, Mayank Goel, Shwetak Patel, Esther K. Chung, Aruna Koduri, Shawn McMahon, Jane Dickerson, Elizabeth A. Simpson, Eric C. Larson
This project is follow-up work to BiliCam, in which we made modifications to the BiliCam system and ran larger study to validate its efficacy at screening newborn jaundice. This study spanned across 7 different sites around the country to broaden the diversity of skin tones in our dataset. From our dataset of samples from 530 newborns, BiliCam demonstrated medically accurate estimates. Our findings are published as a journal paper in Pediatrics, August 2017.
Publication

 

BiliCam: Using Mobile Phones to Monitor Newborn Jaundice

Lilian de Greef, Mayank Goel, Min Joon Seo, Eric Larson, James W. Stout, James A. Taylor, Shwetak Patel
This project investigates how to use smartphone cameras to screen newborns for dangerous levels of jaundice — a medical condition characterized by yellowing of the skin. I work in close collaboration with UW Medical Center to develop data collection procedures and software, apply computer vision to parse images, and use machine learning to estimate jaundice levels. Work from this project was published as a paper in UbiComp 2014 with an Honorable Mention Award, and resulted in two patents, and current commercial development.
Publication Patent #1 Patent #2 Poster Talk Slides Video

 

TeleTourist: Immersive Telepresence Tourism for Mobility-Restricted Participants

Lilian de Greef, Meredith Ringel Morris, Kori Inkpen
During an internship at Microsoft Reserach, I conceived and developed a prototype of TeleTourist, a system that uses video calls with strangers to share experiences for people with mobility restrictions. I interviewed individuals with mobility restrictions as formative work, designed system features, and implemented a subset of them for a prototype. This project was published as a poster at CSCW '16 and resulted in a patent.
Patent Poster Abstract Poster

 

Perspective Aware Projected User Interfaces

Lilian de Greef, Alex Colburn, Jim Curlander
During an internship at Amazon I designed, developed, and evaluated eyes and head tracking related user interface elements to use in enhanced reality interfaces in fulfillment centers. I combined concepts from computer graphics with HCI to produce several prototypes and demonstrated the system in its intended environment. This work resulted in a patent.
Patent Talk Slides

Undergraduate



 

Microsoft Surface for Stroke Rehabilitation

Cati Boulanger, Adam Boulanger, Lilian de Greef, Andy Kearney, Kiley Sobel, Russell Transue, Z Sweedyk, Paul H. Dietz, Steven Bathiche
As part of a four-person team, I designed and developed technology to motivate and assess rehabilitation for stroke patients affected in their upper extremities, using the Microsoft Surface. We interviewed stroke patients and physical therapists, designed a rehabilitative game played on the Microsoft Surface, produced a prototype, and ran user study with stroke patients. Our work was presented at CWIC '12 and published in a note at CHI '12.
Publication Talk Slides

 

Accessible Aerial Autonomy

Nick Berezny, Lilian de Greef, Bradley Jensen, Kimberly Sheely, Malen Sok, David Lingenbrink, Zachary Dodds
I created and explored vision-based localization algorithms for aerial robots as part of a team of five students. We prototyped autonomous cooperation between ground-based and airborne robots and demonstrated localization for a quadrotor helicopter toy using only a built-in camera. We presented our work as demos at GCER '11 and AAAI '11, a talk at CWIC '12, and a publication in TePRA '12.
Publication Poster Talk Slides Video

 

LogiSketch: A Free-Sketch Digital Circuit Design and Simulation System

Kevin Chan, Lilian de Greef, Alexa Keizur, Alice Paul, Brian Liao, June Woo Suk, Christine Alvarado
I helped developed software for tablet PCs to recognize and simulate hand-drawn logic circuits as part of a siz-person team. I specifically focused on methods to refine sketch recognition and refactoring code. I helped the team with user interface design and circuit simulation. The software was then rolled out and used in Harvey Mudd College’s introductory computer science course.
Talk Slides