BiliScreen: Smartphone-Based Scleral Jaundice Monitoring for Liver and Pancreatic Disorders

Alex Mariakakis, Megan A. Banks, Lauren Phillipi, Lei Yu, James Taylor, Shwetak Patel
PDF Video
BiliScreen uses machine learning to estimate the extent of jaundice in the sclera.

Abstract

Pancreatic cancer has one of the worst survival rates amongst all forms of cancer because its symptoms manifest later into the progression of the disease. One of those symptoms is jaundice, the yellow discoloration of the skin and sclera due to the buildup of bilirubin in the blood. Jaundice is only recognizable to the naked eye in severe stages, but a ubiquitous test using computer vision and machine learning can detect milder forms of jaundice. We propose BiliScreen, a smartphone app that captures pictures of the eye and produces an estimate of a person's bilirubin level, even at levels normally undetectable by the human eye. We test two low-cost accessories that reduce the effects of external lighting: (1) a 3D-printed box that controls the eyes' exposure to light and (2) paper glasses with colored squares for calibration. In a 70-person clinical study, we found that BiliScreen with the box achieves a Pearson correlation coefficient of 0.89 and a mean error of -0.09 ± 2.76 mg/dl in predicting a person's bilirubin level. As a screening tool, BiliScreen identifies cases of concern with a sensitivity of 89.7% and a specificity of 96.8% with the box accessory.

Press

Allen School News: Snap a selfie, screen for pancreatic cancer with new app from UW researchers
BBC: Selfie app 'spots early signs of pancreatic cancer'
Cosmopolitan: How selfies could soon be used to diagnose cancer
Engadget: App detects pancreatic cancer from the whites of your eyes
GeekWire: UW team creates smartphone selfie system to screen for pancreatic cancer
IEEE Spectrum: Eye Scans to Detect Cancer and Alzheimer’s Disease
KIRO-TV: Selfies helping detect cancer? UW researchers are on it
Medscape: Smartphone 'Selfies' May Help Diagnose Pancreatic Cancer
NY Daily News: Selfies could detect pancreatic cancer early with proposed app
New York Post: Selfies can now diagnose cancer
Reuters: Eye selfie could screen for pancreatic cancer
USA Today: How your selfies could help detect pancreatic cancer
United Press International: App uses smartphone selfies to screen for pancreatic cancer