Google Unveils Passive Heart Rate Monitoring Using Smartphone Camera

Google's Passive Heart Rate Monitoring via Smartphone Camera
© B. Naumkin

Google has unveiled a research technology called Passive Heart Rate Monitoring that can estimate a person's heart rate using a standard smartphone front-facing camera. The idea is to bring some of the functionality of fitness trackers and smartwatches to devices that nearly everyone already owns.

The system analyzes subtle changes in skin color caused by blood flow through vessels. The human eye cannot see these fluctuations, but the camera and machine learning algorithms can detect them. In Google's version, the smartphone records an eight-second video clip after the user unlocks the phone via facial recognition, and then a local AI model evaluates the heart rate.

Similar methods for measuring heart rate via smartphone have existed before, but they typically required active input: the user had to place a finger on the rear camera, flash, or fingerprint sensor. Google’s approach differs because it works passively during normal phone use and can gradually build a resting heart rate profile without requiring a separate wearable device.

To train and validate the system, Google used more than 350,000 videos from nearly 700 participants. The company emphasizes that the study included people with various skin tones, because cameras have a harder time detecting blood flow on darker skin. According to Google, the measurement accuracy met industry standards across all tested groups, and the resting heart rate estimates differed from Fitbit Charge 6 readings by less than five beats per minute.

However, the technology is not yet perfect. For people with darker skin, the system had more difficulty consistently obtaining readings, even though the data itself remained accurate. Errors can also be caused by talking, head movement, and other common actions. Another important issue is privacy: any consumer implementation would require strict safeguards, although Google is betting on on-device data processing.

For now, PHRM remains a research project, but its potential is clear. If smartphones can reliably track basic cardiovascular metrics without additional gadgets, health monitoring could become more accessible to millions of people who do not buy smartwatches or fitness trackers.