Medical Design and Outsourcing

  • Home
  • Medical Device Business
    • Mergers & Acquisitions
    • Financial
    • Regulatory
  • Applications
    • Cardiovascular
    • Devices
    • Imaging
    • Implantables
    • Medical Equipment
    • Orthopedic
    • Surgical
  • Technologies
    • Contract Manufacturing
    • Components
    • Electronics
    • Extrusions
    • Materials
    • Motion Control
    • Prototyping
    • Pumps
    • Tubing
  • Med Tech Resources
    • Subscribe to Print Magazine
    • DeviceTalks Tuesdays
    • Digital Editions
    • eBooks
    • Manufacturer Search
    • Medical Device Handbook
    • MedTech 100 Index
    • Podcasts
    • Print Subscription
    • The Big 100
    • Webinars / Digital Events
    • Whitepapers
    • Video
  • 2022 Leadership in MedTech
    • 2022 Leadership Voting!
    • 2021 Winners
    • 2020 Winners
  • Women in Medtech

Fitness Trackers Accurately Measure Heart Rate but Not Calories Burned

June 1, 2017 By Stanford Medicine

A Stanford inquiry into the accuracy of seven wristband activity monitors showed that six out of seven devices measured heart rate within 5 percent. None, however, measured energy expenditure well.

Millions of people wear some kind of wristband activity tracker and use the device to monitor their own exercise and health, often sharing the data with their physician. But is the data accurate?

Such people can take heart in knowing that if the device measures heart rate, it’s probably doing a good job, a team of researchers at the Stanford University School of Medicine reports. But if it measures energy expenditure, it’s probably off by a significant amount.

Cardiology researcher Euan Ashley and his team conducted a study to determine how accurately seven types of fitness trackers measure heart rate and energy expenditure. (Credit: Paul Sakuma)

An evaluation of seven devices in a diverse group of 60 volunteers showed that six of the devices measured heart rate with an error rate of less than 5 percent. The team evaluated the Apple Watch, Basis Peak, Fitbit Surge, Microsoft Band, Mio Alpha 2, PulseOn and the Samsung Gear S2. Some devices were more accurate than others, and factors such as skin color and body mass index affected the measurements.

In contrast, none of the seven devices measured energy expenditure accurately, the study found. Even the most accurate device was off by an average of 27 percent. And the least accurate was off by 93 percent.

“People are basing life decisions on the data provided by these devices,” says Euan Ashley, DPhil, FRCP, professor of cardiovascular medicine, of genetics and of biomedical data science at Stanford. But consumer devices aren’t held to the same standards as medical-grade devices, and it’s hard for doctors to know what to make of heart-rate data and other data from a patient’s wearable device, he says.

A paper reporting the researchers’ findings was published online May 24 in the Journal of Personalized Medicine. Ashley is the senior author. Lead authorship is shared by graduate student Anna Shcherbina, visiting assistant professor Mikael Mattsson, PhD, and senior research scientist Daryl Waggott.

Hard for consumers to know device accuracy

Manufacturers may test the accuracy of activity devices extensively, says Ashley, but it’s hard for consumers to know how accurate such information is or the process that the manufacturers used in testing the devices. So Ashley and his colleagues set out to independently evaluate activity trackers that met criteria such as measuring both heart rate and energy expenditure and being commercially available.

Study participants wore the fitness trackers while walking or running on a treadmill and while riding an exercise bike. (Credit: Paul Sakuma)

“For a lay user, in a non-medical setting, we want to keep that error under 10 percent,” Shcherbina says.

Sixty volunteers, including 31 women and 29 men, wore the seven devices while walking or running on treadmills or using stationary bicycles. Each volunteer’s heart was measured with a medical-grade electrocardiograph. Metabolic rate was estimated with an instrument for measuring the oxygen and carbon dioxide in breath — a good proxy for metabolism and energy expenditure. Results from the wearable devices were then compared to the measurements from the two “gold standard” instruments.

“The heart rate measurements performed far better than we expected,” says Ashley, “but the energy expenditure measures were way off the mark. The magnitude of just how bad they were surprised me.”

Heart-rate data reliable

The take-home message, he says, is that a user can pretty much rely on a fitness tracker’s heart rate measurements. But basing the number of doughnuts you eat on how many calories your device says you burned is a really bad idea, he says.

Neither Ashley nor Shcherbina could be sure why energy-expenditure measures were so far off. Each device uses its own proprietary algorithm for calculating energy expenditure, they say. It’s likely the algorithms are making assumptions that don’t fit individuals very well, says Shcherbina. “All we can do is see how the devices perform against the gold-standard clinical measures,” she says. “My take on this is that it’s very hard to train an algorithm that would be accurate across a wide variety of people because energy expenditure is variable based on someone’s fitness level, height and weight, etc.” Heart rate, she says, is measured directly, whereas energy expenditure must be measured indirectly through proxy calculations.

Ashley’s team saw a need to make their evaluations of wearable devices open to the research community, so they created a website that shows their own data. They welcome others to upload data related to device performance.

The team is already working on the next iteration of their study, in which they are evaluating the devices while volunteers wear them as they go about a normal day, including exercising in the open, instead of walking or running on a laboratory treadmill. “In phase two,” says Shcherbina, “we actually want a fully portable study. So volunteers’ ECG will be portable and their energy calculation will also be done with a portable machine.”

The work is an example of Stanford Medicine’s focus on precision health, the goal of which is to anticipate and prevent disease in the healthy and precisely diagnose and treat disease in the ill.

Other Stanford co-authors are clinical nurse specialist Heidi Salisbury, RN, MSN; clinical exercise physiologist Jeffrey Christle, PhD; Trevor Hastie, PhD, professor of statistics and of biomedical data science; and Matthew Wheeler, MD, PhD, clinical assistant professor of cardiovascular medicine. Ashley is also a member of the Stanford Cardiovascular Institute, the Stanford Child Health Research Institute and Stanford Bio-X. Hastie is a member of CHRI, Bio-X, the Stanford Cancer Institute and the Stanford Neurosciences Institute.

Stanford’s departments of Medicine, of Genetics and of Biomedical Data Science supported the work.

Related Articles Read More >

An illustration showing a wireless, chipless skin sensor
MIT engineers fabricate chip-free, wireless e-skin
A small, thin sticker with a button that says press to start
Blue Spark’s TempTraq catches fevers faster. Fever prediction is next.
A small, square transducer array with an adhesive layer
MIT engineers develop wearable, stamp-sized ultrasound stickers for continuous imaging
Connected device design for the real world: Managing the development process

DeviceTalks Weekly.

August 12, 2022
DTW – Medtronic’s Mauri brings years of patient care to top clinical, regulatory, scientific post
See More >

MDO Digital Edition

Digital Edition

Subscribe to Medical Design & Outsourcing. Bookmark, share and interact with the leading medical design engineering magazine today.

MEDTECH 100 INDEX

Medtech 100 logo
Market Summary > Current Price
The MedTech 100 is a financial index calculated using the BIG100 companies covered in Medical Design and Outsourcing.
DeviceTalks

DeviceTalks is a conversation among medical technology leaders. It's events, podcasts, webinars and one-on-one exchanges of ideas & insights.

DeviceTalks

New MedTech Resource

Medical Tubing

Enewsletter Subscriptions

Enewsletter Subscriptions

MassDevice

Mass Device

The Medical Device Business Journal. MassDevice is the leading medical device news business journal telling the stories of the devices that save lives.

Visit Website
MDO ad
Medical Design and Outsourcing
  • MassDevice
  • DeviceTalks
  • MedTech100 Index
  • Medical Tubing + Extrusion
  • Medical Design Sourcing
  • Drug Delivery Business News
  • Drug Discovery & Development
  • Pharmaceutical Processing World
  • R&D World
  • About Us/Contact
  • Advertise With Us
  • Subscribe to Print Magazine
  • Subscribe to E-newsletter
  • Attend our Monthly Webinars
  • Listen to our Weekly Podcasts
  • Join our DeviceTalks Tuesdays Discussion

Copyright © 2022 WTWH Media, LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media LLC. Site Map | Privacy Policy | RSS

Search Medical Design & Outsourcing

  • Home
  • Medical Device Business
    • Mergers & Acquisitions
    • Financial
    • Regulatory
  • Applications
    • Cardiovascular
    • Devices
    • Imaging
    • Implantables
    • Medical Equipment
    • Orthopedic
    • Surgical
  • Technologies
    • Contract Manufacturing
    • Components
    • Electronics
    • Extrusions
    • Materials
    • Motion Control
    • Prototyping
    • Pumps
    • Tubing
  • Med Tech Resources
    • Subscribe to Print Magazine
    • DeviceTalks Tuesdays
    • Digital Editions
    • eBooks
    • Manufacturer Search
    • Medical Device Handbook
    • MedTech 100 Index
    • Podcasts
    • Print Subscription
    • The Big 100
    • Webinars / Digital Events
    • Whitepapers
    • Video
  • 2022 Leadership in MedTech
    • 2022 Leadership Voting!
    • 2021 Winners
    • 2020 Winners
  • Women in Medtech