Medical Design and Outsourcing

  • Home
  • Medical Device Business
    • Mergers & Acquisitions
    • Financial
    • Regulatory
  • Applications
    • Cardiovascular
    • Devices
    • Imaging
    • Implantables
    • Medical Equipment
    • Orthopedic
    • Surgical
  • Technologies
    • Contract Manufacturing
    • Components
    • Electronics
    • Extrusions
    • Materials
    • Motion Control
    • Prototyping
    • Pumps
    • Tubing
  • Med Tech Resources
    • DeviceTalks Tuesdays
    • Digital Editions
    • eBooks
    • Manufacturer Search
    • Medical Device Handbook
    • MedTech 100 Index
    • Podcasts
    • Print Subscription
    • The Big 100
    • Webinars / Digital Events
    • Whitepapers
    • Video
  • 2022 Leadership in MedTech
    • 2022 Leadership Voting!
    • 2021 Winners
    • 2020 Winners
  • Women in Medtech

AI Must Seem Unobtrusive to be Accepted as Part of Clinical Decision Making

May 14, 2019 By Byron Spice

Physicians making life and death decisions about organ transplants, cancer treatments or heart surgeries typically don’t give much thought to how artificial intelligence might help them. And that’s how researchers at Carnegie Mellon University say clinical AI tools should be designed — so doctors don’t need to think about them.

A surgeon might never feel the need to ask an AI for advice, much less allow an AI make a clinical decision for them, said John Zimmerman, professor in CMU’s Human-Computer Interaction Institute (HCII). But an AI might guide decisions if it was embedded in the decision-making routines already used by the clinical team, providing AI-generated predictions and evaluations as part of the overall mix of information.

Zimmerman and his colleagues call this approach “Unremarkable AI.”

“The idea is that AI should be unremarkable in the sense that you don’t have to think about it and it doesn’t get in the way,” Zimmerman added. “Electricity is completely unremarkable until you don’t have it.”

Qian Yang, a Ph.D. student in HCII, will address how the Unremarkable AI approach guided the design of a clinical decision support tool (DST) at CHI 2019, the Association for Computing Machinery’s Conference on Human Factors in Computing Systems, May 4-9 in Glasgow, UK.

Yang, along with Zimmerman and Aaron Steinfeld, associate research professor in HCII and the Robotics Institute, are working with biomedical researchers at Cornell University and CMU’s Language Technologies Institute on a DST to help physicians evaluate heart patients for treatment with a ventricular assist device (VAD). This implantable pump aids diseased hearts in patients who are unable to receive heart transplants. Many recipients die shortly after the implant. The DST under development uses machine learning methods to analyze thousands of cases and calculate a probability of whether an individual might benefit.

DSTs have been developed to help diagnose or plan treatment for a number of medical conditions and surgical procedures, but most fail to make the transition from lab to clinical practice and fall into disuse.

“They all assume you know you need help,” Zimmerman said. They often face resistance from physicians, many of whom don’t think they need help, or see the DST as technology designed to replace them.

Yang used the Unremarkable AI principles to design how the clinical team would interact with the DST for VADs. These teams include mid-level clinicians, such as nurse practitioners, social workers and VAD coordinators, who routinely use computers, and surgeons and cardiologists, who value their colleagues’ advice over computational support.

The natural time to incorporate the DST’s prognostications is during multidisciplinary patient evaluation meetings, Yang said. Though physicians make the ultimate decision about when or if to implant a VAD, the entire team is often present at these meetings and computers are being used.

Her design automatically incorporates the DST prognostications into the slides prepared for each patient. In most cases, the DST information won’t be significant, Steinfeld suggested, but for certain patients, or at certain critical points for each patient, the DST might provide information that demands attention.

Though the DST itself is still under development, the researchers tested this interaction design at three hospitals that perform VAD surgery, with DST-enhanced slides presented for simulated patients.

“The mid-levels — the support staff — loved this,” Yang said, because it enhanced their input and helped them be more active in the discussion. Physician reaction was less enthusiastic, reflecting skepticism about DSTs and the conviction that it was impossible to fully evaluate the interaction without a fully functioning system and real patients.

But Yang said physicians didn’t display the same defensiveness and feelings about being replaced by technology typically associated with DSTs. They also acknowledged that the DST might inform their decisions.

“Prior systems were all about telling you what to do,” Zimmerman said. “We’re not replacing human judgment; we’re trying to give humans inhuman abilities.”

“And to do that we need to maintain the human decision-making process,” Steinfeld added.

The National Heart, Lung and Blood Institute and the CMU Center for Machine Learning and Health supported this research.

Related Articles Read More >

CeQur Simplicity
CeQur is launching a discreet, convenient ‘wearable insulin pen’
Blackrock's Utah array is a miniature array of electrodes for sensing brain signals
Blackrock Neurotech and Pitt work on first at-home BCI system for remote trials
Engineer inspecting artificial hip joint parts in quality control department in orthopaedic factory
Deburring and finishing for beautiful, functional medical devices
A Medtronic HVAD pump opened up to show the inner workings
FDA designates new Medtronic HVAD pump implant recall as Class I

DeviceTalks Weekly.

July 1, 2022
Boston Scientific CEO Mike Mahoney on building a corporate culture that drives high growth results
See More >

MDO Digital Edition

Digital Edition

Subscribe to Medical Design & Outsourcing. Bookmark, share and interact with the leading medical design engineering magazine today.

MEDTECH 100 INDEX

Medtech 100 logo
Market Summary > Current Price
The MedTech 100 is a financial index calculated using the BIG100 companies covered in Medical Design and Outsourcing.
DeviceTalks

DeviceTalks is a conversation among medical technology leaders. It's events, podcasts, webinars and one-on-one exchanges of ideas & insights.

DeviceTalks

New MedTech Resource

Medical Tubing

Enewsletter Subscriptions

Enewsletter Subscriptions

MassDevice

Mass Device

The Medical Device Business Journal. MassDevice is the leading medical device news business journal telling the stories of the devices that save lives.

Visit Website
MDO ad
Medical Design and Outsourcing
  • MassDevice
  • DeviceTalks
  • MedTech 100 Index
  • Medical Tubing + Extrusion
  • Drug Delivery Business News
  • Drug Discovery & Development
  • Pharmaceutical Processing World
  • R&D World
  • About Us/Contact
  • Advertise With Us
  • Subscribe to Print Magazine
  • Subscribe to E-newsletter
  • Attend our Monthly Webinars
  • Listen to our Weekly Podcasts
  • Join our DeviceTalks Tuesdays Discussion

Copyright © 2022 WTWH Media, LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media LLC. Site Map | Privacy Policy | RSS

Search Medical Design & Outsourcing

  • Home
  • Medical Device Business
    • Mergers & Acquisitions
    • Financial
    • Regulatory
  • Applications
    • Cardiovascular
    • Devices
    • Imaging
    • Implantables
    • Medical Equipment
    • Orthopedic
    • Surgical
  • Technologies
    • Contract Manufacturing
    • Components
    • Electronics
    • Extrusions
    • Materials
    • Motion Control
    • Prototyping
    • Pumps
    • Tubing
  • Med Tech Resources
    • DeviceTalks Tuesdays
    • Digital Editions
    • eBooks
    • Manufacturer Search
    • Medical Device Handbook
    • MedTech 100 Index
    • Podcasts
    • Print Subscription
    • The Big 100
    • Webinars / Digital Events
    • Whitepapers
    • Video
  • 2022 Leadership in MedTech
    • 2022 Leadership Voting!
    • 2021 Winners
    • 2020 Winners
  • Women in Medtech