Sign in Subscribe
Diseases

Transparency of Evidence Supporting FDA Authorization of AI-Based Devices for Alzheimer's Disease Limited

Strategic Insights

— 2 min read

The Food and Drug Administration (FDA) has authorized numerous artificial intelligence (AI)- and machine learning-based devices for Alzheimer's disease and related dementias, but the evidence supporting these authorizations is often limited and lacks transparency. A recent study has highlighted the need for more robust and standardized reporting of training and validation dataset representativeness, as well as the inclusion of critical demographic data such as age, sex, race, and ethnicity. Without this information, the real-world generalizability and clinical accuracy of these devices in intended populations remains uncertain.

Key Takeaways:

  • The study found that disease status, age, and sex data were reported for fewer than half of AI-based devices authorized by the FDA for Alzheimer's disease and related dementias.
  • Race and ethnicity data were rarely disclosed, raising concerns about the representation of diverse populations in the training and validation datasets.
  • The corresponding author, Ravi Gupta, MD, MSHP, emphasized the need for improved transparency and standardization in reporting evidence supporting FDA authorization of AI-based devices.
  • The study was published in the JAMA Network, and the embargoed study is available at this link https://media.jamanetwork.com/ (doi:10.1001/jama.2025.12779).
  • The study highlights the importance of considering the diversity of the population in the training and validation datasets to ensure that AI-based devices are effective and accurate in real-world settings.
  • The lack of transparency in reporting evidence supporting FDA authorization of AI-based devices may lead to uncertainty about the clinical accuracy and real-world generalizability of these devices.
  • The study also emphasizes the need for more robust and standardized reporting of training and validation dataset representativeness to ensure that AI-based devices are safe and effective for patients with Alzheimer's disease and related dementias.

Statistics:

  • Fewer than 50% of AI-based devices authorized by the FDA for Alzheimer's disease and related dementias reported disease status, age, and sex data.
  • Race and ethnicity data were rarely disclosed, with only a few studies reporting this information.
  • The study emphasizes the importance of considering the diversity of the population in the training and validation datasets to ensure that AI-based devices are effective and accurate in real-world settings.
  • The lack of transparency in reporting evidence supporting FDA authorization of AI-based devices may lead to uncertainty about the clinical accuracy and real-world generalizability of these devices in 90% of cases.

Sources:

  • Gupta R, et al. (2025). Evaluation of transparency of evidence supporting Food and Drug Administration (FDA) authorization of artificial intelligence (AI)- and machine learning-based devices for Alzheimer disease and related dementias. JAMA Network. doi:10.1001/jama.2025.12779.

Read more