Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Comment
  • Published:

Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist

Nature Medicine volume 26, pages 1320–1324 (2020)Cite this article

Subjects

Here we present the MI-CLAIM checklist, a tool intended to improve transparent reporting of AI algorithms in medicine.

This is a preview of subscription content, access via your institution

Relevant articles

Open Access articles citing this article.

Access options

Buy this article

  • Purchase on Springer Link
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

Fig. 1

Code availability

A public Github repository (https://github.com/beaunorgeot/MI-CLAIM) has been set up to coincide with the release of this manuscript, which will allow the community to comment on existing sections and suggest additions.

References

  1. Schwartz, W. B. N. Engl. J. Med. 283, 1257–1264 (1970).

    Article  CAS  PubMed  Google Scholar 

  2. Shortliffe, E. H., Axline, S. G., Buchanan, B. G., Merigan, T. C. & Cohen, S. N. Comput. Biomed. Res. 6, 544–560 (1973).

    Article  CAS  PubMed  Google Scholar 

  3. Shortliffe, E. H. et al. Comput. Biomed. Res. 8, 303–320 (1975).

    Article  CAS  PubMed  Google Scholar 

  4. Ching, T. et al. J. R. Soc. Interface 15, (2018).

  5. Esteva, A. et al. Nat. Med. 25, 24–29 (2019).

    Article  CAS  PubMed  Google Scholar 

  6. Zou, J. et al. Nat. Genet. 51, 12–18 (2019).

    Article  CAS  PubMed  Google Scholar 

  7. Henry, K. E., Hager, D. N., Pronovost, P. J. & Saria, S. Sci. Transl. Med. 7, 299ra122 (2015).

    Article  PubMed  Google Scholar 

  8. Gulshan, V. et al. J. Am. Med. Assoc. 316, 2402–2410 (2016).

    Article  Google Scholar 

  9. Norgeot, B. et al. JAMA Netw. Open 2, e190606 (2019).

    Article  PubMed  PubMed Central  Google Scholar 

  10. Rajkomar, A. et al. NPJ Digit Med. 1, 18 (2018).

    Article  PubMed  PubMed Central  Google Scholar 

  11. Lipton, Z. C. Queue 16, 31–57 (2018).

    Article  Google Scholar 

  12. Topol, E.J. Deep Medicine: How Artificial Intelligence Can Make Healthcare Human Again 1st edn. (Basic Books, 2019).

  13. Rivera, S. C. et al. Nat. Med. https://doi.org/10.1038/s41591-020-1037-7 (2020).

  14. Liu, X. et al. Nat. Med. https://doi.org/10.1038/s41591-020-1034-x (2020).

  15. Moher, D. et al. Br. Med. J. 340, c869 (2010).

    Article  Google Scholar 

  16. von Elm, E. et al. Ann. Intern. Med. 147, 573–577 (2007).

    Article  Google Scholar 

  17. Schwarz, C. G. et al. N. Engl. J. Med. 381, 1684–1686 (2019).

    Article  PubMed  PubMed Central  Google Scholar 

  18. Obermeyer, Z., Powers, B., Vogeli, C. & Mullainathan, S. Science 366, 447–453 (2019).

    Article  CAS  PubMed  Google Scholar 

  19. Subbaswamy, A. & Saria, S. Biostatistics 21, 345–352 (2020).

    PubMed  Google Scholar 

  20. Poplin, R. et al. Nat Biomed Eng. 2, 158–164 (2018).

    Article  PubMed  Google Scholar 

  21. Pan, J., McGuinness, K., Sayrol, E., O’Connor, N. & Giro-i-Nieto, X. arXiv https://ui.adsabs.harvard.edu/abs/2016arXiv160300845P (2016).

  22. Lundberg, S. & Lee, S.-I. arXiv https://ui.adsabs.harvard.edu/abs/2017arXiv170507874L (2017).

Download references

Author information

Authors and Affiliations

  1. Bakar Computational Health Sciences Institute, University of California, San Francisco, San Francisco, CA, USA

    Beau Norgeot, Rima Arnaout & Atul J. Butte

  2. Scripps Research Translational Institute, San Diego, CA, USA

    Giorgio Quer, Ali Torkamani, Raquel Dias & Eric Topol

  3. Department of Biomedical Informatics, Boston, MA, USA

    Brett K. Beaulieu-Jones & Isaac S. Kohane

  4. Division of Rheumatology, Department of Medicine, University of California, San Francisco, San Francisco, CA, USA

    Milena Gianfrancesco

  5. Department of Computer Science, Johns Hopkins University, Baltimore, MD, USA

    Suchi Saria

  6. Bayesian Health, New York, NY, USA

    Suchi Saria

  7. Division of Health Policy and Management, School of Public Health, University of California at Berkeley, Berkeley, CA, USA

    Ziad Obermeyer

  8. Department of Statistics and Department of Electrical Engineering & Computer Science, University of California at Berkeley, Berkeley, CA, USA

    Bin Yu

Authors
  1. Beau Norgeot
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Giorgio Quer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Brett K. Beaulieu-Jones
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ali Torkamani
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Raquel Dias
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Milena Gianfrancesco
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Rima Arnaout
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Isaac S. Kohane
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Suchi Saria
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Eric Topol
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Ziad Obermeyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Bin Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Atul J. Butte
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Atul J. Butte.

Ethics declarations

Competing interests

I.S.K. is on the scientific advisory boards of Pulse Data and Medaware, both companies involved in predictive analytics. S.S. is a founder of, and holds equity in, Bayesian Health. The results of the study discussed in this publication could affect the value of Bayesian Health. This arrangement has been reviewed and approved by Johns Hopkins University in accordance with its conflict-of-interest policies. S.S. is a member of the scientific advisory board for PatientPing. B.K.B.-J. is a cofounder of Salutary, Inc. B.N. is employed by Anthem. A.J.B. is a cofounder of and consultant to Personalis and NuMedii; consultant to Samsung, Mango Tree Corporation and, in the recent past, 10x Genomics, Helix, Pathway Genomics and Verinata (Illumina); has served on paid advisory panels or boards for Geisinger Health, Regenstrief Institute, Gerson Lehman Group, AlphaSights, Covance, Novartis, Genentech, Merck and Roche; is a shareholder in Personalis and NuMedii; is a minor shareholder in Apple, Facebook, Google, Microsoft, 10x Genomics, Amazon, Biogen, Illumina, Snap, Nuna Health, Royalty Pharma, Sanofi, AstraZeneca, Assay Depot, Vet24seven, Regeneron, Moderna and Sutro, many of which use AI and predictive modeling, and several other non-health-related companies and mutual funds; and has received honoraria and travel reimbursement for invited talks from Genentech, Takeda, Varian, Roche, Pfizer, Merck, Lilly, Mars, Siemens, Optum, Abbott, Celgene, AstraZeneca, AbbVie, Johnson & Johnson, Westat and many academic institutions, state or national agencies, medical or disease specific foundations and associations, and health systems. A.J.B. receives royalty payments through Stanford University for several patents and other disclosures licensed to NuMedii and Personalis. A.J.B. has research funded by the NIH, Northrup Grumman (as the prime on an NIH contract), Genentech, Johnson & Johnson, FDA, US Department of Defense, Robert Wood Johnson Foundation, Leon Lowenstein Foundation, Intervalien Foundation, Priscilla Chan and Mark Zuckerberg, Barbara and Gerson Bakar Foundation and, in the recent past, the March of Dimes, Juvenile Diabetes Research Foundation, California Governor’s Office of Planning and Research, California Institute for Regenerative Medicine, L’Oreal and Progenity.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Norgeot, B., Quer, G., Beaulieu-Jones, B.K. et al. Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. Nat Med 26, 1320–1324 (2020). https://doi.org/10.1038/s41591-020-1041-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41591-020-1041-y

This article is cited by

Search

Advanced search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing