Global disparity bias in ophthalmology artificial intelligence applications
•,,,,,,,.
...
Machine learning (ML) is a branch of artificial intelligence (AI) that performs a classification, prediction and/or optimisation task. Similar to brain neurons, neural networks output a label after multiple information layers connection, resembling human thinking.1
AI is already influencing care in many areas, such as radiology, pathology, dermatology and ophthalmology. In ophthalmology, a variety of multimodal imaging examinations are fundamental in the screening, diagnosis and monitoring of diseases and provide data input for AI development.2 Some applications, such as the IDx Technologies (Coralville, USA) which was approved by the Food and Drug Administration 3 years ago, are already used in clinical practice as a screening tool.2 3 Surprisingly, algorithms can even predict gender, age and cardiovascular risk through retinal images.2 4 5 AI may reduce subjectivity and interobserver disagreement in clinical practice.1
Especially in low-income (LIC) and low-to-medium-income countries (LMIC), preventable blindness causes such as diabetic retinopathy (DR) and age-related macular degeneration could be prevented with screening programmes, home monitoring systems or telemedicine. AI-based screening could systematise screening and improve eye care in remote areas.6
ML requires high-quality, well-labelled, representative and large datasets, but at present, ophthalmological ML-ready datasets are only available in a few countries. One hundred seventy-two countries do not have representation in training and validation cohorts.7
Although data from all world countries are a distant goal, equivalent representation of all continents, ethnicities and the maximum number of countries is desired to reduce ML bias. Demographic information and other social determinants of health are typically not contained in these datasets, making it challenging to interrogate algorithms for bias.7 8 High-quality data are also fundamental for environmental-specific algorithm validation, which is essential before AI implementation.
Available automated DR algorithm performance varies considerably in performance in the real world due to limited training data, including heterogeneity in disease presentations and suboptimal image quality.9 In addition, diverse sociodemographic and ethnic representation are necessary if generalisability is a goal.8
In LICs and LMICs, there is a growing gap between the ophthalmologist workforce and the population size. Two-thirds of ophthalmologists live in only 17 countries and in those countries, most practice in the urban centres.10 AI applications can expand access to eye care and may reduce preventable blindness, which is currently 80% of cases.
In addition to diversifying datasets to build AI technology in healthcare, we must invest in building capacity for health informatics and data science across countries. International collaboration between research groups should be incentivised to narrow disparities in AI research in order to reduce world blindness.
Twitter: @MITCriticalData
Contributors: All authors designed and cowrote the draft of the paper and critically reviewed and edited the final draft. LFN and AK took responsibility for article concept.
Competing interests: None declared.
Provenance and peer review: Not commissioned; externally peer reviewed.
Kras A, Celi LA, Miller JB, et al. Accelerating ophthalmic artificial intelligence research: the role of an open access data Repository. Curr Opin Ophthalmol2020; 31:337–50. doi:10.1097/ICU.0000000000000678•Google Scholar•PubMed
Md A, PT L, M B, et al. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. Yearbook of Paediatric Endocrinology2019; doi:10.1530/ey.16.12.1•Google Scholar
Poplin R, Varadarajan AV, Blumer K, et al. Prediction of cardiovascular risk factors from retinal fundus Photographs via deep learning. Nat Biomed Eng2018; 2:158–64. doi:10.1038/s41551-018-0195-0•Google Scholar•PubMed
Xie Y, Gunasekeran DV, Balaskas K, et al. Health economic and safety considerations for artificial intelligence applications in diabetic retinopathy screening. Transl Vis Sci Technol2020; 9:22. doi:10.1167/tvst.9.2.22•Google Scholar•PubMed
Khan SM, Liu X, Nath S, et al. A global review of publicly available datasets for Ophthalmological imaging: barriers to access, usability, and generalisability. Lancet Digit Health2021; 3:e51-e66. doi:10.1016/S2589-7500(20)30240-5•Google Scholar•PubMed
Mitchell WG, Dee EC, Celi LA, et al. Generalisability through local validation: overcoming barriers due to data disparity in healthcare. BMC Ophthalmol2021; 21. doi:10.1186/s12886-021-01992-6•Google Scholar•PubMed
Lee AY, Yanagihara RT, Lee CS, et al. Multicenter, head-to-head, real-world validation study of seven automated artificial intelligence diabetic retinopathy screening systems. Diabetes Care2021; 44:1168–75. doi:10.2337/dc20-1877•Google Scholar•PubMed
Resnikoff S, Lansingh VC, Washburn L, et al. Estimated number of ophthalmologists worldwide (international Council of ophthalmology update): will we meet the needs? Br J Ophthalmol2020; 104:588–92. doi:10.1136/bjophthalmol-2019-314336•Google Scholar•PubMed