– A new white paper from Imperial College London highlights the opportunities and barriers for artificial intelligence (AI) to improve the health of the UK’s minority ethnic groups.
– The report argues AI has the potential to tackle the widespread disparities in healthcare.
– But if key challenges in the technology are not addressed, AI could widen health inequalities experienced by minority ethnic groups. 
– Key recommendations include improving diversity in the AI industry and academia, and developing legislation and regulation to reduce bias in data and the systems that harness them.

Data-driven technologies like artificial intelligence (AI) are powerful tools demonstrating potential in the diagnosis and treatment of diseases such as skin cancer. Yet these could inadvertently worsen the health inequalities experienced by minority ethnic groups if current challenges such as biased algorithms, poor data collection and a lack of diversity in research and development are not urgently addressed.

These are the findings from a new white paper by Imperial College London’s Institute of Global Health Innovation (IGHI), which calls for further research and transparent discussion on the creation and use of these technologies in health care. 

The white paper reviewed academic literature and policy evidence to identify the issues and opportunities for AI and data-driven technologies to improve the health and care of minority ethnic groups, who generally experience poorer health than the wider population, as emphasised by the COVID-19 pandemic. The study included interviews with a range of experts in the UK and internationally across academia, industry, NHS policy and practice, legal and regulatory bodies, patient-facing organisations and charities.

Artificial intelligence systems are created by combining large amounts of data, for example from research studies or the Internet. The information is then used to ‘train’ a computer programme or algorithm to make decisions based on the data. For example, using data, AI algorithms can create ‘risk scores’ to predict which patients might be likely to develop certain diseases in the future.  

Yet if much of this data is unrepresentative of minority ethnic groups and focuses predominantly on, for example White participants, then these systems are more likely to make decisions which exclude diverse communities. 

The report presents evidence of this racial bias in AI, demonstrating how minority ethnic groups can be underserved by technology. For example, facial recognition systems have shown to be up to 19% less accurate at recognising images of Black men and women compared to White individuals*. Such bias is also seen in AI when used in the detection and treatment of health conditions such as skin cancer. Images of White patients are predominantly used to train algorithms to spot melanoma which could lead to worse outcomes for Black people through missed diagnoses.

The authors argue unconscious and conscious bias in AI is partly fuelled by the lack of diversity in academia, among AI developers and at strategic levels of the health system and government. 

Experts interviewed for the report also voiced concern that the lack of diversity in the AI workforce could lead to solutions which are not fully representative of all users’ needs. The report advises that improving representation in this industry must go further than addressing recruitment processes. Rather, the issue should also be tackled at all stages of education from primary school to postgraduate level. 

The authors highlight examples of good practice seen across health and social care in both the UK and USA and propose actions to be undertaken across academia, among AI developers and at strategic levels of the health system and government to work towards developing a system that facilitates the development of more representative AI technologies, designed with equity in mind. At the national level, more is being done to tackle some of these inequities in healthcare. The Government recently announced two independent reviews**, following the publication of the “Levelling Up” White Paper***,  to tackle health disparities, including a review into the health impact of potential bias in medical devices.

Dr Saira Ghafur, digital health lead at the Institute of Global Health Innovation, said: “AI has tremendous potential for healthcare system delivery. However, our white paper shows how it can exacerbate existing health inequities in minority ethnic groups. By working across government, healthcare and the technology sector, it is crucial we ensure that no one is left behind.”

Lord James O’Shaughnessy, Visiting Professor at the Institute of Global Health Innovation, said: “Tackling health inequality is one of the major challenges of our time. Advances in AI and machine learning give us new tools to tackle this challenge, but our enthusiasm must be tempered by a realistic appraisal of the risks of these technologies inadvertently perpetuating inequalities.

“This paper explains how these risks could manifest and makes concrete proposals about how to mitigate them. Policymakers should heed the lessons of the report so that the wonderful advances in computer science can benefit those who most need it.”

Based on this research, the scientists make a series of recommendations to better enable AI for minority ethnic communities. These include: 
– Involving patients and the public in all areas of AI technology development. 
– Creating governance systems, legislation and regulation in AI which protect data and citizen’s rights. 
– Developing a regulatory framework to ensure algorithms are tested on and appropriate for minority ethnic groups to reduce bias in datasets.

Professor Ara Darzi, co-director of the Institute of Global Health Innovation, said: “Our new white paper identifies some important future considerations to maximise the potential of AI for the health of our entire nation. We hope that our report can be a catalyst for the important conversations that need to be had as we increasingly use AI in healthcare.”

Notes to Editors:

* Source: The Medical Futurist. A.I. Bias In Healthcare, The Medical Futurist. 2019 https://medicalfuturist.com/a-i-bias-in-healthcare

** Source: Government launches landmark reviews to tackle health disparities. https://www.gov.uk/government/news/government-launches-landmark-reviews-to-tackle-health-disparities

*** Source: Levelling Up the United Kingdom, UK Government. 2022. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1052706/Levelling_Up_WP_HRES.pdf

Download the report, ‘Addressing Racial and Ethnic Inequities in Data-Driven Health Technologies’ here, co-written by IGHI’s Dr Saira Ghafur, Lord O’Shaughnessy, Prof Ara Darzi, Niki O’Brien, Dr Jackie van Dael, Dr Jonathan Clarke and Clarissa Gardner.

Link to download: https://imperialcollegelondon.box.com/s/71mvwn5dp4d1y64lq2s53t2yzsfcv15d

For media enquiries, please contact Justine Alford: j.alford@imperial.ac.uk

About Imperial College London

Imperial College London is one of the world’s leading universities. The College’s 20,000 students and 8,000 staff are working to solve the biggest challenges in science, medicine, engineering and business. 

Imperial is University of the Year 2022 in the Times and Sunday Times Good University Guide. It is the world’s fifth most international university, according to Times Higher Education, with academic ties to more than 150 countries. Reuters named the College as the UK’s most innovative university because of its exceptional entrepreneurial culture and ties to industry.   

Imperial staff, students and alumni are working round-the-clock to combat COVID-19. Imperial is at the forefront of coronavirus epidemiology, virology, vaccine development and diagnostics. 

http://www.imperial.ac.uk/

About the Institute of Global Health Innovation

The Institute of Global Health Innovation is one of Imperial College London’s global challenge institutes whose mission is to transform health and care for all through evidence-based innovation. IGHI’s work supports the identification, development and widespread diffusion of innovations in healthcare.

https://www.imperial.ac.uk/global-health-innovation/