0% found this document useful (0 votes)
31 views11 pages

Ethical Concerns of AI in Healthcare

Uploaded by

ritik.sah03
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
31 views11 pages

Ethical Concerns of AI in Healthcare

Uploaded by

ritik.sah03
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

The current issue and full text archive of this journal is available on Emerald Insight at:

[Link]

Artificial intelligence in AI in
healthcare
healthcare: a comprehensive
review of its ethical concerns
Chokri Kooli 121
University of Quebec at Outaouais, Gatineau, Canada and
The University of Ottawa, Ottawa, Canada, and Received 23 December 2021
Revised 8 February 2022
Hend Al Muftah Accepted 8 February 2022

Doha Institute for Graduate Studies, Doha, Qatar

Abstract
Purpose – Nowadays, the digitized economy and technological advancements are increasing at a faster pace.
One such technology that is gaining popularity in the healthcare sector is Artificial Intelligence (AI). AI has
been debated much, searched so well due to the implications, issues and for its benefits in terms of ease, it will
offer. The following research has focused on examining the ethical dilemmas associated with AI when it will be
introduced in the healthcare sector.
Design/methodology/approach – A narrative review method focusing on content analysis has been used in
the research. The authors have employed a deductive approach to determine the ethical facets of adopting AI in
the healthcare sector. The current study is complemented by a review of related studies. The secondary data
have been collected from authentic resources available on the Internet.
Findings – Patient privacy, biased results, patient safety and Human errors are some major ethical dilemmas
that are likely to be faced once AI will be introduced in healthcare. The impact of ethical dilemmas can be
minimized by continuous monitoring but cannot be eliminated in full if AI is introduced in healthcare. AI
overall will increase the performance of the healthcare sector. However, we need to address some
recommendations to mitigate the ethical potential issues that we could observe using AI. Technological change
and AI can mimic the overall intellectual process of humans, which increases its credibility and also offers harm
to humans.
Originality/value – Patient safety is the most crucial ethical concern because AI is a new technology and
technology can lead to failure. Thus, we need to be certain that these new technological developments are
ethically applied. The authors need to evaluate and assess the organizational and legal progress associated
with the emergence of AI in the healthcare sector. It also highlights the importance of covering and protecting
medical practitioners regarding the different secondary effects of this artificial medical progress. The research
stresses the need of establishing partnerships between computer scientists and clinicians to effectively
implement AI. Lastly, the research highly recommends training of IT specialists, healthcare and medical staff
about healthcare ethics.
Keywords Artificial intelligence, Public health, Ethics, Social policy, Sustainability
Paper type Research paper

Introduction
The term Artificial Intelligence (AI) refers to the processes through which a system can mimic
human intellectual processes, such as reasoning ability, decision-making, generalization, or
learning from prior experiences, to accomplish objectives without being explicitly programmed
for particular actions (Copeland, 2020). In contrast to the intelligence of humans or other living
species, AI is defined as the intelligence of machines (Rong et al., 2020). Therefore, AI may
include the fields of machine learning, natural language processing and robotics, that can be
applied to almost any field in medicine, and it potentially contributes to biomedical research,
medical education and delivery of healthcare (Ramesh et al., 2004). AI also helps in those
situations in which machines can simulate like a human mind in learning processes and analysis Technological Sustainability
and thus can help in proper diagnosis, solving the problems and effective decision-making. Vol. 1 No. 2, 2022
pp. 121-131
Rong et al. (2020) admitted that the application of AI in healthcare sectors considerably © Emerald Publishing Limited
2754-1312
accelerated in the recent years. Thus, Eugenio Zuccarelli (2020) admitted that in 2019, the US DOI 10.1108/TECHS-12-2021-0029
TECHS investment in AI through healthcare was equal to $ 2,487.7 billion. Recent research study
1,2 published by Reports and Data (2021) estimates that the global Compound Annual Growth
Rate (CAGR) of the AI investments in healthcare market will continue to grow considerably.
Their estimations forecast a market size of $ 61.59 billion by 2027. From his side, Zakaryan
(2021) estimates that the CAGR of the AI investments in healthcare market will increase by
41.8% and will reach the level of $ 120.2 billion in 2028.
The increased AI deployment and investment in data protection in healthcare sector will
122 revolutionize the system and could be explained in several ways. Researchers (AlAhmad
et al., 2021; Sidhom, 2021; Barman et al., 2021) believe that the application of AI will improve
the, efficiency and performance of the healthcare system. As example, the relay on AI could
enhance oncological diagnosis. Also, the relay on technology will participate in improving the
quality of the offered services and reduce their costs. The latest Covid-19 pandemic showed
the increased recourse to telemedicine which also showed a broadening access to healthcare
delivery (Belisle-Pipon et al., 2021; Spatharou et al., 2020; Lee and Yoon, 2021). A recent report
of the Organisation for Economic Co-operation and Development (OECD) (2020) admitted
that the healthcare sector is a wasteful one and is being disqualified as inefficient. This
increased recourse to AI in health system administration and service redesign (OECD, 2020).
Other researchers (AlAhmad et al., 2021; OECD, 2020; Barman et al., 2021; Dilsizian and
Siegel, 2014) showed that the adoption of AI will greatly assist in clinical decision-making.
With the advancement in technology, AI has been one of the most debated aspects to be
used in the healthcare sector (Kooli, 2021). As explained by Zandi et al. (2019), AI in healthcare
is an overarching term that is being used to describe the utilization of software, machine
learning algorithms, or AI for emulating human cognition in the interpretation, analysis and
understanding of healthcare data. For example, AI-based diagnostic algorithms applied to
mammograms are assisting in the detection of breast cancer, serving as a second opinion for
radiologists (Shiraishi et al., 2011).
AI was applied to healthcare and generated well-performed medical applications (Jiang
et al., 2017; Davenport and Kalakota, 2019). Insilico Medicine, for example, has successfully
developed AI algorithms that can stop viral reproduction (McCall, 2020). Another idea (Rong
et al., 2020) tries to protect pregnant women by giving them nutrition advice based on their
health status and algorithm projections. Another brilliant AI innovation, epileptic seizure
prediction, helped to reduce the impact of epileptic crises (Cook et al., 2013). With AI and the
development of a novel movement-detecting gadget, it was also possible to predict early
stroke with a high rate of success (Villar et al., 2015). IBM Watson is another reliable AI
system that could effectively assist in the diagnosis of cancer (Somashekhar et al., 2017).
Technological progress helped also to generate systems that simulate the functionality of the
human brain (Hassabis et al., 2017) as well as medical applications of radiosurgery (Siddique
and Chow, 2020). The medical healthcare sector got also the support of AI through the
generation of new systems and tools like artificial surgeries simulators, personal digital care,
healthcare devices and neurological disorders software detectors.
The implementation of AI has gone through various developments, due to which various
ethical issues have emerged. Some of such issues include patient safety in terms of data
(Challen et al., 2019; Choudhury and Asan, 2020), the relationship between the doctor and a
patient is at stake (Hashimoto et al., 2018), as the doctors have to rely on the black box AI
algorithm to derive the diagnosis.
To the best of our knowledge, during the last three years, only three research studies
directly focused on studying the ethical challenges associated with the introduction of AI in
healthcare. The first research work (Char et al., 2018) focused on studying the ethical
challenges associated with potential errors that algorithms may generate and how they can
impact the decision-making process. The same research work (Char et al., 2018) raised the
ethical concern of algorithms and how they could become a repository of the collective
medical mind. Another research work (Guan, 2019) studied the governmental role in AI in
protecting the ethical values associated with the emergence of AI in healthcare. The healthcare
researcher stressed the need for governments to perform ethical auditing and specify the
responsibilities of stakeholders in the ethical governance system. Another researcher (Gerke
et al., 2020) identified the legal challenges posed by AI in healthcare in the USA and Europe.
They support the idea of protecting ethical values by the force of law and through the
reinforcement of regulation.
The progress of the use of AI in healthcare and medical care is very fast. As much as we 123
recourse to AI, as much as we face more ethical challenges associated with this technological
development. Contrarily, the speed of research and the concerns of social sciences researchers
regarding the ethical challenges are not progressing as desired. This research comes to fill the
observed gap. Those ethical challenges must be identified and mitigated as long as it
threatens patient’s preference, safety and privacy. Therefore, the focus of the current study is
on examining AI and public health and the ethical associated dilemmas. This research study
aims to (1) study the concept of AI and its developments. (2) Analyze the AI usage in the
healthcare sector. (3) Assess the ethical dilemmas due to AI implications in the healthcare
sector. (4) Offer recommendations to the healthcare professionals for minimizing the
dilemmas and consider the implementation of AI, quite comprehensively.

Research methodology
A narrative review research method focusing on content analysis has been used. We have
employed a deductive approach to determine the ethical facets of adopting AI in the
healthcare sector. The current study is complemented by a review of related studies. The
secondary data have been collected from authentic resources available on the Internet. We
mainly used research through Google scholar by referring to words such as “ethical
challenges”; “Artificial intelligence” “Healthcare and medical sectors”. The first research
using these three keywords as the main components of the research titles makes it possible to
get only three manuscripts published by the end of 2020. The limited number of papers
observed pushed us to extend the search parameters by looking for these keywords
anywhere in the article. Changing the search parameters, making it possible to retain 22
interesting research. We mainly tried to catch the progress observed in terms of the use of AI
in the health sector. We also tried to look at the different ethical challenges that could be
observed by practicians, researchers and users.

Advantages of AI in the public health sector


Public health is doing its best to achieve optimal health outcomes by designing and
implementing such standards which can modify the diagnosis and treatment of diseases.
There is no doubt that AI had widespread ramifications that revolutionized the practice of
medicine, transforming the patient experience and physicians’ daily routines. The AI applied
to healthcare generated several positive outcomes (Harrison, 2018; Serag et al., 2019;
Tschandl et al., 2020; Dembrower et al., 2020; Sechopoulos et al., 2021). The diagnosis became
faster and more accurate through the application of AI tools and systems (Harrison, 2018;
Serag et al., 2019). As stressed above, today it is possible to diagnose skin cancer via an
intelligent computer program (Tschandl et al., 2020). Similarly, recently developed algorithms
could help physicians to make better diagnostics applied to mammograms (Dembrower et al.,
2020; Sechopoulos et al., 2021) in particular, and medical issues in general.
Also, researchers reported that AI applications are improving the ability of the technology
to enhance diagnosis and care accuracy. AI helps in improving the benefits of health
initiatives such as analysis of non-structured or semi-structured text from e-health reports,
TECHS online media and publications for evaluating the effect of suggestions and actions on public
1,2 health (Tucker et al., 2019). There are several AI-based models which can help in interpreting
the radiographs (Majkowska et al., 2020). Digital pathology is a more recent groundbreaking
advancement, while radiology imaging was the first to introduce digital data (Dreyer and
Geis, 2017). Most hospitals have also digitalized their health records to store their data
(Bukowski et al., 2020). AI applications, in general, have supported physicians and physicians
in the field of information systems for health, disease and condition tracking, predictive
124 support for modeling, decision-making and imagery.
Thus, we can say that the implementation of AI will prove beneficial for healthcare, as a
diagnosis will be automated, hassle-free, and will offer ease to the patients. AI will take the
healthcare sector up to the next level. IT will work as a game-changer in healthcare, as AI will
result in creating an efficient healthcare ecosystem. AI implementation will reveal the disease
risks quite early and will help us to save lives at an earlier stage. Nonetheless, one may
question if developers and practitioners of AI for healthcare applications have values that are
always aligned with the values of clinicians? Are they committed to legal requirements that
regulate the AI processes and implementation? And to what extent profit versus best patient
outcomes and safety are conflicted? Thus, there are some queries about AI practices to lay
down the ethical foundation for using its technology safely and effectively in healthcare,
including patient privacy, safety and medical education.

Ethical dilemmas in AI and public health


The use of AI in the clinical practice of healthcare has huge potential to transform it for the
better and improve the efficiency of medical diagnosis and healthcare applications in general,
but it also generated certain ethical concerns. Safety is one of the biggest challenges for AI in
healthcare. A very good example is IBM Watson for oncology (Siddique and Chow, 2020) that
uses AI algorithms to assess information from patients’ medical records and help physicians
explore cancer treatment options for their patients, which has later come under criticism by
reportedly giving unsafe and incorrect recommendations for cancer treatments. The problem
is that instead of using real patient data, the piece of software was only trained with a few
synthetic cancer cases, meaning they were only developed by doctors (Brown, 2018). AI
algorithms indeed help doctors in diagnosis and treatment by analyzing patient information
such as IBM Watson oncology to discover the best treatment options. However, there are
times when the system was unable to provide appropriate diagnoses and recommendations
(Ross and Swetlitz, 2018).
Another issue arises when the AI algorithms are trained on data of specific people; it gives
biased results (Chen et al., 2021). In this condition, AI-based systems will not be able to give
relevant and accurate results for every patient and could amplify existing societal biases
(Madaio et al., 2020). Such a situation will lead to incorrect diagnosis and treatment. AI offers
results that are biased because this is the difference between technology and humans. This
situation can be resolved by collecting a large amount of correct and relevant data. This
example raises very important questions related to the reliability and validity of the used data
in developing and implementing AI and developers’ and portioners’ transparency and biased
decisions. Indeed, any AI system or human-trained algorithm will only be as trustworthy,
effective, valid and fair as the reliable data that it is trained with as the honest and transparent
developers and practitioners.
On the other hand, rising concern regarding the risk of breach of patient privacy and
confidentiality is more than preoccupying (Verma et al., 2021; Saheb et al., 2021). For example,
the application of facial recognition technology could constitute a serious threat to the proper
informed consent, incidental findings and data security. In addition, the emergence of AI
could be associated with certain dangers that need to be legitimated and elucidated through
the update of policies, procedures, informed consent and other legal documents. The privacy AI in
of patients is considered as one of the main ethical challenges. healthcare
Healthcare organizations are at risk from data breaches because they rapidly threaten
patient trust, leading to people failing to disclose vital health information from physicians.
Landi (2022) noticed that, in 2021, the number of cyber-attacks observed in the USA attained
an all-time peak. In fact, the data collected from the US Department of Health and Human
Services admitted that 45 million individuals were affected by healthcare cyber-attacks.
Research conducted by CALYPTIX Security (2018), admitted that there are 5 main factors 125
that could lead to or motivate a health information piracy. In fact, in 33.5% of cases the loss or
non-protection of data is associated with Human Errors. Also, in Healthcare sector, the data
Misuse or use in non-preauthorized activities comes in the second place with 29.5% of cases.
The threat of physical theft comes in the third place with 16.3% of cases, followed by hacking
which counts for 14.8% of cases. Malwares are viewed as the most rarely reason with 10.8%
of cases. A concrete example of data security breach was observed in Goggin (2019) article. In
fact, in 2019, Facebook employed AI to collect data from users’ postings and then forecast
their mental health and proclivity for suicide. As a result, Facebook collected and kept users’
mental health information without their knowledge or consent. Another case health records
threat was reported by the journalist Alder (2020). Accordingly, the stage data, personal and
health information of more than 2.5 million US patients was published online by an AI firm
named Cense AI. The data were openly accessible through the internet and required no
credentials to retrieve. These data had been temporarily stored into a storage repository
before becoming deposited into the AI system, according to the author.
Most of the time, AI-based systems solutions can violate the privacy rights of the patients.
AI-based applications raise some concerns about user agreements. A contract that a person
agrees to without a face-to-face dialog is contrary to the generally informed process of consent
(Klugman et al., 2018). Most of the time, people do not take time and regularly violate user
agreements (Friedman et al., 2000). Accordingly, some concerns may arise as to what kind of
data should be gathered by AI developers and practitioners? For what purposes patients’ data
can be processed, used and shared? Can patients have the right to withdraw their data? What
about the vulnerability to both cyber and physical threats and hazards? Indeed, in the world of
big data, it is of pivotal importance that there are data protection laws in place that adequately
protect the privacy of individuals and patients (Pavlova et al., 2019). Regarding the patient’s
privacy, Voigt and Von dem Bussche (2017) reminded us that we live in a knowledge society
characterized by a continuous accelerating pace of technical progress. Consequently, there is an
urgent need to protect patients’ data from technological progress. Thus, Voigt and Von dem
Bussche (2017) highlight the importance of the reference to the concepts of Privacy by Design
and Privacy by Default. The concept of privacy protection by design consists of limiting the
data collected to the strict necessary minimal level. The concept of privacy protection by default
is referred to in the Art. 25 Sec. 2 of General Data Protection Regulation (GDPR) is also useful
once we refer to extending the use of AI. By relying on this concept, the data processor will only
and strictly have access to personal data that is necessary to execute the purpose of his mission
(Voigt and Von dem Bussche, 2017). Researchers and AI specialists should consequently be
aware of these principles to better protect the patient’s privacy.
The emergence of AI in the healthcare sector will lower the level of Human errors, will also
lower the level of Human legal responsibility. However, legally speaking, who is going to be
accountable and responsible for the diagnosis of errors that could potentially make AI
through machines? Consequently, another serious ethical dilemma emerges. Machine
learning-based clinical guidance leads to the introduction of third-party actors thus
challenging dynamics of responsibility in patient–doctor relationships.
A more comprehensive model to sum up the AI ethical dilemmas and benefits are
mentioned in Table 1.
TECHS Risk priority number (RPN)
1,2 Occurrence Severity Detactability
Benefits Risks (O) (S) (D) RPN

Improving efficiencies for The fast pace of 10 10 6 600


the operational technology and impact
management of healthcare on decision-making
126 businesses processes
Accuracy of diagnosis and Moral hazard and 5 10 5 250
treatment in personal human intervention
medicine
Table 1. Increased insights to Lack of regulation and 10 10 9 900
RPN, benefits and risks enhance cohort treatment algorithm bias
associated with the Privacy pressures 10 10 10 1,000
application of AI in the Safety 10 10 10
healthcare sector Human errors 5 10 10 500

Discussion and recommendations


This research aimed to (1) study the concept of AI and its developments. Through this
research, we were able to report the technological progress observed in terms of the use of AI
in the health and medical fields. The research conducted has even enunciated and unfolded
the ethical dilemmas that are likely to be raised when AI will be introduced in healthcare.
The actual research aimed also to (2) Analyze the AI usage in the healthcare sector. The
findings confirm that safety is one of the most important ethical dilemmas being faced.
Challenging dynamics of responsibility in the patient-doctor relationship is also one of the
prime ethical dilemmas being encountered. AI is capable of mimicking the overall intellectual
process of humans, which increases its credibility and also offers harm to humans. It was also
found that patient safety is the most crucial ethical dilemma, as, at the end of the day, AI is a
new technology and technology can lead to failure. The findings are in accordance with the
literature as Klugman et al. (2018) averred, concerns about user agreements and hacking of the
patient’s personal data impose a huge influence on the overall introduction of AI in healthcare.
Finally, we agree with Majkowska et al. (2020), that AI, on the whole, will increase the
performance of the healthcare sector. However, we need to address some recommendations to
mitigate the ethical potential issues that we could observe through the use of AI.
The third research objective consists of (3) assessing the ethical dilemmas due to AI
implications in the healthcare sector. The researcher was able to conclude that the potential
harms and risks associated with AI application need also to be transparent to avoid any
potential ethical issues. Today, we need to evaluate and assess the organizational and legal
progress associated with the emergence of AI in the healthcare sector. To avoid any ethical
dilemmas in the application of AI, it becomes important to verify that these new tools and
systems are ethically applied. We must also be certain that medical practitioners are well
covered and protected regarding the different secondary effects of this artificial medical
progress. In addition, it becomes important to guarantee the safety and security of patients
and protect their rights even if that one day they will be applied to deal with systems and not
physicians.
The last objective (4) consists of offering recommendations to the healthcare professionals
to minimize the dilemmas and consider the implementation of AI, quite comprehensively.
Previous research conducted by Wolff (2021) suggested 3 key success factors of AI in
healthcare sector. The first factor recommends the setting of a risk adjusted policy frame that
clarifies the limits of actions in term of precautions, permissions, accountability, liability and
culpability. The second success criteria suggest maintaining a centralized technology
architecture that allows for practical and lawful metadata. Finally, Wolff (2021) highlights the AI in
necessity of having key performance indicators (KPI) that measure the medical and economic healthcare
impact of AI in healthcare. Building on that, we suggest 4 key success factors of AI in
healthcare sector that could potentially reduce the impact of the observed ethical dilemmas.
Patient safety and privacy remain paramount, therefore, the development of a regulated way
(1) by establishing a partnership between computer scientists and clinicians should be
considered to implement AI effectively. Here, the focus needs to go through adopting
appropriate laws, regulations and policies that organize and regulate the use of AI in 127
healthcare. Such measures will also protect rights and specify duties of users and patients.
Secondly, training (2) healthcare staff members, nurses and doctors toward AI will lead to a
far more comprehensive introduction of AI. Thirdly, we recommend that the teaching of
ethics, AI ethics, and AI courses (3), become mandatory in all IT, medical and paramedical
training programs. Finally, we need to mention that AI, however, should be implemented to
reduce the health inequality (4) not increase, from all aspects geographically, economically
and socially.

Conclusion
Technological advancement is surely beneficial for our environment and society, but it is
important to remember that the misuse of these techniques can lead to the downfall of
humanity. Today, we become more aware about the importance and potential of AI in
transforming healthcare services delivery. As of today, we observed several AI technology-
based developments that completely innovated and transformed the organization and
delivery of healthcare services and practice. The continuous and effective use of AI in
healthcare will increase its clinical and operational efficiency. Also, the continuous
investment in the research and development of AI algorithms and machine learning will
continually sustain the accuracy of AI predictions and optimize levels of data privacy use and
protection and network security in this context. Thus, for making the best use of these
advancements, it is important to control its growth.
Governments and policymakers need to better control this growth by implementing laws
and regulations that regulate and limit the frontiers of development. Researchers need to be
more sensitized about the importance of the respect of ethical values as well as the importance
of technological progress. Organizations that work toward technological advancements must
work toward quality control. Keeping control of their system and marinating their systems
will help them produce technology that is safe and healthy for the environment, people and
the planet. The research stressed that ultimately, patients will still be treated by physicians
no matter how much AI changes the delivery and quality of healthcare, and there will always
be a human element in the practice of medicine, however, AI will remain as a technological
tool that should benefit the healthcare, however, with more ethical foundation. The paper also
revealed the existence of some ethical dilemmas that are associated with the use of AI in the
medical and healthcare fields. Privacy of patients and data protection, safety, as well as
patient-doctor relationships are amongst the most highlighted ones. Technological
advancement is expected to affect almost all aspects of human life, especially the way
humans work. The advancement will have an equal impact on both the overall functionality
due to ethical dilemmas raised.
It is concluded that the impact of ethical dilemmas can be minimized but cannot be
eliminated in full if AI is introduced in healthcare. Every technology has its pros and cons as
well as concerns, therefore, no one can eliminate the ethical issues associated with the use of
AI in healthcare. However, these ethical issues can be minimized by continuous monitoring.
A balance between AI and the human workforce will also somehow help to solve ethical
dilemmas. Only complex tasks and diagnoses need to be done by AI, not everything.
TECHS AI will only see what it is programmed to see whereas an experienced medical professional
1,2 will see and diagnose what is not apparent.

References
AlAhmad, Y.M., Haggeer, D.M., Alsayed, A.Y., Haik, M.Y., AbuAfifeh, L.M., Aljaber, M.H., Mohamed,
A.A., Balideh, M., Almutawa, N. and Mahmoud, M.H. (2021), “The effect of telemedicine on
128 patients’ compliance in family medicine follow-ups in Qatar”, Avicenna, Vol. 2022 No. 1, p. 3.
Alder, S. (2020), “AI company exposed 2.5 million patient records over the internet”, HIPAA Journal,
available at: [Link]
over-the-internet/ (accessed 21 August 2020).
Barman, M., Hussain, T., Abuswiril, H., Illahi, M.N., Sharif, M., Saman, H.T., Hassan, M., Gaafar, M.,
Abu, J., Ahmad, M.K.K. and Kamar, M.A. (2021), “Embracing healthcare delivery challenges
during a pandemic. Review from a nodal designated COVID-19 center in Qatar”, Avicenna, Vol.
2021 No. 2, p. 8.
Belisle-Pipon, J.C., Couture, V., Roy, M.C., Ganache, I., Goetghebeur, M. and Cohen, I.G. (2021), “What
makes artificial intelligence exceptional in health technology assessment?”, Frontiers in
Artificial Intelligence, Vol. 4, p. 736697, doi: 10.3389/frai.2021.736697.
Brown, J. (2018), IBM Watson Reportedly Recommended Cancer Treatments that Were ‘Unsafe and
Incorrect’, Gizmodo, available at: [Link]
cancer-treatments-tha-1827868882 (accessed 20 April 2021).
Bukowski, M., Farkas, R., Beyan, O., Moll, L., Hahn, H., Kiessling, F. and Schmitz-Rode, T. (2020),
“Implementation of eHealth and AI integrated diagnostics with multidisciplinary digitized data: are
we ready from an international perspective?”, European Radiology, Vol. 30 No. 10, pp. 5510-5524.
CALYPTIX Security (2018), “Top 5 causes of data breaches in healthcare”, available at: [Link]
[Link]/hipaa/top-5-causes-of-data-breaches-in-healthcare/ (accessed 26 March 2018).
Challen, R., Denny, J., Pitt, M., Gompels, L., Edwards, T. and Tsaneva-Atanasova, K. (2019), “Artificial
intelligence, bias and clinical safety”, BMJ Quality and Safety, Vol. 28 No. 3, pp. 231-237.
Char, D.S., Shah, N.H. and Magnus, D. (2018), “Implementing machine learning in health care—
addressing ethical challenges”, The New England Journal of Medicine, Vol. 378 No. 11, p. 981.
Chen, I.Y., Pierson, E., Rose, S., Joshi, S., Ferryman, K. and Ghassemi, M. (2021), “Ethical machine
learning in healthcare”, Annual Review of Biomedical Data Science, Vol. 4, pp. 123-144.
Choudhury, A. and Asan, O. (2020), “Role of artificial intelligence in patient safety outcomes:
systematic literature review”, JMIR Medical Informatics, Vol. 8 No. 7, e18599.
Cook, M.J., O’Brien, T.J., Berkovic, S.F., Murphy, M., Morokoff, A., Fabinyi, G., D’Souza, W., Yerra, R.,
Archer, J., Litewka, L., Hosking, S., Lightfoot, P., Ruedebusch, V., Sheffield, W.D., Snyder, D.,
Leyde, K. and Himes, D. (2013), “Prediction of seizure likelihood with a long-term, implanted
seizure advisory system in patients with drug-resistant epilepsy: a first-in-man study”, The
Lancet Neurology, Vol. 12 No. 6, pp. 563-571.
Copeland, B.J. (2020). “Artificial intelligence”, Britannica, available at: [Link]
technology/artificial-intelligence.
Davenport, T. and Kalakota, R. (2019), “The potential for artificial intelligence in healthcare”, Future
Healthcare Journal, Vol. 6 No. 2, p. 94.
Dembrower, K., W ahlin, E., Liu, Y., Salim, M., Smith, K., Lindholm, P., . . . Strand, F. (2020), “Effect of
artificial intelligence-based triaging of breast cancer screening mammograms on cancer
detection and radiologist workload: a retrospective simulation study”, The Lancet Digital
Health, Vol. 2 No. 9, pp. e468-e474.
Dilsizian, S.E. and Siegel, E.L. (2014), “Artificial intelligence in medicine and cardiac imaging:
harnessing big data and advanced computing to provide personalized medical diagnosis and
treatment”, Current Cardiology Reports, Vol. 16 No. 1, pp. 1-8.
Dreyer, K.J. and Geis, J.R. (2017). “When machines think: radiology’s next Frontier”, Radiology, AI in
Vol. 285 No. 3, pp. 713-718, doi: 10.1148/radiol.2017171183.
healthcare
Friedman, B., Felten, E. and Millett, L.I. (2000), “Informed consent online: a conceptual model and
design principles”, University of Washington Computer Science and Engineering Technical
Report 00–12–2, p. 8.
Gerke, S., Minssen, T. and Cohen, G. (2020), “Ethical and legal challenges of artificial intelligence-
driven healthcare”, Artificial Intelligence in Healthcare, Academic Press, pp. 295-336, doi: 10.
1016/B978-0-12-818438-7.00012-5. 129
Goggin, B. (2019), Inside Facebook’s Suicide Algorithm: Here’s How the Company Uses Artificial
Intelligence to Predict Your Mental State from Your Posts, Business Insider, available at: https://
[Link]/facebook-is-using-ai-to-try-to-predict-if-youre-suicidal-2018-12.
Guan, J. (2019), “Artificial intelligence in healthcare and medicine: promises, ethical challenges and
governance”, Chinese Medical Sciences Journal, Vol. 34 No. 2, pp. 76-83.
Harrison, C. (2018), “FDA backs clinician-free AI imaging diagnostic tools”, Nature Biotechnology,
Vol. 36 No. 8, p. 673.
Hashimoto, D.A., Rosman, G., Rus, D. and Meireles, O.R. (2018), “Artificial intelligence in surgery:
promises and perils”, Annals of Surgery, Vol. 268 No. 1, p. 70.
Hassabis, D., Kumaran, D., Summerfield, C. and Botvinick, M. (2017), “Neuroscience-inspired artificial
intelligence”, Neuron, Vol. 95 No. 2, pp. 245-258.
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H. and Wang, Y. (2017),
“Artificial intelligence in healthcare: past, present and future”, Stroke and Vascular Neurology,
Vol. 2 No. 4.
Klugman, C.M., Dunn, L.B., Schwartz, J. and Cohen, I.G. (2018), “The ethics of smart pills and self-
acting devices: autonomy, truth-telling, and trust at the dawn of digital medicine”, The
American Journal of Bioethics, Vol. 18 No. 9, pp. 38-47, doi: 10.1080/15265161.2018.1498933.
Kooli, C. (2021), “COVID 19: public health issues and ethical dilemmas”, Ethics, Medicine and Public
Health, 100635, Vol. 17, 100635, ISSN 2352-5525, doi: 10.1016/[Link].2021.100635.
Landi, H. (2022), “Healthcare data breaches hit all-time high in 2021, impacting 45M people”, Health
Tech, available at: [Link]
all-time-high-2021-impacting-45m-people (accessed 2 February 2022).
Lee, D. and Yoon, S.N. (2021), “Application of artificial intelligence-based technologies in the
healthcare industry: opportunities and challenges”, International Journal of Environmental
Research and Public Health, Vol. 18 No. 1, p. 271.
Madaio, M.A., Stark, L., Wortman Vaughan, J. and Wallach, H. (2020), “Co-designing checklists to
understand organizational challenges and opportunities around fairness in ai”, Proceedings of
the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1-14.
Majkowska, A., Mittal, S., Steiner, D.F., Reicher, J.J., McKinney, S.M., Duggan, G.E., Eswaran, K.,
Cameron Chen, P.H., Liu, Y., Kalidindi, S.R., Ding, A., Corrado, G.S., Tse, D. and Shetty, S. (2020).
“Chest radiograph interpretation with deep learning models: assessment with radiologist-
adjudicated reference standards and population-adjusted evaluation”, Radiology, Vol. 294 No. 2,
pp. 421-431, doi: 10.1148/radiol.2019191293, available at: [Link]
31793848/.
McCall, B. (2020), “COVID-19 and artificial intelligence: protecting health-care workers and curbing the
spread”, The Lancet Digital Health, Vol. 2 No. 4, pp. e166-e167.
OECD (2020), Trustworthy AI in Health, Background Paper for the G20 AI Dialogue, Digital Economy
Task Force, Saudi Arabia, 1–2 April 2020, available at: [Link]
[Link].
Pavlova, T., Zarutska, E., Pavlov, R. and Kolomoichenko, O. (2019), “Ethics and law in Kant’s views:
the principle of complementarity”, International Journal of Ethics and Systems, Vol. 35 No. 4, pp.
651-664, doi: 10.1108/IJOES-04-2019-0080.
TECHS Ramesh, A.N., Kambhampati, C., Monson, J.R.T. and Drew, P.J. (2004), “Artificial intelligence in
medicine”, Annals of the Royal College of Surgeons of England, Vol. 86 No. 5, p. 334.
1,2
Regulation, G.D.P. (n.d) General Data Protection Regulation (GDPR)–Official Legal Text.
Reports and Data (2021), Artificial Intelligence (AI) in Healthcare Market Size Worth $61.59 Billion by
2027, available at: [Link]
Artificial-Intelligence-AI-in-Healthcare-Market-Size-Worth-61-59-Billion-By-2027-CAGR-of-43-6-
[Link] (accessed 19 January 2021).
130
Rong, G., Mendez, A., Assi, E.B., Zhao, B. and Sawan, M. (2020). “Artificial intelligence in healthcare:
review and prediction case studies”, Engineering, Vol. 6 No. 3, pp. 291-301, available at: https://
[Link]/science/article/pii/S2095809919301535.
Ross, C. and Swetlitz, I. (2018), “IBM’s Watson supercomputer recommended ‘unsafe and incorrect’
cancer treatments, internal documents show”, Stat News, available at: [Link]
com/2018/07/25/ibm-watson-recommended-unsafe-incorrect-treatments, [Link]
com/wp-content/uploads/2018/09/IBMs-Watson-recommended-unsafe-and-incorrect-cancer-
[Link].
Saheb, T., Saheb, T. and Carpenter, D.O. (2021), “Mapping research strands of ethics of artificial
intelligence in healthcare: a bibliometric and content analysis”, Computers in Biology and
Medicine, Vol. 135, 104660.
Sechopoulos, I., Teuwen, J. and Mann, R. (2021), “Artificial intelligence for breast cancer detection in
mammography and digital breast tomosynthesis: state of the art”, Seminars in Cancer Biology,
Academic Press, Vol. 72, pp. 214-225.
Serag, A., Ion-Margineanu, A., Qureshi, H., McMillan, R., Saint Martin, M.-J., Diamond, J., O’Reilly, P.
and Hamilton, P. (2019), “Translational AI and deep learning in diagnostic pathology”,
Frontiers in Medicine, Vol. 6, p. 185.
Shiraishi, J., Li, Q., Appelbaum, D. and Doi, K. (2011), “Computer-aided diagnosis and artificial
intelligence in clinical imaging”, Seminars in Nuclear Medicine, WB Saunders, Vol. 41 No. 6, pp.
449-462.
Siddique, S. and Chow, J.C. (2020), “Artificial intelligence in radiotherapy”, Reports of Practical
Oncology and Radiotherapy, Vol. 25 No. 4, pp. 656-666.
Sidhom, O. (2021), “Physical and mental health aspects in COVID-19: two sides of a coin”, Avicenna,
Vol. 2021 No. 2, p. 6.
Somashekhar, S.P., Kumarc, R., Rauthan, A., Arun, K.R., Patil, P. and Ramya, Y.E. (2017), “Abstract
S6-07: double blinded validation study to assess performance of IBM artificial intelligence
platform, Watson for oncology in comparison with Manipal multidisciplinary tumour board–
first study of 638 breast cancer cases”, available at: [Link]
77/4_Supplement/S6-07/624543/Abstract-S6-07-Double-blinded-validation-study-to.
Spatharou, A., Hieronimus, S. and Jenkins, J. (2020), Transforming Healthcare with AI: The Impact on
the Workforce and Organizations, McKinsey & Company, p. 10, available at: [Link]
[Link]/industries/healthcare-systems-and-services/our-insights/transforming-
healthcare-with-ai.
Tschandl, P., Rinner, C., Apalla, Z., Argenziano, G., Codella, N., Halpern, A., Janda, M., Lallas, A.,
Longo, C., Malvehy, J., Paoli, J., Puig, S., Rosendahl, C., Soyer, H.P., Zalaudek, I. and Kittler, H.
(2020), “Human–computer collaboration for skin cancer recognition”, Nature Medicine, Vol. 26
No. 8, pp. 1229-1234.
Tucker, T.C., Durbin, E.B., McDowell, J.K. and Huang, B. (2019). “Unlocking the potential of
population-based cancer registries”, Cancer, Vol. 125 No. 21, pp. 3729-3737, doi: 10.1002/
cncr.32355.
Verma, P., Kumar, S. and Sharma, S.K. (2021), “Multiple dimensions of e-healthcare ethics and its
relationship to the ethical concerns of the consumer”, International Journal of Ethics and
Systems, Vol. 37 No. 1, pp. 70-89, doi: 10.1108/IJOES-04-2020-0056.
Villar, J.R., Gonzalez, S., Sedano, J., Chira, C. and Trejo-Gabriel-Galan, J.M. (2015), “Improving human AI in
activity recognition and its application in early stroke diagnosis”, International Journal of
Neural Systems, Vol. 25 No. 04, 1450036. healthcare
Voigt, P. and Von dem Bussche, A. (2017), The EU General Data Protection Regulation (GDPR), A
Practical Guide, 1st ed., Vol. 10, Springer International Publishing, Cham, 3152676.
Wolff, J. (2021), “Success factors of artificial intelligence implementation in healthcare”, Frontiers in
Digital Health, Vol. 3, p. 51.
131
Zakaryan, Vahan (2021), AI Future in Healthcare: Improving the Effectiveness of Medical Care,
available at: [Link]
medical-care/ (accessed 2 December 2021).
Zandi, D., Reis, A., Vayena, E. and Goodman, K. (2019), “New ethical challenges of digital technologies,
machine learning and artificial intelligence in public health: a call for papers”, Bulletin of the
World Health Organization, Vol. 97 No. 1, pp. 2-2.
Zuccarelli, E. (2020), 3 AI Trends that Will Revolutionise Healthcare. Towards Data Science, available
at: [Link]
(accessed 7 December 2020).

Corresponding author
Chokri Kooli can be contacted at: ibm4chk@[Link]

For instructions on how to order reprints of this article, please visit our website:
[Link]/licensing/[Link]
Or contact us for further details: permissions@[Link]

Common questions

Powered by AI

While AI in healthcare offers significant benefits like enhanced diagnostic accuracy, personalized treatment, and operational efficiency, these must be balanced against substantial ethical risks such as patient safety, data privacy, and biased decision-making . For instance, AI diagnostic tools can outperform humans in speed, yet they risk misdiagnosis if not properly vetted and continuously assessed . The privacy risks associated with handling large datasets demand stringent regulatory oversight to protect sensitive data . The need to manage these ethical challenges requires robust regulatory frameworks and ongoing ethical review to ensure AI's safe integration into healthcare .

Ethical dilemmas from AI use in patient care include issues of patient safety, privacy, and the accuracy of AI-generated medical recommendations. The case of IBM Watson, criticized for unsafe cancer treatment recommendations, exemplifies the potential harm from AI errors . There are concerns about the alignment of AI developers' values with those of clinicians, and the potential bias in AI algorithms presents risks to equitable patient care . Furthermore, data privacy under guidelines like GDPR requires strict control over personal data access, raising important questions about AI's impact on privacy and data protection . Ultimately, the lack of clarity regarding legal responsibility for AI-related errors further complicates ethical considerations .

AI has been used to mitigate issues like diagnostic errors by employing machine learning algorithms that improve diagnostic precision and speed, as observed in digital pathology and radiology imaging . AI's ability to handle large datasets and identify patterns not readily visible to clinicians enhances diagnostic accuracy and reduces human errors . Implementations like using AI for interpreting mammograms significantly lessen radiologist workload while maintaining diagnostic efficacy . However, ensuring patient safety involves continuous assessment of AI system outcomes and the integration of oversight mechanisms to catch potential inaccuracies early on .

AI in healthcare introduces various ethical challenges due to the fast-paced technological development that often outpaces the necessary progress in ethical governance and legal frameworks . The legal challenges are particularly prominent in the enforcement of ethical values through law and regulation, especially in regions like the USA and Europe . This imbalance raises concerns about patient preference, safety, and privacy being potentially compromised without adequate mitigation strategies . The introduction of AI complicates accountability, especially when medical errors are involved, as it is unclear who is responsible for AI-generated decisions—leading to challenging dynamics within the patient-doctor relationship .

AI poses challenges to patient privacy mainly in the area of personal data use and protection, as seen with data breaches such as the exposure of 2.5 million patient records by an AI company . Regulation occurs through frameworks like the General Data Protection Regulation (GDPR), which mandates strict controls on how personal data can be accessed and used, restricting access to only data necessary for specific AI operations . This regulatory approach aims to ensure that patient privacy is not compromised by AI applications in healthcare, highlighting the importance of legal frameworks in safeguarding sensitive health information .

To address AI's integration into healthcare, frameworks must focus on aligning AI practices with ethical and legal standards such as those embodied in GDPR, which dictates strict protocols for data access and protection . Additionally, there's a need for comprehensive models that assign responsibility and accountability in AI-related medical errors to bridge the gap between technology providers and healthcare practitioners . Ethical oversight committees and interdisciplinary collaboration are also essential for ensuring AI systems do not infringe on patient rights and are used responsibly . Conclusively, these frameworks should incorporate continuous evaluation and updates to remain relevant with advancing AI technology .

AI plays a transformative role in medical education by providing advanced tools for learning and simulation that enhance diagnostic skills and decision-making abilities for both students and professionals . AI systems offer personalized training experiences, adapting content and difficulty to match a learner's progress and needs. This can significantly accelerate learning, particularly regarding complex medical procedures . Moreover, AI can analyze and provide feedback on clinical performance, fostering an environment of continuous improvement and precision in healthcare delivery . The integration of AI into medical curricula prepares future physicians for the evolving landscape of healthcare practice heavily influenced by technology .

Healthcare professionals are recommended to undertake several measures for effective AI implementation, including ensuring the alignment of AI applications with clinical values and goals to enhance patient safety . It's crucial to address ethical challenges proactively and integrate AI systems gradually to manage and anticipate potential errors . Moreover, training in understanding AI processes and outcomes is essential for practitioners to use AI tools safely and responsibly. Privacy concerns must be rigorously managed per regulations like GDPR to protect patient information . Finally, continuous monitoring and assessment of AI systems are necessary to maintain their effectiveness and safety in practice .

AI can revolutionize the healthcare sector by automating and streamlining various processes, leading to early disease detection and more effective treatment options. This transformation is driven by AI's ability to enhance diagnostics, interpret medical data more accurately, and provide predictive support for clinical decision-making . By improving diagnostic efficiency and facilitating personalized medicine, AI not only simplifies physicians' daily routines but also improves the patient experience . Overall, its integration could elevate the quality of healthcare delivery and potentially reduce operational costs, making it a transformative force in medical practice .

AI enhances diagnostic capabilities by making the process faster and more accurate. For instance, AI applications can diagnose conditions such as skin cancer through intelligent computer programs and improve mammogram analysis, aiding in breast cancer detection . These AI-based systems use deep learning models to interpret complex medical images, sometimes outperforming human capabilities in terms of speed and efficiency . Additionally, AI is employed to improve the evaluation of e-health reports, enhancing the overall accuracy of diagnostics and care delivery .

You might also like