Advanced search
1 file | 1.55 MB Add to list

Influence of AI behavior on human moral decisions, agency, and responsibility

Author
Organization
Abstract
There is a growing interest in understanding the effects of human-machine interaction on moral decision-making (Moral-DM) and sense of agency (SoA). Here, we investigated whether the “moral behavior” of an AI may affect both moral-DM and SoA in a military population, by using a task in which cadets played the role of drone operators on a battlefield. Participants had to decide whether or not to initiate an attack based on the presence of enemies and the risk of collateral damage. By combining three different types of trials (Moral vs. two No-Morals) in three blocks with three type of intelligent system support (No-AI support vs. Aggressive-AI vs. Conservative-AI), we showed that participants’ decisions in the morally challenging situations were influenced by the inputs provided by the autonomous system. Furthermore, by measuring implicit and explicit agency, we found a significant increase in the SoA at the implicit level in the morally challenging situations, and a decrease in the explicit responsibility during the interaction with both AIs. These results suggest that the AI behavior influences human moral decision-making and alters the sense of agency and responsibility in ethical scenarios. These findings have implications for the design of AI-assisted decision-making processes in moral contexts.
Keywords
Human-autonomous systems interaction, Human performance, AI behavior, Moral decision-making, Sense of agency, ARTIFICIAL-INTELLIGENCE, IMPERFECT AUTOMATION, SENSE, EXPERIENCE, MILITARY, ETHICS, BIAS

Downloads

  • 2025 Salatino Influence of AI behavior.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 1.55 MB

Citation

Please use this url to cite or link to this publication:

MLA
Salatino, Adriana, et al. “Influence of AI Behavior on Human Moral Decisions, Agency, and Responsibility.” SCIENTIFIC REPORTS, vol. 15, no. 1, 2025, doi:10.1038/s41598-025-95587-6.
APA
Salatino, A., Prével, A., Caspar, E., & Bue, S. L. (2025). Influence of AI behavior on human moral decisions, agency, and responsibility. SCIENTIFIC REPORTS, 15(1). https://doi.org/10.1038/s41598-025-95587-6
Chicago author-date
Salatino, Adriana, Arthur Prével, Emilie Caspar, and Salvatore Lo Bue. 2025. “Influence of AI Behavior on Human Moral Decisions, Agency, and Responsibility.” SCIENTIFIC REPORTS 15 (1). https://doi.org/10.1038/s41598-025-95587-6.
Chicago author-date (all authors)
Salatino, Adriana, Arthur Prével, Emilie Caspar, and Salvatore Lo Bue. 2025. “Influence of AI Behavior on Human Moral Decisions, Agency, and Responsibility.” SCIENTIFIC REPORTS 15 (1). doi:10.1038/s41598-025-95587-6.
Vancouver
1.
Salatino A, Prével A, Caspar E, Bue SL. Influence of AI behavior on human moral decisions, agency, and responsibility. SCIENTIFIC REPORTS. 2025;15(1).
IEEE
[1]
A. Salatino, A. Prével, E. Caspar, and S. L. Bue, “Influence of AI behavior on human moral decisions, agency, and responsibility,” SCIENTIFIC REPORTS, vol. 15, no. 1, 2025.
@article{01JS3T5X09TSHYRBGA95XC6D1H,
  abstract     = {{There is a growing interest in understanding the effects of human-machine interaction on moral decision-making (Moral-DM) and sense of agency (SoA). Here, we investigated whether the “moral behavior” of an AI may affect both moral-DM and SoA in a military population, by using a task in which cadets played the role of drone operators on a battlefield. Participants had to decide whether or not to initiate an attack based on the presence of enemies and the risk of collateral damage. By combining three different types of trials (Moral vs. two No-Morals) in three blocks with three type of intelligent system support (No-AI support vs. Aggressive-AI vs. Conservative-AI), we showed that participants’ decisions in the morally challenging situations were influenced by the inputs provided by the autonomous system. Furthermore, by measuring implicit and explicit agency, we found a significant increase in the SoA at the implicit level in the morally challenging situations, and a decrease in the explicit responsibility during the interaction with both AIs. These results suggest that the AI behavior influences human moral decision-making and alters the sense of agency and responsibility in ethical scenarios. These findings have implications for the design of AI-assisted decision-making processes in moral contexts.}},
  articleno    = {{12329}},
  author       = {{Salatino, Adriana and Prével, Arthur and Caspar, Emilie and Bue, Salvatore Lo}},
  issn         = {{2045-2322}},
  journal      = {{SCIENTIFIC REPORTS}},
  keywords     = {{Human-autonomous systems interaction,Human performance,AI behavior,Moral decision-making,Sense of agency,ARTIFICIAL-INTELLIGENCE,IMPERFECT AUTOMATION,SENSE,EXPERIENCE,MILITARY,ETHICS,BIAS}},
  language     = {{eng}},
  number       = {{1}},
  pages        = {{13}},
  title        = {{Influence of AI behavior on human moral decisions, agency, and responsibility}},
  url          = {{http://doi.org/10.1038/s41598-025-95587-6}},
  volume       = {{15}},
  year         = {{2025}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: