Skip to main navigation menu Skip to main content Skip to site footer

Research articles

Vol. 4 (2026)

Why Say Why? On the Purposes of AI Explainability

DOI
https://doi.org/10.59490/jhtr.2026.4.8233
Submitted
June 19, 2025
Published
2026-11-20

Abstract

In the wake of rapidly expanding capacities and applications of AI systems that may, to some extent, automate human decision-making, there is a burgeoning debate amongst practitioners, academics, and policymakers concerning the need for explainable AI. While there is a significant consensus around the desirability of explainable AI, there is also a growing body of critique. As explainable AI is supposed to support a major aspect of the responsible innovation of AI, this paper asks: What are the normative and ethical purpose of explainable AI? The paper addresses this question by engaging in a discussion of the normative and ethical purposes of AI explainability. First, it engages in a mapping of different concrete normative purposes that are attributed to AI explainability in the literature. These include, amongst others, diagnosing potential harms, reducing arbitrariness, and enhancing legitimacy. Second, the paper raises a number of limitations faced by explainable AI in realising the purposes it is expected to fulfil, which pertain to the desirability of explainability, its status as an ethical principle, practical obstacles and the rhetorical dangers of explainable AI applications. Third, the paper argues that in order to address these challenges, two over-arching questions should be asked about the extent to which AI explainability can fulfil an ethical purpose: (1) is explainability only merely an instrumental or may it also be a constitutive value, and (2) does explainability pertain to the AI system and its outputs, or to the larger decision-making ecology? Clarifying these questions, the paper argues, is crucial for maintaining explainability as a core ethical principle driving technology development and policy making.

References

  1. Adams, J. (2023). Defending explicability as a principle for the ethics of artificial intelligence in medicine. Medicine, Health Care and Philosophy, 26(4), 615–623. https://doi.org/10.1007/s11019-023-10175-7
  2. Alpsancar, S., Buhl, H. M., Matzner, T., & Scharlau, I. (2025). Explanation needs and ethical demands: Unpacking the instrumental value of XAI. AI and Ethics, 5(3), 3015-3033. https://doi.org/10.1007/s43681-024-00622-3
  3. Angelov, P. P., Soares, E. A., Jiang, R., Arnold, N. I., & Atkinson, P. M. (2021). Explainable artificial intelligence: An analytical review. WIREs Data Mining and Knowledge Discovery, 11(5), 1–13. https://doi.org/10.1002/widm.1424
  4. Aristotle. (2006). The “art” of rhetoric (J. H. Freese, Trans.). Harvard University Press. (Original work published ca. 350 B.C.E)
  5. Babic, B., & Cohen, I. G. (2023). The Algorithmic Explainability “Bait and Switch”. Minnesota Law Review, 108, 857–909.
  6. Barredo Arrieta, A., Diaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-Lopez, S., Molina, D., Benjamins, R., Chatila, R., & Herrera, F. (2019). Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, 58, 82–115. https://doi.org/10.1016/j.inffus.2019.12.012
  7. Baron, S. (2025). Trust, explainability and AI. Philosophy & Technology, 38(1), 4. https://doi.org/10.1007/s13347-024-00837-6
  8. Bietti, E. (2020). From ethics washing to ethics bashing: A view on tech ethics from within moral philosophy. FAT* '20: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, 210–219. https://doi.org/10.1145/3351095.3372860
  9. Coeckelbergh, M. (2020). Artificial intelligence, responsibility attribution, and a relational justification of explainability. Science and Engineering Ethics, 26(4), 2051–2068. https://doi.org/10.1007/s11948-019-00146-8
  10. Colaner, N. (2022). Is explainable artificial intelligence intrinsically valuable? AI & SOCIETY, 37(1), 231–238. https://doi.org/10.1007/s00146-021-01184-2
  11. Cortese, J. F. N. B., Cozman, F. G., Lucca-Silveira, M. P., & Bechara, A. F. (2023). Should explainability be a fifth ethical principle in AI ethics? AI and Ethics, 3(1), 123–134. https://doi.org/10.1007/s43681-022-00152-w
  12. de Bruijn, H., Warnier, M., & Janssen, M. (2022). The perils and pitfalls of explainable AI: Strategies for explaining algorithmic decision-making. Government information quarterly, 39(2), 1–8. https://doi.org/10.1016/j.giq.2021.101666
  13. Doshi-Velez, F., & Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv: Machine Learning, 1–13. https://doi.org/10.48550/arXiv.1702.08608
  14. Došilović, F. K., Brčič, M., & Hlupic, N. (2018). Explainable artificial intelligence: A survey. 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), 210–215. https://doi.org/10.23919/MIPRO.2018.8400040
  15. Ferrari, R. (2015). Writing narrative style literature reviews. Medical Writing, 24(4), 230–235. https://doi.org/10.1179/2047480615Z.000000000329
  16. Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., Schafer, B., Valcke, P., & Vayena, E. (2018). AI4People—An ethical framework for a good AI society: Opportunities, risks, principles, and recommendations. Minds & Machines, 28, 689–707. https://doi.org/10.1007/s11023-018-9482-5
  17. Floridi, L., & Cowls, J. (2019). A unified framework of five principles for AI in society. Harvard Data Science Review, 1(1), 1–14. https://doi.org/10.1162/99608f92.8cd550d1
  18. Franke, U. (2022). First- and second-level bias in automated decision-making. Philosophy & Technology, 35(21), 1–20. https://doi.org/10.1007/s13347-022-00500-y
  19. Freiesleben, T., & König, G. (2023). Dear XAI Community, We Need to Talk! Fundamental misconceptions in current XAI research. In L. Longo (Eds.), Explainable Artificial Intelligence (Vol. 1901, pp. 48–65). Springer. https://doi.org/10.1007/978-3-031-44064-9_3
  20. Greenstein, S. (2022). Preserving the rule of law in the era of artificial intelligence (AI). Artificial Intelligence and Law, 30(3), 291–323. https://doi.org/10.1007/s10506-021-09294-4
  21. Gyevnar, B., Ferguson, N., & Schafer, B. (2023). Bridging the transparency gap: What can explainable AI learn from the AI Act? In K. Gal, A. Nowé, G. J. Nalepa, R. Fairstein, & R. Rădulescu (Eds.), ECAI 2023 (Vol. 372, pp. 964–971). IOS Press. https://doi.org/10.3233/FAIA230367
  22. Hansson, S. O. (2017). The Ethics of Technology: Methods and Approaches. Rowman & Littlefield Publishers.
  23. Hatherley, J., Sparrow, R., & Howard, M. (2026). The virtues of interpretable medical artificial intelligence. Cambridge Quarterly of Healthcare Ethics, 35(3), 167-176. https://doi.org/10.1017/S0963180122000305
  24. Heidegger, M. (1977). The question concerning technology and other essays. Graland Publishing, Inc.
  25. Herzog, C. (2022). On the ethical and epistemological utility of explicable AI in medicine. Philosophy & Technology, 35(2), 50. https://doi.org/10.1007/s13347-022-00546-y
  26. Hickok, M. (2021). Lessons learned from AI ethics principles for future actions. AI and Ethics, 1, 41–47. https://doi.org/10.1007/s43681-020-00008-1
  27. Hildebrandt, M. (2020). A philosophy of technology for computational law. Oxford University Press. https://doi.org/10.31228/osf.io/7eykj
  28. Hindocha, S., & Badea, C. (2022). Moral exemplars for the virtuous machine: The clinician’s role in ethical artificial intelligence for healthcare. AI and Ethics, 2(1), 167–175. https://doi.org/10.1007/s43681-021-00089-6
  29. Ihde, D. (1979). Technics and Praxis: A philosophy of technology. D. Reidel Publishing Company.
  30. Jongepier, F., & Keymolen, E. (2022). Explanation and agency: Exploring the normative-epistemic landscape of the “Right to explanation”. Ethics and Information Technology, 24(4), 1–11. https://doi.org/10.1007/s10676-022-09654-x
  31. Kamath, U., & Liu, J. C. (2021). Explainable artificial intelligence: An introduction to interpretable machine learning. Springer International Publishing.
  32. Karlan, B., & Allen, C. (2024). Engineered wisdom for learning machines. Journal of Experimental & Theoretical Artificial Intelligence, 36(2), 257–272. https://doi.org/10.1080/0952813X.2022.2092559
  33. Kempt, H., Freyer, N., & Nagel, S. K. (2022). Justice and the normative standards of explainability in healthcare. Philosophy & Technology, 35(4), 100. https://doi.org/10.1007/s13347-022-00598-0
  34. Krishnan, M. (2020). Against interpretability: A critical examination of the interpretability problem in machine learning. Philosophy & Technology, 33, 487–502. https://doi.org/10.1007/s13347-019-00372-9
  35. Lim, S. (2021). Judicial decision-making and explainable artificial intelligence. 33 Singapore Academy of Law Journal 280, 280–314.
  36. Linardatos, P., Papastefanopoulos, V., & Kotsiantis, S. (2020). Explainable AI: A review of machine learning interpretability methods. Entropy, 23(1), 18. https://doi.org/10.3390/e23010018
  37. Lipton, Z. C. (2018). The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery. Queue, 16(3), 31–57. https://doi.org/10.1145/3236386.3241340
  38. Mackenzie, D. (2006). An engine, not a camera: How financial models shape markets. MIT Press.
  39. Maclure, J. (2021). AI, explainability and public reason: The argument from the limitations of the human mind. Minds and Machines, 31(3), 421–438. https://doi.org/10.1007/s11023-021-09570-x
  40. Matthias, A. (2004). The responsibility gap: Ascribing responsibility for actions of learning automata. Ethics and Information Technology, 6(3), 175–183. https://doi.org/10.1007/s10676-004-3422-1
  41. Miller, T. (2019). Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence, 267, 1–38. https://doi.org/10.1016/j.artint.2018.07.007
  42. Minh, D., Wang, H. X., Li, Y. F., & Nguyen, T. N. (2022). Explainable artificial intelligence: A comprehensive review. Artificial Intelligence Review, 55(5), 3503–3568. https://doi.org/10.1007/s10462-021-10088-y
  43. Mittelstadt, B. D. (2019). Principles alone cannot guarantee ethical AI. Nature Machine Intelligence, 1, 501–507. https://doi.org/10.1038/s42256-019-0114-4
  44. Nannini, L., Balayn, A., & Smith, A. L. (2023). Explainability in AI policies: A critical review of communications, reports, regulations, and standards in the EU, US, and UK. Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (FAccT '23), 1198–1212. https://doi.org/10.1145/3593013.3594074
  45. Noorman, M., & Swierstra, T. (2023). Democratizing AI from a sociotechnical perspective. Minds and Machines, 33, 563–586. https://doi.org/10.1007/s11023-023-09651-z
  46. O’Hara, K. (2020). Explainable AI and the philosophy and practice of explanation. Computer Law & Security Review, 39, 1–7. https://doi.org/10.1016/j.clsr.2020.105474
  47. Peters, U. (2023). Explainable AI lacks regulative reasons: Why AI and human decision-making are not equally opaque. AI and Ethics, 3(3), 963–974. https://doi.org/10.1007/s43681-022-00217-w
  48. Ranchordas, S. (2021). Empathy in the digital administrative state. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3946487
  49. Ricoeur, P. (1992). Oneself as another (K. Blamey, Ed.). University of Chicago Press.
  50. Robbins, S. (2019). A misdirected principle with a catch: Explicability for AI. Minds and Machines, 29(4), 495–514. https://doi.org/10.1007/s11023-019-09509-3
  51. Robbins, S. (2025). What machines shouldn’t do. AI & SOCIETY, 40, 4093-4104. https://doi.org/10.1007/s00146-024-02169-7
  52. Russo, F., Schliesser, E., & Wagemans, J. (2023). Connecting ethics and epistemology of AI. AI & SOCIETY, 39, 1585–1603. https://doi.org/10.1007/s00146-022-01617-6
  53. Scherer, M. (2019). Artificial intelligence and legal decision-making: The wide open? Journal of International Arbitration, 36(5), 539–573. https://doi.org/10.54648/joia2019028
  54. Searle, J. R. (2006). Social ontology: Some basic principles. Anthropological Theory, 6(1), 51–71. https://doi.org/10.1177/1463499606061731
  55. Sparrow, R. (2007). Killer robots. Journal of Applied Philosophy, 24(1), 62–77. https://doi.org/10.1111/j.1468-5930.2007.00346.x
  56. Starke, G., Schmidt, B., De Clercq, E., & Elger, B. S. (2023). Explainability as fig leaf? An exploration of experts’ ethical expectations towards machine learning in psychiatry. AI and Ethics, 3(1), 303–314. https://doi.org/10.1007/s43681-022-00177-1
  57. Taylor, I. (2024). Is explainable AI responsible AI? AI & SOCIETY, 40, 1695-1704. https://doi.org/10.1007/s00146-024-01939-7
  58. Ursin, F., Lindner, F., Ropinski, T., Salloch, S., & Timmermann, C. (2023). Levels of explicability for medical artificial intelligence: What do we normatively need and what can we technically reach? Ethik in Der Medizin, 35(2), 173–199. https://doi.org/10.1007/s00481-023-00761-x
  59. Vredenburgh, K. (2022). The Right to Explanation. Journal of Political Philosophy, 30(2), 209–229. https://doi.org/10.1111/jopp.12262
  60. Vredenburgh, K. (2023). AI and bureaucratic discretion. Inquiry, 68(4), 1091-1120. https://doi.org/10.1080/0020174X.2023.2261468
  61. Wasserman-Rozen, H., Gilad-Bachrach, R., & Elkin-Koren, N. (2023). Lost in Translation: The Limits of Explainability in AI. SSRN Electronic Journal, 1–42, https://doi.org/10.2139/ssrn.4531323
  62. Wieringa, M. (2023). “Hey SyRI, tell me about algorithmic accountability”: Lessons from a landmark case. Data & Policy, 5, e2. https://doi.org/10.1017/dap.2022.39
  63. Xu, F., Uszkoreit, H., Du, Y., Fan, W., Zhao, D., & Zhu, J. (2019). Explainable AI: A brief survey on history, research areas, approaches and challenges. In J. Tang, M.-Y. Kan, D. Zhao, S. Li, & H. Zan (Eds.), Natural Language Processing and Chinese Computing (pp. 563–574). Springer.
  64. Zerilli, J., Knott, A., Maclaurin, J., & Gavaghan, C. (2019). Transparency in algorithmic and human decision-making: Is there a double standard? Philosophy & Technology, 32(4), 661–683. https://doi.org/10.1007/s13347-018-0330-6
  65. Ződi, Z. (2022). Algorithmic explainability and legal reasoning. The Theory and Practice of Legislation, 10(1), 67–92. https://doi.org/10.1080/20508840.2022.2033945
Update cookies preferences