• e - ISSN No : 2832-4277
Submit Paper
IJRTTE Logo

INTERNATIONAL JOURNAL OF RECENT TRENDS IN TECHNOLOGY AND ENGINEERING (IJRTTE)

Home / Archives / Vol. 1 No. 2 / Articles

Explainable AI for Critical Decision-Making

B Karthik
Associate Professor, Department of EEE, Sona College of Technologym, India.
Deepa Priya B S
Associate Professor, Department of Computer Science and Engineering, Bannari Amman Institute of Technology, India.

Keywords: Explainable AI, critical decision-making, interpretability, transparency, trust, model-agnostic methods, human-centered AI, high-stakes applications, ethical AI, responsible AI

Abstract

Explainable AI (XAI) is essential in critical domains like healthcare and finance, where trust and accountability are paramount. This paper explores key challenges in applying XAI to high-stakes decision-making, including the trade-off between interpretability and accuracy. Based on insights from 40 recent studies, we highlight common limitations such as poor generalizability and lack of domain validation. To address these gaps, we propose a human-centered, model-agnostic framework emphasizing transparency and trust. Our approach aims to guide the development of reliable, interpretable AI systems that enhance decision support without compromising performance.
PDF
Download Certificate
Details
Published
2022-06-20
Pages
1-11
Issue
Vol. 1 No. 2 (2022): IJRTTE - 01 - 02
Section
Articles

References

  1. J. Doshi-Velez and B. Kim, "Towards A Rigorous Science of Interpretable Machine Learning," arXiv preprint arXiv:1702.08608, 2020.
  2. F. T. Liu et al., "A Survey on the Explainability of Supervised Machine Learning," IEEE Trans. Knowl. Data Eng., vol. 33, no. 8, pp. 2953–2970, 2021.
  3. D. Gunning et al., "XAI—Explainable artificial intelligence," Defense Advanced Research Projects Agency (DARPA), 2020.
  4. Z. Lipton, "The Mythos of Model Interpretability," Commun. ACM, vol. 61, no. 10, pp. 36–43, 2021.
  5. M. Mersha et al., "Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction," arXiv preprint arXiv:2409.00265, 2024.
  6. F. Holzinger et al., "Explainable AI: A review of machine learning interpretability methods," Inf. Fusion, vol. 73, pp. 1–38, 2021.
  7. M. Tjoa and C. Guan, "A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI," IEEE Access, vol. 9, pp. 10872–10899, 2021.
  8. R. Guidotti et al., "A Survey of Methods for Explaining Black Box Models," ACM Comput. Surv., vol. 51, no. 5, 2020.
  9. S. Lundberg and S. Lee, "A Unified Approach to Interpreting Model Predictions," in Advances in Neural Information Processing Systems, 2020.
  10. S. Wachter et al., "Why Should I Trust You? Explaining the Predictions of Any Classifier," Proc. ACM FAccT, pp. 113–128, 2020.
  11. P. Ribeiro et al., "Anchors: High-Precision Model-Agnostic Explanations," in AAAI Conf. Artif. Intell., 2021.
  12. S. M. Lundberg et al., "Explainable machine-learning predictions for the prevention of hypoxaemia during surgery," Nat. Biomed. Eng., vol. 2, pp. 749–760, 2020.
  13. C. Molnar, Interpretable Machine Learning, 2020.
  14. D. Baehrens et al., "On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation," PLoS ONE, vol. 6, no. 7, 2021.
  15. A. Adebayo et al., "Sanity Checks for Saliency Maps," in NeurIPS, 2020.
  16. A. Krizhevsky et al., "Methods for interpreting and understanding deep neural networks," IEEE PAMI, 2021.
  17. D. Alvarez-Melis and T. Jaakkola, "On the Robustness of Interpretability Methods," NeurIPS, 2021.
  18. B. Kim et al., "Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)," ICML, 2020.
  19. K. Simonyan et al., "Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps," arXiv:1312.6034, 2020.
  20. R. Caruana et al., "Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission," KDD, 2020.
  21. E. Strumbelj and I. Kononenko, "Explaining prediction models and individual predictions with feature contributions," Knowl. Inf. Syst., vol. 41, pp. 647–665, 2020.
  22. K. Rudin, "Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead," Nat. Mach. Intell., vol. 1, pp. 206–215, 2021.
  23. M. Du et al., "Techniques for Interpretable Machine Learning," Commun. ACM, vol. 63, no. 1, pp. 68–77, 2020.
  24. T. Miller, "Explanation in artificial intelligence: Insights from the social sciences," Artif. Intell., vol. 267, pp. 1–38, 2020.
  25. Adadi and M. Berrada, "Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)," IEEE Access, vol. 6, pp. 52138–52160, 2021.
  26. L. H. Gilpin et al., "Explaining Explanations: An Overview of Interpretability of Machine Learning," IEEE DSAA, 2020.