arXiv · 2302.11107
Non-Uniform Interpolation in Integrated Gradients for Low-Latency Explainable-AI
Abstract
There has been a surge in Explainable-AI (XAI) methods that provide insights into the workings of Deep Neural Network (DNN) models. Integrated Gradients (IG) is a popular XAI algorithm that attributes relevance scores to input features commensurate with their contribution to the model's output. However, it requires multiple forward \& backward passes through the model. Thus, compared to a single forward-pass inference, there is a significant computational overhead to generate the explanation which hinders real-time XAI. This work addresses the aforementioned issue by accelerating IG with a hardware-aware algorithm optimization. We propose a novel non-uniform interpolation scheme to compute the IG attribution scores which replaces the baseline uniform interpolation. Our algorithm significantly reduces the total interpolation steps required without adversely impacting convergence. Experiments on the ImageNet dataset using a pre-trained InceptionV3 model demonstrate \textit{2.6-3.6}$\times$ performance speedup on GPU systems for iso-convergence. This includes the minimal \textit{0.2-3.2}\% latency overhead introduced by the pre-processing stage of computing the non-uniform interpolation step-sizes.
Explore related subjects
Keep this discovery
Ashwin Bhat, Arijit Raychowdhury. 2023-02-22. Non-Uniform Interpolation in Integrated Gradients for Low-Latency Explainable-AI. https://arxiv.org/abs/2302.11107
Cite the original work for its findings. Save a collection to share your selection of sources.