Fact or Artifact? Revise Layer-wise Relevance Propagation on various ANN Architectures.

Landt-Hayen, Marco , Rath, Willi and Claus, Martin (2023) Fact or Artifact? Revise Layer-wise Relevance Propagation on various ANN Architectures. Open Access Computer Science & Information Technology (CS & IT), 13 (23). DOI 10.5121/csit.2023.132305.

[thumbnail of csit132305.pdf]
csit132305.pdf - Published Version
Available under License Creative Commons: Attribution 4.0.

Download (4MB) | Preview

Supplementary data:


Layer-wise relevance propagation (LRP) is a widely used and powerful technique to reveal insights into various artificial neural network (ANN) architectures. LRP is often used in the context of image classification. The aim is to understand, which parts of the input sample have highest relevance and hence most influence on the model prediction. Relevance can be traced back through the network to attribute a certain score to each input pixel. Relevance scores are then combined and displayed as heat maps and give humans an intuitive visual understanding of classification models. Opening the black box to understand the classification engine in great detail is essential for domain experts to gain trust in ANN models. However, there are pitfalls in terms of model-inherent artifacts included in the obtained relevance maps, that can easily be missed. But for a valid interpretation, these artifacts must not be ignored. Here, we apply and revise LRP on various ANN architectures trained as classifiers on geospatial and synthetic data. Depending on the network architecture, we show techniques to control model focus and give guidance to improve the quality of obtained relevance maps to separate facts from artifacts.

Document Type: Article
Additional Information: DOI noch nicht freigeschaltet (18.12.2023)
Keywords: Artificial Neural Networks; Image Classification; Layer-wise Relevance Propagation; Geospatial Data; Explainable AI
Research affiliation: OceanRep > GEOMAR > FB1 Ocean Circulation and Climate Dynamics > FB1-OD Ocean Dynamics
Main POF Topic: PT2: Ocean and Cryosphere
Refereed: Yes
Open Access Journal?: Yes
Publisher: AIRCC
Date Deposited: 18 Dec 2023 09:25
Last Modified: 09 Jan 2024 13:21
URI: https://oceanrep.geomar.de/id/eprint/59658

Actions (login required)

View Item View Item