Explainable AI

Explainable AI

Explainable AI for Driving Assistance Systems

Explainable AI

The project Explainable Artificial Intelligence (AI) for Driving Assistance Systems investigates how to predict and explain the lane change behaviour of vehicles in real time using the digital twin of Providentia++.

Project decription

This project aims to demonstrate the potential and value of Explainable AI in the safety-critical domain of lane change predictions, which offers the possibility to explain the state-of-the-art research in machine learning.

The goal is to develop a machine learning model that can predict and justify lane changes by utilizing the Providentia++ Digital Twin data.

The reasoning of the machine learning model shall be made explicit to build trust and justify the model's prediction in a safety-critical domain.

Finally, the predictions and explanations of the machine learning model are visualized in a live web application to demonstrate the potential of Explainable AI in safety-critical domains for clients.

Research contribution

Layer normalized Long Short-term Memory models (LSTM) are identified as robust state-of-the-art machine learning models for real-time lane change predictions. However, their inner functioning is too complex and complicated to be understood by an observer. As a result, layer normalized LSTM's are so-called black-boxes.  For safety-critical applications like lane change predictions, their reasoning needs to be made explicit.

Several attribution methods are compared to explain the model's behaviour. Layer-wise Relevance Propagation (LRP) is identified as particularly suitable for a real-time explanation due to its robustness and computational inexpensiveness. However, LRP was not extended to the layer normalized LSTM architecture. This project extends LRP to layer normalized LSTMS, which is the leading research contribution of the project.

The project was carried out in collaboration with fortiss research fellow Prof. Dr. Ute Schmid, University of Bamberg.

Project duration

01.01.2021 - 01.06.2021

More information

Project partner

IBM Munich CenterUniversität Bamberg