Explainable AI

Explainable AI

Explainable AI for Assisted Driving Systems

Explainable AI

This project Explainable Artificial Intelligence (AI) for Assisted Driving Systems explores how to predict and explain lane changing behaviour of vehicles from the Providentia++ Digital Twin in real-time.

Project decription

This project aims to demonstrate the potential and value of Explainable AI in the safety-critical domain of lane change predictions, which offers the possibility to explain the state-of-the-art research in machine learning.

The goal is to develop a machine learning model that can predict and justify lane changes by utilizing the Providentia++ Digital Twin data.

The reasoning of the machine learning model shall be made explicit to build trust and justify the model's prediction in a safety-critical domain.

Finally, the predictions and explanations of the machine learning model are visualized in a live web application to demonstrate the potential of Explainable AI in safety-critical domains for clients.

Research contribution

Layer normalized Long Short-term Memory models (LSTM) are identified as robust state-of-the-art machine learning models for real-time lane change predictions. However, their inner functioning is too complex and complicated to be understood by an observer. As a result, layer normalized LSTM's are so-called black-boxes.  For safety-critical applications like lane change predictions, their reasoning needs to be made explicit.

Several attribution methods are compared to explain the model's behaviour. Layer-wise Relevance Propagation (LRP) is identified as particularly suitable for a real-time explanation due to its robustness and computational inexpensiveness. However, LRP was not extended to the layer normalized LSTM architecture. This project extends LRP to layer normalized LSTMS, which is the leading research contribution of the project.

Project duration

01.01.2021 - 01.06.2021

Dr. Yuanting Liu

Your contact

Dr. Yuanting Liu

+49 89 3603522 427
liu@fortiss.org

More information

Project partner

IBM Munich Center