SAGAT & Full Video Library

Explainable deep learning improves human mental models of self-driving cars

1. Mental Model Correlation with Prediction

Participants were shown driving scenarios before and after CW-Net explanations, then asked to predict the vehicle's next action. Each row pairs the before (control) and after (with explanation) video for a given concept.

Practice Scenario
BEFORE
Practice — Control
AFTER
Practice — With CW-Net

ASV — Approaching Stopped Vehicle
BEFORE
ASV — Control
AFTER
ASV — With CW-Net

CLOSE — Proximity to Other Vehicles
BEFORE
CLOSE — Control
AFTER
CLOSE — With CW-Net

BIKE — Cyclist Detection
BEFORE
BIKE — Control
AFTER
BIKE — With CW-Net

2. SAGAT Study — Control Condition No Explanations

Participants in the control condition viewed these Las Vegas public-road videos without any CW-Net concept explanations. Surprising scenarios involve out-of-distribution events; unsurprising scenarios are routine driving situations.

Miscellaneous
MISC
Practice
MISC
Attention Check

ASV — Approaching Stopped Vehicle
SURPRISING
ASV — Surprising Scenario 1
SURPRISING
ASV — Surprising Scenario 2
UNSURPRISING
ASV — Unsurprising Scenario 1
UNSURPRISING
ASV — Unsurprising Scenario 2

CLOSE — Proximity to Other Vehicles
SURPRISING
CLOSE — Surprising Scenario 1
SURPRISING
CLOSE — Surprising Scenario 2
UNSURPRISING
CLOSE — Unsurprising Scenario 1
UNSURPRISING
CLOSE — Unsurprising Scenario 2

BIKE — Cyclist Detection
SURPRISING
BIKE — Surprising Scenario 1
SURPRISING
BIKE — Surprising Scenario 2
UNSURPRISING
BIKE — Unsurprising Scenario 1
UNSURPRISING
BIKE — Unsurprising Scenario 2

3. SAGAT Study — Experiment Condition With CW-Net Explanations

Participants in the experiment condition viewed these Las Vegas public-road videos with CW-Net concept explanations displayed in real time. These are the videos that produced the significant SAGAT improvements reported in the paper.

Miscellaneous
MISC
Practice
MISC
Attention Check

ASV — Approaching Stopped Vehicle
SURPRISING
ASV — Surprising Scenario 1
SURPRISING
ASV — Surprising Scenario 2
UNSURPRISING
ASV — Unsurprising Scenario 1
UNSURPRISING
ASV — Unsurprising Scenario 2

CLOSE — Proximity to Other Vehicles
SURPRISING
CLOSE — Surprising Scenario 1
SURPRISING
CLOSE — Surprising Scenario 2
UNSURPRISING
CLOSE — Unsurprising Scenario 1
UNSURPRISING
CLOSE — Unsurprising Scenario 2

BIKE — Cyclist Detection
SURPRISING
BIKE — Surprising Scenario 1
SURPRISING
BIKE — Surprising Scenario 2
UNSURPRISING
BIKE — Unsurprising Scenario 1
UNSURPRISING
BIKE — Unsurprising Scenario 2
← Back to Main Page