Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice

By Amir Rasouli, John K. Tsotsos. IEEE transactions on intelligent transportation systems (Print), 2018

745 citations recorded by the source corpus.

One of the major challenges that autonomous cars are facing today is driving in urban environments. To make it a reality, autonomous vehicles require the ability to communicate with other road users and understand their intentions. Such interactions are essential between vehicles and pedestrians, the most vulnerable road users. Understanding pedestrian behavior, however, is not intuitive and depends on various factors, such as demographics of the pedestrians, traffic dynamics, environmental conditions, and so on. In this paper, we identify these factors by surveying pedestrian behavior studies, both the classical works on pedestrian–driver interaction and the modern ones that involve autonomous vehicles. To this end, we will discuss various methods of studying pedestrian behavior and analyze how the factors identified in the literature are interrelated. We will also review the practical applications aimed at solving the interaction problem, including design approaches for autonomous vehicles that communicate with pedestrians and visual perception and reasoning algorithms tailored to understanding pedestrian intention. Based on our findings, we will discuss the open problems and propose future research directions.

Subfields: Automotive Engineering, Computer Vision and Pattern Recognition, Safety, Risk, Reliability and Quality

View Paper: https://www.semanticscholar.org/paper/852998c60e4a62d0508de11b6297e6e97a0d3fac

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Automotive Engineering

In Computer Vision and Pattern Recognition

In Safety, Risk, Reliability and Quality

Citations in the corpus

Game Theoretic Analysis of Road User Safety Scenarios Involving Autonomous Vehicles (2018, background): “Thus, besides being risk averse per se, connected vehicles should implement additional mechanisms; for example, they might notify their presence to distracted pedestrians [2], [3].”
Explanations in Autonomous Driving: A Survey (2021, background): “Autonomous vehicles should also have modalities for communicating intents to pedestrians [174].”
Human motion trajectory prediction: a survey (2019, background): “Apart from the contextual cues, discussed in this survey, there are many other factors influencing pedestrian motion, according to the recent studies (Rasouli and Tsotsos 2019), e.”
Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys (2023, neutral): “simulation [113], [114], interpretability [115], Human-Machine Interface (HMI) [116], and special scenes [117], [118], [119], [120], [121], [122].”