Cognitive-Digital-Twin-Based Driving Assistance

摘要

Advanced driver assistance systems (ADAS) have been developed to enhance driving safety by issuing timely warnings to drivers. However, current ADAS do not take into account the driver’s cognitive state when delivering warnings, which can result in false alarms and impact the driver’s trust in the system. To address this issue, we propose a Cognitive-digital-twin-based Driving Assistance System (CDAS) that issues warnings tailored to the driver’s perception of the driving environment and driving style. In this letter, we present a model of the driver’s decision-making process that explicitly captures their perception of the driving environment, their utility evaluation of predicted future environments, and their driving style in terms of minimum acceptable risk. The cognitive digital twin of the driver is then created and updated by minimizing the discrepancy between the predicted and actual behaviors of the driver. With the cognitive digital twin, the CDAS warns the driver when there is a significant discrepancy between the predicted driving strategy based on partial observation and that based on full observation. This approach can more accurately identify risks that the driver is not aware of and provide warnings only when necessary. We conducted human and simulated experiments in a virtual driving environment, and our results demonstrate that our proposed CDAS has a similar perception of risky behaviors compared to humans. Furthermore, the digital twin learning framework can identify the driving styles of human participants and accurately predict their driving strategies. Additionally, our proposed cognitive driving assistance system provides fewer false warnings and avoids more collisions compared to state-of-the-art ADAS algorithms. Our research shows that incorporating the driver’s cognitive state and driving style can enhance the effectiveness and safety of driving assistance systems.

出版物
IEEE Robotics and Automation Letters
Junyu Diao
Junyu Diao
校友

刁俊宇已毕业,现就职于盛趣游戏。

Renzhi Tang
Renzhi Tang
工程师

唐仁智为上海科技大学计算机科学硕士(2022 届),现任职于深信科创(GuardStrike)。

Yi Gu
Yi Gu
校友

顾艺已毕业,现就职于中国商飞。

江智浩
江智浩
助理教授

江智浩是上海科技大学人机物融合系统实验室主任。

相关