E2ETrADS: end-to-end transformer based autonomous driving system for adverse weather conditions

Date

2026-12-01

Author

Spanogianopoulos, Sotirios
Ahıska, Kenan

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

3489
views

65
downloads

Cite This

Adverse weather conditions, such as snow, heavy rain, fog, or limited illumination, pose significant challenges for autonomous vehicles (AVs) by degrading sensor reliability. This paper introduces E2ETrADS, an end-to-end transformer-based autonomous driving framework designed to operate robustly under such conditions. A comprehensive dataset was generated using the CARLA simulator, encompassing both nominal and adverse weather scenarios. The model is trained via imitation learning from an expert driver equipped with weather-adaptive MPC planner and PID controllers, enabling robust control under perception uncertainty. Experimental results demonstrate that E2ETrADS outperforms the TransFuser baseline in adverse conditions, exhibiting fewer infractions and improved lane adherence. The system dynamically adjusts vehicle speed to maintain control stability and adapts its control policies in response to sensor degradation, resulting in fewer missed turns and reduced lane invasions. Furthermore, E2ETrADS generalizes effectively to safety-critical long-tail scenarios, demonstrating human-like reasoning capabilities.

Subject Keywords

Adverse weather, Autonomous driving, CARLA, Imitation learning, Transformer

URI

https://hdl.handle.net/11511/119676

Collections

Department of Electrical and Electronics Engineering, Article