[NeurIPS 2025] This is the official implementation of the paper:
AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
Zewei Zhou*, Tianhui Cai*, Seth Z. Zhao, Yun Zhang, Zhiyu Huangβ , Bolei Zhou, Jiaqi Ma
University of California, Los Angeles - * Equal contribution, β Project leader
- π AutoVLA integrates chain-of-thought (CoT) reasoning and physical action tokenization to directly generate planning trajectories through a unified autoregressive process, dynamically switching dual-thinking modes.
- βοΈ Supervised fine-tuning (SFT) is employed to equip the model with dual thinking modes: fast thinking (trajectory-only) and slow thinking (enhanced with chain-of-thought reasoning).
- πͺ Reinforcement fine-tuning (RFT) based on Group Relative Policy Optimization (GRPO) is adopted to further enhance planning performance and efficiency, reducing unnecessary reasoning in straightforward scenarios.
- π₯ Extensive experiments across real-world and simulated datasets and benchmarks, including nuPlan, nuScenes, Waymo, and CARLA, demonstrate its competitive performance in both open-loop and closed-loop settings.
2025/09: AutoVLA is accepted by NeurIPS 2025 ππ.2025/06: AutoVLA paper release.2025/05: In the Waymo Vision-based End-to-end Driving Challenge, AutoVLA ranks highly in both RFS Overall and achieves the top RFS Spotlight score, which focuses on the most challenging scenarios.
2025/06: β AutoVLA paper.2025/11: Reasoning data.2025/11: Reasoning annotation code.2025/11: AutoVLA code.2025/11: AutoVLA checkpoints.
If you find this repository useful for your research, please consider giving us a star π and citing our paper.
@article{zhou2025autovla,
title={AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning},
author={Zhou, Zewei and Cai, Tianhui and Zhao, Seth Z.and Zhang, Yun and Huang, Zhiyu and Zhou, Bolei and Ma, Jiaqi},
journal={arXiv preprint arXiv:2506.13757},
year={2025}
}