DriveArena
DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Driving
Install / Use
/learn @PJLab-ADG/DriveArenaREADME
<a id="readme-top"></a>
<!-- PROJECT LOGO --> <div align="center"> <img src="assets/github-logo.png" alt="Logo" width="550"> <p> <a href="https://pjlab-adg.github.io/DriveArena/"> <img src="https://img.shields.io/badge/Project-Page-green?style=for-the-badge" alt="Project Page" height="20"> </a> <a href="https://arxiv.org/abs/2408.00415"> <img src="https://img.shields.io/badge/arXiv-Paper-red?style=for-the-badge" alt="arXiv Paper" height="20"> </a> <a href="https://groups.google.com/g/drivearena"> <img src="https://img.shields.io/badge/Google-Group-D14836?style=for-the-badge&logo=google&logoColor=white" alt="Google Group" height="20"> </a> </p> <b>[<a href="docs/RUN_SIMULATION.md">Documentation</a> | <a href="docs/RUN_SIMULATION_CN.md">中文说明</a>]</b> <hr> <img src="assets/boston_thomas_park.gif" width="800" style="display: block; margin: 0 auto;"> <img src="assets/singapore.gif" width="800" style="display: block; margin: 0 auto;"> <img src="assets/boston.gif" width="800" style="display: block; margin: 0 auto;"> <br> <p align="left"> This is the official project repository of the paper <b>DriveArena: A Controllable Generative Simulation Platform for Autonomous Driving</b> and is mainly used for releasing schedules, updating instructions, sharing model weights, and handling issues. </p> </div> <!-- > Xuemeng Yang<sup>1\*</sup>, Licheng Wen<sup>1\*</sup>, Yukai Ma<sup>2,1,\*</sup>, Jianbiao Mei<sup>2,1,\*</sup>, Xin Li<sup>3,5,\*</sup>, Tiantian Wei<sup>1,4,\*</sup>, Wenjie Lei<sup>2</sup>, Daocheng Fu<sup>1</sup>, Pinlong Cai<sup>1</sup>, Min Dou<sup>1</sup>, Botian Shi<sup>1,†</sup>, Liang He<sup>5</sup>, Yong Liu<sup>2,†</sup>, Yu Qiao<sup>1</sup> <br> > <sup>1</sup> Shanghai Artificial Intelligence Laboratory <sup>2</sup> Zhejiang University <sup>3</sup> Shanghai Jiao Tong University <sup>4</sup> Technical University of Munich <sup>5</sup> East China Normal University <br> > <sup>\*</sup> Equal Contribution <sup>†</sup> Corresponding Authors -->🆕 Updates
-
2025-05-22:We now integrate DreamForge-DiT for DiT-based video autoregression generation. Please refer to thevideobranch for more details. -
2024-12-30:We now integrate DreamForge for video autoregression generation. Please refer to thevideobranch for more details. -
2024-11-27:DriveArena V1.2 is released. We now support evaluating driving performance of VAD. -
2024-11-26:We have presented Video Autoregression Dreamer named DreamForge on arXiv. -
2024-11-07:WorldDreamer V1.1 and the pretrained weight trained on nuScenes and nuPlan is released! We now support training and inference onnuScenesandnuPlandatasets. -
2024-09-05:🎉🎉We are thrilled to announce the release of DriveArena V1.0! 🎉🎉Join our Google group for the latest news and discussions.
-
2024-08-02:The paper is now available on arXiv. -
2024-07-30:We've launched the official project page for DriveArena!
Table of Contents:
- Table of Contents:
- 🤩 Running DriveArena
- :fire: Highlights
- 🏁 Leaderboard of Driving Agents
- 📌 Roadmap
- 🔍 Video Autoregression Dreamer
- Acknowledgments
- 📝 License
- 🔖 Citation
🤩 Running DriveArena
To run the closed-loop / open-loop simulation, please refer to the [Documentation|中文说明].
Just for three steps, and you will be able to launch DriveArena as the window below:
<div align="center"> <img width=800px src="assets/simulation.png"> </div>:fire: Highlights
<b> DriveArena </b> is a simulation platform that can
- Provide closed-loop high-fidelity testing environments for vision-based driving agents.
- Dynamically control the movement of all vehicles in the scenarios.
- Generate realistic simulations with road networks from any city worldwide.
- Follow a modular architecture, allowing the easy replacement of each module.
The <b>DriveArena</b> is pretrained on nuScenes dataset. All kinds of vision-based driving agents, such as UniAD and VAD, can be combined with <b>DriveArena</b> to evaluate their actual driving performance in closed-loop realistic simulation environments.
🏁 Leaderboard of Driving Agents
We provide a leaderboard to present the driving performance evaluation of driving agents with our simulation platform. For the explanation of each evaluation metric, please check out our paper.
1. Open-loop Evaluation Leaderboard
<table> <tr style="background-color: #C7C7C7; color: white;"> <th>Driving Agent</th> <th>Simulation Environment</th> <th>NC</th> <th>DAC</th> <th>EP</th> <th>TTC</th> <th>C</th> <th>PDMS</th> </tr> <tr> <td>Human</td> <td>Nuscenes GT</td> <td>1.000±0.00</td> <td>1.000±0.00</td> <td>1.000±0.00</td> <td>0.979±0.12</td> <td>0.752±0.17</td> <td>0.950±0.06</td> </tr> <tr> <td>UniAD</td> <td>nuScenes original</td> <td>0.993±0.03</td> <td>0.995±0.01</td> <td>0.914±0.05</td> <td>0.947±0.14</td> <td>0.848±0.21</td> <td>0.910±0.09</td> </tr> <tr> <td>UniAD</td> <td>DriveArena</td> <td>0.792±0.11</td> <td>0.942±0.04</td> <td>0.738±0.11</td> <td>0.771±0.12</td> <td>0.749±0.16</td> <td>0.636±0.08</td> </tr> </table>2. Closed-loop Evaluation Leaderboard
<table> <tr style="background-color: #C7C7C7; color: white;"> <th>Driving Agent</th> <th>Route</th> <th>PDMS</th> <th>RC</th> <th>ADS</th> </tr> <tr> <td>UniAD</td> <td>sing_route_1</td> <td>0.7615</td> <td>0.1684</td> <td>0.1684</td> </tr> <tr> <td>UniAD</td> <td>sing_route_2</td> <td>0.7215</td> <td>0.169</td> <td>0.0875</td> </tr> <tr> <td>UniAD</td> <td>boston_route_1</td> <td>0.4952</td> <td>0.091</td> <td>0.0450</td> </tr> <tr> <td>UniAD</td> <td>boston_route_2</td> <td>0.6888</td> <td>0.121</td> <td>0.0835</td> </tr> </table> <!-- ROADMAP -->📌 Roadmap
- [x] Demo Website Release
- [x] V1.0 Release
- [x] Traffic Manager Code
- [x] World Dreamer
- [x] Inference Code
- [x] Training Code
- [x] Pretrained Weights
- [x] Driving Agent Support
- [x] UniAD
- [x] V1.1 Release
- [x] WorldDreamer
- [x] Code for nuPlan
- [x] Pretrained Model trained on nuScenes + nuPlan
- [x] WorldDreamer
- [x] V1.2 Release
- [x] Driving Agent Support
- [x] VAD
- [x] Driving Agent Support
- [x] Video Autoregression Dreamer
- [ ] Evaluation Code
- [ ] Development Tutorial
- [ ] Driving Agent Support
- [ ] LeapAD
🔍 Video Autoregression Dreamer
Video Autoregression Dreamer Capable of Producing Videos Exceeding 220 Frames <img src="assets/case_country.gif" width="800" style="display: block; margin: 0 auto;">
UniAD Performance
<img src="assets/video-uniad.gif" width="500" style="display: block; margin: 0 auto;">Please refer to dreamforge for more details and visualization cases.
<!-- ACKNOWLEDGMENTS -->Acknowledgments
We utilized the following repos during development:
Thanks for their Awesome open-sourced work!
<!-- LICENSE -->📝 License
Distributed under the Apache 2.0 license.
<!-- CONTACT -->🔖 Citation
If you find our paper and codes useful, please kindly cite us via:
@article{yang2024drivearena,
title={DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Driving},
author={Xuemeng Yang and Licheng Wen and Yukai Ma and Jianbiao Mei and Xin Li and Tiantian Wei and Wenjie Lei and Daocheng Fu and Pinlong Cai and Min Dou and Botian Shi and Liang He and Yong Liu and Yu Qiao},
journal={arXiv preprint arXiv:2408.00415},
year={2024}
}
<p align="right">(<a href="#readme-top">back to top</a>)</p>Related Skills
node-connect
341.2kDiagnose OpenClaw node connection and pairing failures for Android, iOS, and macOS companion apps
frontend-design
84.5kCreate distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, or applications. Generates creative, polished code that avoids generic AI aesthetics.
openai-whisper-api
341.2kTranscribe audio via OpenAI Audio Transcriptions API (Whisper).
commit-push-pr
84.5kCommit, push, and open a PR
