OpenDriveLab / OpenLane

[ECCV 2022 Oral] OpenLane: Large-scale Realistic 3D Lane Dataset
Apache License 2.0
503 stars 47 forks source link
autonomous-driving dataset deep-learning lane-detection

OpenLane-V1

OpenLane is the first real-world and the largest scaled 3D lane dataset to date. Our dataset collects valuable contents from public perception dataset, providing lane and closest-in-path object(CIPO) annotations for 1000 segments. In short, OpenLane owns 200K frames and over 880K carefully annotated lanes. We have released the OpenLane Dataset publicly to aid the research community in making advancements in 3D perception and autonomous driving technology. See details in Paper.

This repository is organized as the following.

Note that our OpenLane is an autonomous driving dataset, while there's another repository with the same name The-OpenROAD-Project/OpenLane.

News

Get Started

Please follow these steps to make yourself familiar with the OpenLane dataset. Create an issue if you need any further information.

Download

You can download the entire OpenLane dataset here. Note that before using OpenLane dataset, you should register at Waymo Open Dataset Website and agreed to these Terms since OpenLane is built on top of Waymo Open Dataset.

Evaluation Kit

We provide evaluation tools on both lane and CIPO, following the same data format as Waymo and common evaluation pipeline in 2D/3D lane detection. Please refer to Evaluation Kit Instruction.

Data

OpenLane dataset is constructed on mainstream datasets in the field of autonomous driving. In v1.0, we release the annotation on Waymo Open Dataset. In the future we'll update for annotation on nuScenes. OpenLane dataset focuses on lane detection as well as CIPO. We annotate all the lanes in each frame, including those in the opposite direction if no curbside exists in the middle. In addition to the lane detection task, we also annotate: (a) scene tags, such as weather and locations; (b) the CIPO, which is defined as the most concerned target w.r.t. ego vehicle; such a tag is quite pragmatic for subsequent modules as in planning/control, besides a whole set of objects from perception. The introduction about the coordinates system can be found here.

Lane Annotation

We annotate lane in the following format.

For more annotation criterion, please refer to Lane Anno Criterion.

CIPO/Scenes Annotation

We annotate CIPO and Scenes in the following format.

For more annotation criterion, please refer to CIPO Anno Criterion.

Benchmark and Leaderboard

Benchmark

We provide an initial benchmark on OpenLane 2D/3D Lane Detection and you are welcome to pull request and add your work here! To thoroughly evaluate the model, we provide different case split from the entire validation set. They are Up&Down case, Curve case, Extreme Weather case, Night case, Intersection case, and Merge&Split case. More detail can be found in Lane Anno Criterion Based on the Lane Eval Metric, results (F-Score) of different 2D/3D methods on different cases are shown as follows.

Method All Up&
Down
Curve Extreme
Weather
Night Intersection Merge&
Split
LaneATT-S 28.3 25.3 25.8 32.0 27.6 14.0 24.3
LaneATT-M 31.0 28.3 27.4 34.7 30.2 17.0 26.5
PersFormer 42.0 40.7 46.3 43.7 36.1 28.9 41.2
CondLaneNet-S 52.3 55.3 57.5 45.8 46.6 48.4 45.5
CondLaneNet-M 55.0 58.5 59.4 49.2 48.6 50.7 47.8
CondLaneNet-L 59.1 62.1 62.9 54.7 51.0 55.7 52.3
Method Version All Up &
Down
Curve Extreme
Weather
Night Intersection Merge&
Split
Best model x-c x-f z-c z-f Category Accuracy
GenLaneNet 1.1 32.3 25.4 33.5 28.1 18.7 21.4 31.0 model 0.593 0.494 0.140 0.195 /
3DLaneNet 1.1 44.1 40.8 46.5 47.5 41.5 32.1 41.7 - - - - - -
PersFormer 1.1 50.5 45.6 58.7 54.0 50.0 41.6 53.1 model 0.319 0.325 0.112 0.141 89.51
PersFormer 1.2 52.9 47.5 58.4 51.8 47.4 42.1 50.9 model 0.291 0.294 0.080 0.116 89.24

The implementation of PersFormer can be found here.

Leaderboard

For comparison, we provide a leaderboard on paperwithcode.

Citation

Please use the following citation when referencing OpenLane:

    @inproceedings{chen2022persformer,
      title={PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmark},
      author={Chen, Li and Sima, Chonghao and Li, Yang and Zheng, Zehan and Xu, Jiajie and Geng, Xiangwei and Li, Hongyang and He, Conghui and Shi, Jianping and Qiao, Yu and Yan, Junchi},
      booktitle={European Conference on Computer Vision (ECCV)},
      year={2022}
    }

License

Our dataset is based on the Waymo Open Dataset and therefore we distribute the data under Creative Commons Attribution-NonCommercial-ShareAlike license and Waymo Dataset License Agreement for Non-Commercial Use (August 2019). You are free to share and adapt the data, but have to give appropriate credit and may not use the work for commercial purposes. All code within this repository is under Apache License 2.0.