wzzheng / TPVFormer

[CVPR 2023] An academic alternative to Tesla's occupancy network for autonomous driving.
https://wzzheng.net/TPVFormer/
Apache License 2.0
1.18k stars 107 forks source link

Question about the label #3

Closed scuizhibin closed 1 year ago

scuizhibin commented 1 year ago

What is the label of the network? How do you deal with it? Thanks to the author.

wzzheng commented 1 year ago

We use the sparse lidar segmentation labels to train the network. The trained model can generalize them to other areas in the scene.

scuizhibin commented 1 year ago

Is  the code open source on weekends?

---Original--- From: "Wenzhao @.> Date: Wed, Feb 8, 2023 16:21 PM To: @.>; Cc: @.**@.>; Subject: Re: [wzzheng/TPVFormer] Question about the label (Issue #3)

We use the sparse lidar segmentation labels to train the network. The trained model can generalize them to other areas in the scene.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

wzzheng commented 1 year ago

Yes.

scuizhibin commented 1 year ago

大佬,代码更新了吗?

---Original--- From: "Wenzhao @.> Date: Wed, Feb 8, 2023 16:30 PM To: @.>; Cc: @.**@.>; Subject: Re: [wzzheng/TPVFormer] Question about the label (Issue #3)

Yes.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

wzzheng commented 1 year ago

更新了!

scuizhibin commented 1 year ago

大佬 抱大腿

---Original--- From: "Wenzhao @.> Date: Sun, Feb 12, 2023 21:50 PM To: @.>; Cc: @.**@.>; Subject: Re: [wzzheng/TPVFormer] Question about the label (Issue #3)

更新了!

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

FrontierBreaker commented 1 year ago

What's the difference between [nuscenes-noIgnore.yaml] and nuscenes.yaml ? Hope for detailed explanation. Thanks!! @wzzheng

scuizhibin commented 1 year ago

怎么制作生成训练的标签?是nuscenes自带的吗?

---Original--- From: @.> Date: Tue, Feb 14, 2023 18:07 PM To: @.>; Cc: @.**@.>; Subject: Re: [wzzheng/TPVFormer] Question about the label (Issue #3)

What's the difference between [nuscenes-noIgnore.yaml] and nuscenes.yaml ? Hope for detailed explanation. Thanks!! @wzzheng

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

wzzheng commented 1 year ago

怎么制作生成训练的标签?是nuscenes自带的吗? ---Original--- From: @.> Date: Tue, Feb 14, 2023 18:07 PM To: @.>; Cc: @.**@.>; Subject: Re: [wzzheng/TPVFormer] Question about the label (Issue #3) What's the difference between [nuscenes-noIgnore.yaml] and nuscenes.yaml ? Hope for detailed explanation. Thanks!! @wzzheng — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

是的,Panoptic nuScenes有这个标签

huang-yh commented 1 year ago

What's the difference between [nuscenes-noIgnore.yaml] and nuscenes.yaml ? Hope for detailed explanation. Thanks!! @wzzheng

The nuscenes-noIgnore.yaml assigns voxels without any annotation an "empty" label, and is used for 3D semantic occupancy prediction. The nuscenes.yaml does not have the "empty" class and simply ignores voxels without annotation when calculating losses, and thus is used for the lidar segmentation task.

FrontierBreaker commented 1 year ago

got it, thanks!

anhquancao commented 1 year ago

We use the sparse lidar segmentation labels to train the network. The trained model can generalize them to other areas in the scene.

Hi, congratulations on your awesome work! Out of curiosity, have you ever experimented with accumulating lidar scans to generate denser labels for training purposes?

wzzheng commented 1 year ago

We use the sparse lidar segmentation labels to train the network. The trained model can generalize them to other areas in the scene.

Hi, congratulations on your awesome work! Out of curiosity, have you ever experimented with accumulating lidar scans to generate denser labels for training purposes?

Yes. Actually, we plan to release a paper doing this recently. Stay tuned!

anhquancao commented 1 year ago

Thank you for the information!