Open witignite opened 4 years ago
@SuminHan, @ahyun-kim : The Google Sheet was originally created by @luulinh90s to keep track of the tasks that we are (and will be) working on. I think that it is perfect for such purpose. But I will post the big picture of the plan, explicitly in step by step here. Once we are done on each task, we can check in front of the box listed above.
However, there are some differences between the to-do tasks in Google Sheet and the to-do tasks listed here above. So, first we need to decide, and let us agree on what needs to be done in step by step. Feel free to comment.
Description
This is a half-semester project, an ongoing attempt to extend the original work by:
The below figure shows the proposed modification to the original work. The components (at the top) connected by red arrows are what we are going to add.
The purpose is to experiment on and try using the bird's eye view LIDAR data to help improving the performance in some extreme condition, such as low light or occlusion, where it may be difficult to detect the 2D bounding boxes in the image (and hence 3D object in the original framework). By using the bird's eye view LIDAR data, we expect to obtain additional 3D box proposals, which will be combined with the original proposals to improve the performance.
TODO
Please note that there is a priority (the number in square box) which indicates what urgent the most.
mayavi
TensorFlow
custom operatorsFrustum PointNet
; just getting the general ideas out of it.easy
,hard
,moderate
.PIXOR
implementations and make it work. We have to either implement a similar model inTensorFlow
at step6.2
, or just use thePyTorch
version (decide later).TensorFlow
orPyTorch
) to generate 3D bounding boxes from BEV of point cloud. This will be difficult. :five:6.2
to our baseline network model. :six:Important Dates
Environment
sudo apt-get
)environment.yaml
file because there are some other components not used in this project; it's not a clean environment. Also, I mixconda
withpip
, which is not safe.And in this environment, install:
pip
withconda
packages is not safe.cudatoolkit
version. Do check your GPU compatibility andCUDA
version.Google Sheets
For more thorough details such as who is working on which step, progress status, etc. https://docs.google.com/spreadsheets/d/1XSqLmRnz4X9YVjgq7cah004tj2bg_MMFn16CfM0oWJI/edit#gid=0