Orthographic Feature Transform for Monocular 3D Object Detection

This is a PyTorch implementation of the OFTNet network from the paper Orthographic Feature Transform for Monocular 3D Object Detection. The code currently supports training the network from scratch on the KITTI dataset - intermediate results can be visualised using Tensorboard. The current version of the code is intended primarily as a reference, and for now does not support decoding the network outputs into bounding boxes via non-maximum suppression. This will be added in a future update. Note also that there are some slight implementation differences from the original code used in the paper.

Training

The training script can be run by calling train.py with the name of the experiment as a required position argument.

python train.py name-of-experiment --gpu 0

By default data will be read from data/kitti/objects and model checkpoints will be saved to experiments. The model is trained using the KITTI 3D object detection benchmark which can be downloaded from here. See train.py for a full list of training options.

Inference

To decode the network predictions and visualise the resulting bounding boxes, run the infer.py script with the path to the model checkpoint you wish to visualise:

python infer.py /path/to/checkpoint.pth.gz --gpu 0

Citation

If you find this work useful please cite the paper using the citation below.

@article{roddick2018orthographic,  
  title={Orthographic feature transform for monocular 3d object detection},  
  author={Roddick, Thomas and Kendall, Alex and Cipolla, Roberto},  
  journal={British Machine Vision Conference},  
  year={2019}  
}