This is the source code for our paper HSI Road: A Hyper Spectral Image Dataset for Road Segmentation
The HSI Road dataset consists of 3799 scenes with not only RGB bands but also 25 NIR bands ranging from 600nm to 960nm, containing various kinds of road surfaces, including asphalt, cement, dirt and sand, under rural and natural scenes. The presented scenes are collected by a RGB camera and a NIR camera synchronously, which are fixed into a frame closely and equipped on our self-driving platform. Each group of images contains an RGB image, a hyper spectral image and a pixel mask, in which colored pixels represent road areas.
The purpose of building this dataset is:
Diversity
This dataset contains two sorts of scenes:the urban scene and the rural scene. In urban scenes, city road with asphalt surface was collected and accounts for 23% of the dataset.The rural scenes consist of cement(17%) road surfaces in villages and dirt(21%) or sand(39%) road surfaces under natural scenes.
Typical Road Scenes
The typical road scenes of this dataset are as follows among which (a),(b),(c) are in urban scenes and (d),(e),(f),(g),(h) are in rural scenes.The first row presents the picture of RGB images then follows with red channel at about 580nm.The third and last row represent NIR spectrums for identical scenes.
Lisence
This dataset is made freely available to academic and non-academic entities for non-commercial purposes such as academic research, teaching, scientific publications, or personal experimentation. Permission is granted to use the data given that you agree:
That the dataset comes ¡°AS IS¡±, without express or implied warranty. Although every effort has been made to ensure accuracy, we do not accept any responsibility for errors or omissions.
That you include a reference to the HSI Dataset in any work that makes use of the dataset. For research papers, cite our preferred publication as listed; for other media cite our preferred publication as listed.
That you do not distribute this dataset or modified versions. It is permissible to distribute derivative works in as far as they are abstract representations of this dataset (such as models trained on it or additional annotations that do not directly include any of our data) and do not allow to recover the dataset or something similar in character.
That you may not use the dataset or any derivative work for commercial purposes as, for example, licensing or selling the data, or using the data with a purpose to procure a commercial gain.
That all rights not expressly granted to you are reserved by us.
Data Preparation
wget https://hsiroad-sh.oss-cn-shanghai.aliyuncs.com/hsi_road.tar.gz
tar -xvf hsi_road.tar.gz
Source Code
If you want to train the whole network from begining using source code, please follow subsequent steps
Modify model_cfgs
to the model you want to use in nir-fcn-mobilenet.yaml
Modify dataset_cfgs
to correct the data directory and collection in nir-fcn-mobilenet.yaml
Modify loss_cfgs
to the loss function you want to use in nir-fcn-mobilenet.yaml
Modify train_cfgs
to correct the gpu and learning parameters in nir-fcn-mobilenet.yaml
Activate virtual environment(e.g. conda) and then run the script
python train.py --config nir-fcn-mobilenet.yaml --ckpt_path [the directory you want to save the model to]
If you find this useful in your research, please consider citing:
@inproceedings{lu2020HSI,
title={HSI Road: A Hyper Spectral Image Dataset for Road Segmentation},
author={Jiarou Lu, Huafeng Liu, Yazhou Yao, Shuyin Tao, Zhenmin Tang,Jianfeng Lu},
booktitle={IEEE International Conference on Multimedia and Expo (ICME)},
year={2020}
}