CRS-Diff: Controllable Generative Remote Sensing Foundation Model

Paper (ArXiv)

TODO

• [x] Release inference code.
• [x] Release pretrained models.
• [x] Release Gradio UI.
• [ ] Release training code

Environment

conda env create -f environment.yaml
conda activate csrldm

You can download pre-trained models last.ckpt and put it to ./ckpt/ folder.

Testing

You can run the code to start the gradio interface by:

python src/test/test.py

The demonstration effects of the project are as follows:

You can also use the following code to generate images more quickly

python src/test/inference.py

Some of the results are shown below：

Acknowledgments:

This repo is built upon ControlNet and Uni-ControlNet. Some of the functional implementations of remote sensing imagery refer to: GeoSeg,Txt2Img-MHN and SGCN. Sincere thanks to their excellent work!

Citation

@misc{tang2024crsdiff,
      title={CRS-Diff: Controllable Generative Remote Sensing Foundation Model}, 
      author={Datao Tang and Xiangyong Cao and Xingsong Hou and Zhongyuan Jiang and Deyu Meng},
      year={2024},
      eprint={2403.11614},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}