Caoxuheng / HIFtool

A toolbox for HSI-MSI fusion/pan-sharpening, including MoGDCN, Fusformer, PSRT, MSST, DCTransformer, iDaFormer, HySure, HyMS, DBSR, UDALN,uHNTC, ZSL and pretrained weights
MIT License
20 stars 2 forks source link
hsi-msi-fusion image-fusion pan-sharpening spectral-reconstruction super-resolution

PyTorchHIFToolBox

Goal

Welcome to our groundbreaking project! Our mission is to compile state-of-the-art (SOTA) algorithms in the field of hyperspectral and multispectral/panchromatic sharpening. Our comprehensive collection spans three categories: model-based algorithms, unsupervised/self-supervised learning algorithms, as well as supervised learning algorithms. Join us in pioneering the advancement of spectral image processing technology!

本项目旨在收录高光谱和多光谱/全色锐化领域的SOTA算法。收录算法主要分三类:基于模型的算法、自/无监督学习算法,以及监督学习算法。加入我们,共同推动光谱图像处理技术的发展!!!!

News📰

> **[2024.05.16]** Pre-trained models on the QB dataset in [Pancollection Dataset](https://github.com/liangjiandeng/PanCollection) are released. > **[2024.05.05]** Compatible with [Pancollection Dataset](https://github.com/liangjiandeng/PanCollection). > **[2024.05.04]** Fixed the bug of missing the 'config.py' in Fusformer. > **[2024.04.03]** DBSR, a blind unsupervised learning method, has been added to our collection of SOTA algorithms. > **[2024.03.20]** Fixed the bug of missing the 'utils' file. > **[2024.03.14]** Added download links for the Chikusei dataset. > **[2024.03.05]** DCTransformer, a new supervised learning method, has been added to our collection of SOTA algorithms.

Algorithm List⚡

Model-based Learning-based
[HySure](https://github.com/alfaiate/HySure) [[Endnote](https://serveri.dotaindex.com/enw.php?q=info:MO4wOAc9b08J:scholar.google.com/&output=citation&scisdr=ClGi1W3VGAA:AFWwaeYAAAAAZfztZSG-TNwxaiI6XKNB_oyLblg&scisig=AFWwaeYAAAAAZfztZbzgCePAMT0xni7804KkXUQ&scisf=3&ct=citation&cd=-1&hl=zh-CN) ] [HyMS](https://github.com/Caoxuheng/HyMS) [[Endnote](https://serveri.dotaindex.com/enw.php?q=info:xLPyMJZ-FpMJ:scholar.google.com/&output=citation&scisdr=ClGi7GzdGAA:AFWwaeYAAAAAZfKHBs36iuksvtwHR3tOxJj4K_E&scisig=AFWwaeYAAAAAZfKHBi22c5pG0ocO8IdsD7IeD64&scisf=3&ct=citation&cd=-1&hl=zh-CN) ] | supervised | unsupervised | |--|--| | [MoG-DCN](https://github.com/chengerr/Model-Guided-Deep-Hyperspectral-Image-Super-resolution) [[Endnote](https://serveri.dotaindex.com/enw.php?q=info:S7MfxO8q8aEJ:scholar.google.com/&output=citation&scisdr=ClGzTYxKGAA:AFWwaeYAAAAAZfzqejxMF1uMuFewQyuLumZKVjA&scisig=AFWwaeYAAAAAZfzqerlv_jCaJWoP-90-w_cFxFk&scisf=3&ct=citation&cd=-1&hl=zh-CN) ] | [UDALN](https://github.com/JiaxinLiCAS/UDALN_GRSL) [[Endnote](https://serveri.dotaindex.com/enw.php?q=info:qgfL7WGaxdIJ:scholar.google.com/&output=citation&scisdr=ClH0gIhKGAA:AFWwaeYAAAAAZfztqCBAClOLL8rzuwlxJRpqoVg&scisig=AFWwaeYAAAAAZfztqN2brdoZRzp3r_r9I80dbow&scisf=3&ct=citation&cd=-1&hl=zh-CN) ] | | [Fusformer](https://github.com/J-FHu/Fusformer) [[Endnote](https://serveri.dotaindex.com/enw.php?q=info:Y_VL4yy1P_UJ:scholar.google.com/&output=citation&scisdr=ClEn-LSRGAA:AFWwaeYAAAAAZfzqzZaG0x6P_W0y8oPgrdOgHQ8&scisig=AFWwaeYAAAAAZfzqzZnBXY48xwYQSuCjBZ2Ksug&scisf=3&ct=citation&cd=-1&hl=zh-CN) ]|[DBSR](https://github.com/JiangtaoNie/DBSR) [[Endnote](https://usercontent.cljtscd.com/scholar.enw?q=info:RsVj1tIoZW8J:scholar.google.com/&output=citation&scisdr=ClEJoW84GAA:AFWwaeYAAAAAZgzUB15HxpVbEk-pe7xcv0vQoq4&scisig=AFWwaeYAAAAAZgzUBzHlJPxWuRcd488RrViyj3o&scisf=3&ct=citation&cd=-1&hl=en)] | | [PSRT](https://github.com/shangqideng/PSRT) [[Endnote](https://serveri.dotaindex.com/enw.php?q=info:v1UsDdmP02kJ:scholar.google.com/&output=citation&scisdr=ClEn-KBbGAA:AFWwaeYAAAAAZfzq836StZmuiBOmfmVVq4N10Os&scisig=AFWwaeYAAAAAZfzq85hczfI6DL9lRnYwzy3M_pM&scisf=3&ct=citation&cd=-1&hl=zh-CN) ] |[FeafusFormer](https://github.com/Caoxuheng/FeafusFormer) [[Endnote](https://serveri.dotaindex.com/enw.php?q=info:aMfnxk1NCsIJ:scholar.google.com/&output=citation&scisdr=ClE2KNo0GAA:AFWwaeYAAAAAZfzt5IO3l3FK900X1f__rVGoU7s&scisig=AFWwaeYAAAAAZfzt5KuMGawtVE7Gjgzoc0mzkQ0&scisf=3&ct=citation&cd=-1&hl=zh-CN) ]| | [MSST-Net](https://github.com/jx-mzc/MSST-Net) [[Endnote](https://serveri.dotaindex.com/enw.php?q=info:SL2o22p2NUQJ:scholar.google.com/&output=citation&scisdr=ClGT3Z9GGAA:AFWwaeYAAAAAZfzrHSbuijFA2riDQJZEXZr1GnE&scisig=AFWwaeYAAAAAZfzrHYGTYyXUa-y0H73FZG5JTXM&scisf=3&ct=citation&cd=-1&hl=zh-CN) ] |[UMC2FF](https://github.com/JiaxinLiCAS/UMC2FF_GRSL)[*On hold*] | | [DCTransformer](https://github.com/qingma2016/DCTransformer) [[Endnote](https://serveri.dotaindex.com/enw.php?q=info:yGUmoYD5aNoJ:scholar.google.com/&output=citation&scisdr=ClG_1Q4VGAA:AFWwaeYAAAAAZfzrkFunjs4brfHK-MujBieQ_Wo&scisig=AFWwaeYAAAAAZfzrkGWmRph52cvPtHZn16FAByQ&scisf=3&ct=citation&cd=-1&hl=zh-CN) ] |[ZSL](https://github.com/renweidian/ZSL)[*On hold*] | | [iDaFormer](https://github.com/Caoxuheng/iDaFormer)[*On hold*] | |

Dataset

Chikusei Dataset Baidu
Recommended Pansharpening Datasets Baidu

How to use?

中文说明

For any questions, feedback, or issues related to the HIFTool, please feel free to contact me via email.
关于HIFTool的任何问题、反馈或疑问,请随时发起issue或电子邮件与我联系。
Email

Acknowledege

We would like to express our sincere gratitude to the following individuals and teams for granting us permission to include their algorithms in our project:
Jiaxin Li (李嘉鑫) [ UDALN & UMC2FF Permission ]; ✨ Qing Ma (马 清)[ DCTransformer Permission ]; ✨ Jiangtao Nie (聂江涛)[ DBSR Permission ]