最全图像融合论文及代码整理
News
[2022-07-29] 我们的综述论文《基于深度学习的图像融合方法综述》被《中国图象图形学报》正式接收！[论文下载]
Github项目地址：/Linfeng-Tang/Image-Fusion （欢迎大家Start、 Fork、 Fellow一键三连哦~）
图像融合(Image Fusion)
-
多模图像融合(Multi-Modal Image Fusion)
- 红外和可见光图像融合(Infrared and visible image fusion)
- 医学图像融合(Medical image fusion)
-
数字摄影图像融合(Digital Photography Image Fusion)
- 多曝光图像融合(Multi-exposure image fusion)
- 多聚焦图像融合(Multi-focus image fusion)
-
遥感影像融合(Remote Sensing Image Fusion)
- 全色图像锐化(Pansharpening)
- 通用图像融合框架(General Image Fusion Framerwork)
- 综述(Survey)
- 数据集(Dataset)
-
评估指标(Evaluation Metric)
- 通用评估指标(General evaluation metric)
- 遥感影像融合评估指标
- Citation
图像融合系列博客还有：
- 图像融合综述论文整理参见：图像融合综述论文整理
- 图像融合评估指标参见：红外和可见光图像融合评估指标
- 图像融合常用数据集整理参见：图像融合常用数据集整理
- 通用图像融合框架论文及代码整理参见：通用图像融合框架论文及代码整理
- 基于深度学习的红外和可见光图像融合论文及代码整理参见:基于深度学习的红外和可见光图像融合论文及代码整理
- 更加详细的红外和可见光图像融合代码参见：红外和可见光图像融合论文及代码整理
- 基于深度学习的多曝光图像融合论文及代码整理参见：基于深度学习的多曝光图像融合论文及代码整理
- 基于深度学习的多聚焦图像融合论文及代码整理参见：基于深度学习的多聚焦图像融合(Multi-focus Image Fusion)论文及代码整理
- 基于深度学习的全色图像锐化论文及代码整理参见：基于深度学习的全色图像锐化(Pansharpening)论文及代码整理
- 基于深度学习的医学图像融合论文及代码整理参见：基于深度学习的医学图像融合(Medical image fusion)论文及代码整理
- 彩色图像融合程序参见：彩色图像融合
- SeAFusion:首个结合高级视觉任务的图像融合框架参见：SeAFusion:首个结合高级视觉任务的图像融合框架
- DIVFusion:首个耦合互促低光增强&图像融合的框架参见：DIVFusion:首个耦合互促低光增强&图像融合的框架
多模图像融合(Multi-Modal Image Fusion)
红外和可见光图像融合(Infrared and visible image fusion)
| 方法 | 标题 | 论文 | 代码 | 发表期刊或会议 | 基础框架 | 监督范式 | 发表年份 |
|---|---|---|---|---|---|---|---|
| DenseFuse | DenseFuse: A Fusion Approach to Infrared and Visible Images | Paper | Code | TIP | AE | 自监督 | 2019 |
| FusionGAN | FusionGAN: A generative adversarial network for infrared and visible image fusion | Paper | Code | InfFus | GAN | 无监督 | 2019 |
| DDcGAN | Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators | Paper | Code | IJCAI | GAN | 无监督 | 2019 |
| NestFuse | NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models | Paper | Code | TIM | AE | 自监督 | 2020 |
| DDcGAN | DDcGAN: A dual-discriminator conditional generative adversarial network for multi-resolution image fusion | Paper | Code | TIP | GAN | 无监督 | 2020 |
| RFN-Nest | RFN-Nest: An end-to-end residual fusion network for infrared and visible images | Paper | Code | InfFus | AE | 自监督 | 2021 |
| CSF | Classification Saliency-Based Rule for Visible and Infrared Image Fusion | Paper | Code | TCI | AE | 自监督 | 2021 |
| DRF | DRF: Disentangled Representation for Visible and Infrared Image Fusion | Paper | Code | TIM | AE | 自监督 | 2021 |
| SEDRFuse | SEDRFuse: A Symmetric Encoder–Decoder With Residual Block Network for Infrared and Visible Image Fusion | Paper | Code | TIM | AE | 自监督 | 2021 |
| MFEIF | Learning a Deep Multi-Scale Feature Ensemble and an Edge-Attention Guidance for Image Fusion | Paper | Code | TCSVT | AE | 自监督 | 2021 |
| Meta-Learning | Different Input Resolutions and Arbitrary Output Resolution: A Meta Learning-Based Deep Framework for Infrared and Visible Image Fusion | Paper | TIP | CNN | 无监督 | 2021 | |
| RXDNFuse | RXDNFuse: A aggregated residual dense network for infrared and visible image fusion | Paper | InfFus | CNN | 无监督 | 2021 | |
| STDFusionNet | STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection | Paper | Code | TIM | CNN | 无监督 | 2021 |
| D2LE | A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion | Paper | TIP | CNN | 无监督 | 2021 | |
| HAF | Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion | Paper | Code | ACM MM | CNN | 无监督 | 2021 |
| SDDGAN | Semantic-supervised Infrared and Visible Image Fusion via a Dual-discriminator Generative Adversarial Network | Paper | Code | TMM | GAN | 无监督 | 2021 |
| Detail-GAN | Infrared and visible image fusion via detail preserving adversarial learning | Paper | Code | InfFus | GAN | 无监督 | 2021 |
| Perception-GAN | Image fusion based on generative adversarial network consistent with perception | Paper | Code | InfFus | GAN | 无监督 | 2021 |
| GAN-FM | GAN-FM: Infrared and Visible Image Fusion Using GAN With Full-Scale Skip Connection and Dual Markovian Discriminators | Paper | Code | TCI | GAN | 无监督 | 2021 |
| AttentionFGAN | AttentionFGAN: Infrared and Visible Image Fusion Using Attention-Based Generative Adversarial Networks | Paper | TMM | GAN | 无监督 | 2021 | |
| GANMcC | GANMcC: A Generative Adversarial Network With Multiclassification Constraints for Infrared and Visible Image Fusion | Paper | Code | TIM | GAN | 无监督 | 2021 |
| MgAN-Fuse | Multigrained Attention Network for Infrared and Visible Image Fusion | Paper | TIM | GAN | 无监督 | 2021 | |
| TC-GAN | Infrared and Visible Image Fusion via Texture Conditional Generative Adversarial Network | Paper | TCSVT | GAN | 无监督 | 2021 | |
| TarDAL | Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection | Paper | Code | CVPR | GAN | 无监督 | 2022 |
| RFNet | RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and Fusion | Paper | Code | CVPR | CNN | 无监督 | 2022 |
| SeAFusion | Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network | Paper | Code | InfFus | CNN | 无监督 | 2022 |
| PIAFusion | PIAFusion: A progressive infrared and visible image fusion network based on illumination aware | Paper | Code | InfFus | CNN | 无监督 | 2022 |
| UMF-CMGR | Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration | Paper | Code | IJCAI | CNN | 无监督 | 2022 |
| DetFusion | DetFusion: A Detection-driven Infrared and Visible Image Fusion Network | Paper | Code | ACM MM | CNN | 无监督 | 2022 |
| DIVFusion | DIVFusion: Darkness-free infrared and visible image fusion | Paper | Code | InfFus | CNN | 无监督 | 2023 |
医学图像融合(Medical image fusion)
| 方法 | 标题 | 论文 | 代码 | 发表期刊或会议 | 基础框架 | 监督范式 | 年份 |
|---|---|---|---|---|---|---|---|
| CNN | A medical image fusion method based on convolutional neural networks | Paper | ICIF | CNN | 无监督 | 2017 | |
| Zero-LMF | Zero-Learning Fast Medical Image Fusion | Paper | Code | ICIF | CNN | 无监督 | 2019 |
| DDcGAN | Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators | Paper | Code | IJCAI | GAN | 无监督 | 2019 |
| GFPPC-GAN | Green Fluorescent Protein and Phase-Contrast Image Fusion via Generative Adversarial Networks | Paper | CMMM | GAN | 无监督 | 2019 | |
| CCN-CP | Multi-modality medical image fusion using convolutional neural network and contrast pyramid | Paper | Sensors | CNN | 无监督 | 2020 | |
| DDcGAN | DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion | Paper | Code | TIP | GAN | 无监督 | 2020 |
| MGMDcGAN | Medical Image Fusion Using Multi-Generator Multi-Discriminator Conditional Generative Adversarial Network | Paper | Code | Access | GAN | 无监督 | 2020 |
| D2LE | A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion | Paper | TIP | CNN | 无监督 | 2021 | |
| HAF | Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion | Paper | Code | ACM MM | CNN | 无监督 | 2021 |
| EMFusion | EMFusion: An unsupervised enhanced medical image fusion network | Paper | Code | InfFus | CNN | 无监督 | 2021 |
| DPCN-Fusion | Green Fluorescent Protein and Phase Contrast Image Fusion Via Detail Preserving Cross Network | Paper | Code | TCI | CNN | 无监督 | 2021 |
| MSPRN | A multiscale residual pyramid attention network for medical image fusion | Paper | Code | BSPC | CNN | 无监督 | 2021 |
| DCGAN | Medical image fusion method based on dense block and deep convolutional generative adversarial network | Paper | NCA | GAN | 无监督 | 2021 |
数字摄影图像融合(Digital Photography Image Fusion)
多曝光图像融合(Multi-exposure image fusion)
| 方法 | 标题 | 论文 | 代码 | 发表期刊或会议 | 基础框架 | 监督范式 | 年份 |
|---|---|---|---|---|---|---|---|
| DeepFuse | DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs | Paper | Code | ICCV | CNN | 无监督 | 2017 |
| CNN | Multi-exposure fusion with CNN features | Paper | Code | ICIP | CNN | 无监督 | 2018 |
| MEF-Net | Deep guided learning for fast multi-exposure image fusion | Paper | Code | TIP | CNN | 无监督 | 2020 |
| ICEN | Multi-exposure high dynamic range imaging with informative content enhanced network | Paper | NC | CNN | 无监督 | 2020 | |
| MEF-GAN | MEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks | Paper | Code | TIP | GAN | 无监督 | 2020 |
| CF-Net | Deep coupled feedback network for joint exposure fusion and image super-resolutions | Paper | Code | TIP | CNN | 无监督 | 2021 |
| UMEF | Deep unsupervised learning based on color un-referenced loss functions for multi-exposure image fusion | Paper | Code | InFus | CNN | 无监督 | 2021 |
| PA-AGN | Two exposure fusion using prior-aware generative adversarial network | Paper | TMM | GAN | 无监督 | 2021 | |
| AGAL | Attention-guided Global-local Adversarial Learning for Detail-preserving Multi-exposure Image Fusion | Paper | Code | TCSVT | GAN | 无监督 | 2022 |
| GANFuse | GANFuse: a novel multi-exposure image fusion method based on generative adversarial networks | Paper | NCAA | GAN | 无监督 | 2021 | |
| DRLF | Automatic Intermediate Generation With Deep Reinforcement Learning for Robust Two-Exposure Image Fusion | Paper | TNNLS | CNN | 无监督 | 2021 | |
| Trans-MEF | TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework using Self-Supervised Multi-Task Learning | Paper | Code | AAAI | AE | 自监督 | 2022 |
| DPE-MEF | Multi-exposure image fusion via deep perceptual enhancement | Paper | Code | InFus | CNN | 无监督 | 2022 |
多聚焦图像融合(Multi-focus image fusion)
| 方法 | 标题 | 论文 | 代码 | 发表期刊或会议 | 基础框架 | 监督范式 | 年份 |
|---|---|---|---|---|---|---|---|
| CNN | Multi-focus image fusion with a deep convolutional neural network | Paper | Code | InFus | CNN | 有监督 | 2017 |
| ECNN | Ensemble of CNN for multi-focus image fusion | Paper | Code | InFus | CNN | 有监督 | 2019 |
| MLFCNN | Multilevel features convolutional neural network for multifocus image fusion | Paper | TCI | CNN | 有监督 | 2019 | |
| DRPL | DRPL: Deep Regression Pair Learning for Multi-Focus Image Fusion | Paper | Code | TIP | CNN | 有监督 | 2020 |
| MMF-Net | An α-Matte Boundary Defocus Model-Based Cascaded Network for Multi-Focus Image Fusion | Paper | Code | TCI | CNN | 有监督 | 2020 |
| MFF-SSIM | Towards Reducing Severe Defocus Spread Effects for Multi-Focus Image Fusion via an Optimization Based Strategy | Paper | Code | Sensors | CNN | 无监督 | 2020 |
| MFNet | Structural Similarity Loss for Learning to Fuse Multi-Focus Images | Paper | TIP | CNN | 有监督 | 2021 | |
| GEU-Net | Global-Feature Encoding U-Net (GEU-Net) for Multi-Focus Image Fusion [GEU-Net | Paper | Code | TCI | CNN | 自监督 | 2021 |
| DTMNet | DTMNet: A Discrete Tchebichef Moments-Based Deep Neural Network for Multi-Focus Image Fusion | Paper | TMM | CNN | 无监督 | 2021 | |
| SMFuse | SMFuse: Multi-Focus Image Fusion Via Self-Supervised Mask-Optimization | Paper | Code | NCA | CNN | 无监督 | 2021 |
| ACGAN | A generative adversarial network with adaptive constraints for multi-focus image fusion | Paper | Code | ICCV | GAN | 有监督 | 2021 |
| FuseGAN | Learning to fuse multi-focus image via conditional generative adversarial network | Paper | TIP | GAN | 有监督 | 2020 | |
| D2FMIF | Depth-Distilled Multi-focus Image Fusion | Paper | TMM | CNN | 有监督 | 2019 | |
| SESF-Fuse | SESF-Fuse: an unsupervised deep model for multi-focus image fusion | Paper | Code | NCAA | CNN | 有监督 | 2020 |
| MFF-GAN | MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion | Paper | Code | InFus | GAN | 无监督 | 2021 |
| MFIF-GAN | MFIF-GAN: A new generative adversarial network for multi-focus image fusion | Paper | Code | SPIC | GAN | 有监督 | 2021 |
遥感影像融合(Remote Sensing Image Fusion)
全色图像锐化(Pansharpening)
| 方法 | 标题 | 论文 | 代码 | 发表期刊或会议 | 基础框架 | 监督范式 | 年份 |
|---|---|---|---|---|---|---|---|
| PNN | Pansharpening by Convolutional Neural Networks | Paper | Code | RS | CNN | 有监督 | 2016 |
| PanNet | PanNet: A deep network architecture for pan-sharpening | Paper | Code | PanNet | CNN | 有监督 | 2017 |
| TFNet | Remote sensing image fusion based on two-stream fusion network | Paper | Code | TFNet | CNN | 有监督 | 2020 |
| BKL | Unsupervised Blur Kernel Learning for Pansharpening | Paper | IGARSS | CNN | 无监督 | 2020 | |
| Pan-GAN | Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion | Paper | Code | InFus | GAN | 无监督 | 2020 |
| UCNN | Pansharpening via Unsupervised Convolutional Neural Networks | Paper | JSTARS | CNN | 无监督 | 2020 | |
| UPSNet | UPSNet: Unsupervised Pan-Sharpening Network With Registration Learning Between Panchromatic and Multi-Spectral Images | Paper | ACCESS | CNN | 无监督 | 2020 | |
| GPPNN | Deep Gradient Projection Networks for Pan-sharpening | Paper | Code | CVPR | CNN | 有监督 | 2021 |
| GTP-PNet | GTP-PNet: A residual learning network based on gradient transformation prior for pansharpening | Paper | Code | ISPRS | CNN | 有监督 | 2021 |
| HMCNN | Pan-Sharpening Via High-Pass Modification Convolutional Neural Network | Paper | Code | ICIP | CNN | 有监督 | 2021 |
| SDPNet | SDPNet: A Deep Network for Pan-Sharpening With Enhanced Information Representation | Paper | Code | TGRS | CNN | 有监督 | 2021 |
| SIPSA-Net | SIPSA-Net: Shift-Invariant Pan Sharpening with Moving Object Alignment for Satellite Imagery | Paper | Code | CVPR | CNN | 有监督 | 2021 |
| SRPPNN | Super-resolution-guided progressive pansharpening based on a deep convolutional neural network | Paper | Code | TGRS | CNN | 有监督 | 2021 |
| PSGAN | PSGAN: A generative adversarial network for remote sensing image pan-sharpening | Paper | Code | TGRS | GAN | 有监督 | 2021 |
| MDCNN | MDCNN: multispectral pansharpening based on a multiscale dilated convolutional neural network | Paper | JRS | CNN | 有监督 | 2021 | |
| LDP-Net | LDP-Net: An Unsupervised Pansharpening Network Based on Learnable Degradation Processes | Paper | Code | Arxiv | CNN | 无监督 | 2021 |
| DIGAN | Pansharpening approach via two-stream detail injection based on relativistic generative adversarial networks | Paper | ESA | GAN | 有监督 | 2022 | |
| DPFN | A Dual-Path Fusion Network for Pan-Sharpening | Paper | Code | TGRS | CNN | 有监督 | 2022 |
| MSGAN | An Unsupervised Multi-scale Generative Adversarial Network for Remote Sensing Image Pan-Sharpening | Paper | ICMM | GAN | 无监督 | 2022 | |
| UCGAN | Unsupervised Cycle-Consistent Generative Adversarial Networks for Pan Sharpening | Paper | Code | TGRS | GAN | 无监督 | 2022 |
| P2Sharpen | P2Sharpen: A progressive pansharpening network with deep spectral transformation | Paper | Code | INFFus | CNN | 有监督 | 2023 |
通用图像融合框架(General Image Fusion Framerwork)
| 方法 | 标题 | 论文 | 代码 | 发表期刊或会议 | 基础框架 | 监督范式 | 年份 |
|---|---|---|---|---|---|---|---|
| IFCNN | IFCNN: A general image fusion framework based on convolutional neural network | Paper | Code | InFus | CNN | 有监督 | 2020 |
| FusionDN | FusionDN: A Unified Densely Connected Network for Image Fusion | Paper | Code | AAAI | CNN | 无监督 | 2020 |
| PMGI | Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity | Paper | Code | AAAI | CNN | 无监督 | 2020 |
| CU-Net | Deep Convolutional Neural Network for Multi-Modal Image Restoration and Fusion | Paper | Code | TPAMI | CNN | 有监督 | 2021 |
| SDNet | SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion | Paper | Code | IJCV | CNN | 无监督 | 2021 |
| DIF-Net | Unsupervised Deep Image Fusion With Structure Tensor Representations | Paper | Code | TIP | CNN | 无监督 | 2021 |
| IFSepR | IFSepR: A general framework for image fusion based on separate representation learning | Paper | TMM | AE | 自监督 | 2021 | |
| MTOE | Multiple Task-Oriented Encoders for Unified Image Fusion | Paper | ICME | CNN | 无监督 | 2021 | |
| U2Fusion | U2Fusion: A Unified Unsupervised Image Fusion Network | Paper | Code | TPAMI | CNN | 无监督 | 2022 |
| SwinFusion | SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer | Paper | Code | JAS | Transformer | 无监督 | 2022 |
| DeFusion | Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion | Paper | Code | ECCV | CNN | 无监督 | 2022 |
| UIFGAN | UIFGAN: An unsupervised continual-learning generative adversarial network for unified image fusion | Paper | Code | InFus | GAN | 无监督 | 2023 |
综述(Survey)
| 标题 | 论文 | 代码 | 发表期刊或会议 | 年份 |
|---|---|---|---|---|
| A review of remote sensing image fusion methods | Paper | InFus | 2016 | |
| Pixel-level image fusion: A survey of the state of the art | Paper | InFus | 2017 | |
| Deep learning for pixel-level image fusion: Recent advances and future prospects | Paper | InFus | 2018 | |
| Infrared and visible image fusion methods and applications: A survey | Paper | InFus | 2019 | |
| Multi-focu image fusion: A Survey of the state of the art | Paper | InFus | 2020 | |
| Image fusion meets deep learning: A survey and perspective | Paper | InFus | 2021 | |
| Deep Learning-based Multi-focus Image Fusion: A Survey and A Comparative Study | Paper | Code | TPAMI | 2021 |
| Benchmarking and comparing multi-exposure image fusion algorithms | Paper | Code | InFus | 2021 |
| Current advances and future perspectives of image fusion: A comprehensive review | Paper | InFus | 2023 |
数据集(Dataset)
| 融合场景 | 数据集 | 下载链接 |
|---|---|---|
| 红外和可见光图像融合 | TNO | /articles/dataset/TNO_Image_Fusion_Dataset/1008029 |
| INO | /en/technologies/video-analytics-dataset/videos/ | |
| RoadScene | /hanna-xu/RoadScene | |
| MSRS | /Linfeng-Tang/MSRS | |
| LLVIP | /LLVIP/ | |
| M3FD | /JinyuanLiu-CV/TarDAL | |
| 医学图像融合 | Harvard | /AANLIB/ |
| 多曝光图像融合 | MEF | /csjcai/SICE |
| MEFB | /xingchenzhang/MEFB | |
| 多聚焦图像融合 | Lytro | /content/lytro-multi-focus-dataset |
| MFI-WHU | /HaoZhang1018/MFI-WHU | |
| MFFW | /paper/MFFW%3A-A-new-dataset-for-multi-focus-image-fusion-Xu-Wei/4c0658f338849284ee4251a69b3c323908e62b45 | |
| 全色图像锐化 | GaoFen | /web/eoportal/satellite-missions/g |
| WorldView | / | |
| GeoEye | /eogateway/missions/geoeye-1 | |
| QuickBird | /satellite-sensors/quickbird/ |
评估指标(Evaluation Metric)
通用评估指标(General evaluation metric)
通用评估指标位于：/Linfeng-Tang/Image-Fusion/tree/main/General%20Evaluation%20Metric or /Linfeng-Tang/Evaluation-for-Image-Fusion
遥感影像融合评估指标(Evaluation metric for pansharpening)
如有疑问可联系：2458707789@; 备注 姓名+学校
更新维护不易，关注，收藏，点赞一键三连是我持续更新的动力哦~