欢迎访问林业科学,今天是

林业科学 ›› 2025, Vol. 61 ›› Issue (8): 116-128.doi: 10.11707/j.1001-7488.LYKX20240674

• 研究论文 • 上一篇    下一篇

基于CycleGAN的土壤CT/SEM图像多尺度融合方法

黄梓菡1,韩巧玲1,2,3,4,赵玥1,2,3,4,*(),赵燕东1,2,3,4,宋美慧1   

  1. 1. 北京林业大学工学院 北京 100083
    2. 国家林业局林业装备与自动化国家重点实验室 北京 100083
    3. 北京市教育委员会城乡生态环境北京实验室 北京 100083
    4. 北京林业大学智慧林业研究中心 北京 100083
  • 收稿日期:2024-11-12 出版日期:2025-08-25 发布日期:2025-09-02
  • 通讯作者: 赵玥 E-mail:zhaoyue0609@126.com
  • 基金资助:
    国家自然科学基金面上项目(32471964, 32071838);北京林业大学“5·5工程”科研创新团队项目 (BLRC2023C05)。

Multi-Scale Fusion Method of Soil CT/SEM Images Based on CycleGAN

Zihan Huang1,Qiaoling Han1,2,3,4,Yue Zhao1,2,3,4,*(),Yandong Zhao1,2,3,4,Meihui Song1   

  1. 1. School of Technology, Beijing Forestry University Beijing 100083
    2. Key Lab of State Forestry Administration for Forestry Equipment and Automation Beijing 100083
    3. Beijing Laboratory of Urban and Rural Ecological Environment, Beijing Municipal Education Commission Beijing 100083
    4. Research Centro for Intelligent Forestry, Beijing Forestry University Beijing 100083
  • Received:2024-11-12 Online:2025-08-25 Published:2025-09-02
  • Contact: Yue Zhao E-mail:zhaoyue0609@126.com

摘要:

目的: 针对土壤CT图像超分辨率重建任务依赖成对数据集的问题,提出一种基于循环生成对抗网络(CycleGAN)的土壤CT/SEM图像多尺度融合方法(MSF-CycleGAN),提升土壤CT图像质量,降低高分辨率采集CT图像成本,为农林业的智能化管理提供新的技术支持。方法: 首先,构建土壤CT图像和土壤SEM图像数据集,共包含3种含水率下多次冻融循环的土柱样本,为后续图像分辨率提升提供数据基础。其次,引入适用于跨域转换的CycleGAN网络模型应用于土壤CT/SEM图像多尺度融合任务,利用CT与SEM图像的不同成像特性补充低分辨率土壤CT图像信息。为提高生成图像的分辨率,在生成器A中加入上采样模块,在生成器B中加入下采样模块。为增强图像的真实性和一致性,采用双线性插值法将原始图像上采样后加入身份损失函数的计算。最后,基于改进ConvNeXt网络模型对融合高分辨率图像进行孔隙分割,构建三维孔隙模型并进行参数提取。结果: 在相同试验条件下,本研究从定性、定量角度对比MSF-CycleGAN与超分辨率重建算法,证明MSF-CycleGAN多尺度融合方法能够提高土壤CT图像的分辨率且效果比超分辨率重建算法更明显。引入SEM图像和身份损失函数,验证了二者设计的有效性。对50%、75%、100%含水率土柱的图像多尺度融合试验表明,融合后的土壤三维模型能够观察到更多细小孔隙,孔隙数量增加2倍,孔隙率较融合前提高3.93%,孔隙成圆率提高3.64%,分形维数提高0.55%。孔隙参数量化试验表明,基于高分辨率融合图像分割量化的孔隙参数在冻融循环下的变化更符合现有研究规律,证明本研究方法能够准确、有效提高土壤CT图像的分辨率。结论: 本研究论证将土壤CT图像与SEM图像进行多尺度融合提高CT图像分辨率的可行性,为降低采集高分辨率图像成本提供了新的技术路线,能够推动土壤结构研究的精细化与智能化发展。

关键词: 土壤, 多尺度融合, 循环生成对抗网络, CT图像, SEM图像

Abstract:

Objective: A multi-scale fusion method based on a cycle generative adversarial network for soil CT/SEM images (multi-scale fusion based on CycleGAN, MSF-CycleGAN) is for the first time proposed in order to address the obligatory dependence on paired datasets in super-resolution reconstruction of soil CT images. By integrating micro-structural priors from SEM imagery, the approach substantially enhances soil CT image fidelity while circumventing the prohibitive expense of high-resolution CT scanning, thereby offering a novel technical pathway and broad application prospects for intelligent forestry and agricultural management. Method: Firstly, this study constructed a dataset of soil CT and SEM images, encompassing soil column samples across three moisture levels and multiple freeze-thaw cycles, providing a data foundation for subsequent image resolution enhancement. Secondly, a CycleGAN model suitable for cross-domain transformation was introduced for the multi-scale fusion task of soil CT/SEM images. This model leveraged the different imaging characteristics of CT and SEM images to supplement low-resolution soil CT images. To improve the resolution of the generated images, upsampling modules were added to generator A, and downsampling modules were added to generator B. To enhance the authenticity and consistency of the images, the bilinear interpolation method was introduced to upsample the original images and then incorporate them into the calculation of the identity loss function. Finally, an improved ConvNeXt model was employed to segment the pores in the fused high-resolution images, construct a three-dimensional pore model and extract parameters. Result: Under the same experimental conditions, MSF-CycleGAN was qualitatively and quantitatively compared and analyzed with the super-resolution reconstruction algorithms. It was proved that the multi-scale fusion of MSF-CycleGAN could improve the resolution of soil CT images and the effect is more remarkable than that of the super-resolution reconstruction. In addition, ablation experiments were conducted to analyze the contributions of the introduction of SEM images and the improvement of the identity loss function to the overall performance, and the effectiveness of both designs was verified. The multi-scale image fusion experiments on soil columns with moisture contents of 50%, 75%, and 100% indicated that the fused three-dimensional models exhibited more fine pores, with pore quantity increasing twofold. The pore volume fraction increased by 3.93%, and the roundness of pores increased by 3.64%, while the fractal dimension increased by 0.55%. Quantitative experiments on pore parameters based on the high-resolution fused image segmentation quantification under freeze-thaw cycles conformed more closely to existing research patterns, confirming that the proposed method accurately and effectively enhanced the resolution of soil CT images. Conclusion: This study demonstrates the feasibility of improving the resolution of CT images through multi-scale fusion of soil CT and SEM images, providing a new technical approach to reduce the cost of acquiring high-resolution images and promoting the refinement and intelligent development of soil structure research.

Key words: soil, multi-scale fusion, cycle-consistent GAN, soil CT images, SEM images

中图分类号: