Chemical Research in Chinese Universities ›› 2026, Vol. 42 ›› Issue (5): 1534-1543.doi: 10.1007/s40242-026-6050-z

• Research Articles • Previous Articles     Next Articles

Bimodal Deep Learning Network for Augmenting Contrast-enhanced Ultrasound Image Analysis

WU Xinyan1, FU Haohao1, CAI Wensheng1, ZHOU Yan2, JING Xiang2, SHAO Xueguang1   

  1. 1. Research Center for Analytical Sciences, College of Chemistry, Tianjin Key Laboratory of Biosensing and Molecular Recognition, Nankai University, Tianjin 300071, P. R. China;
    2. Department of Ultrasound, Tianjin University Central Hospital, Tianjin Third Central Hospital, Tianjin Key Laboratory of Extracorporeal Life Support for Critical Diseases, Artificial Cell Engineering Technology Research Center, Tianjin Institute of Hepatobiliary Disease, Tianjin 300170, P. R. China
  • Received:2026-02-22 Accepted:2026-04-28 Online:2026-10-01 Published:2026-09-24
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (Nos. 22374082, 82371986, 22293030), the National Key R&D Program of China (No. 2022YFA1305200), and the Tianjin Key Medical Discipline (Specialty) Construction Project, China (No. TJYXZDXK-074C).

Abstract: Contrast-enhanced ultrasound (CEUS) is a vital technique for lesion identification, where accurate localization and segmentation of target regions are essential tasks. However, extracting reliable quantitative information from CEUS data is significantly challenged by respiratory motion artifacts that disrupt spatial consistency and the inherent fuzziness of lesion boundaries. Existing methods generally use a single-modal signal, i.e., the fundamental or harmonic signal, in the data, failing to leverage the complementary information from multimodal signals. In this work, we developed a bimodal deep learning network for fusing the bimodal features. The model synergistically fuses fundamental and harmonic signals by integrating residual learning and depth-wise separable convolution (DSCNN). The fundamental signal provides anatomical structural details, while the harmonic signal captures dynamic perfusion profiles. Identification of focal liver lesions (FLLs) was performed with a group of CEUS images. The pixel-level fusion strategy effectively enhanced signal resolution and robustness against motion interference, enabling the proposed model to outperform the established models, such as standard U-Net, fully convolutional network (FCN) and Attention U-Net. This work may provide a powerful tool for rapid and accurate FLL identification, offering a technique for processing multimodal signals.

Key words: Deep learning, Multimodal signal fusion, Depth-wise separable convolution, Focal liver lesion