New medical image fusion method draws on deep learning to improve patient outcomes

New medical image fusion method draws on deep learning to improve patient outcomes
Model of image fusion based on deep learning. Credit: KeAi Communications Co., Ltd.

Image fusion is a process that can enhance the clinical value of medical images, improving the accuracy of medical diagnoses and the quality of patient care.

Researchers at the College of Data Science Software Engineering at China's Qingdao University have developed a new "multi-modal" image method based on supervised that enhances image clarity, reduces redundant image features and supports batch processing. Their findings have just been published in KeAi's International Journal of Cognitive Computing in Engineering.

Author Yi Li explains, "Most medical images have unilateral or limited information content; for instance, focus positions vary which can make some objects appear blurred. Having important information scattered across a number of images can hamper a doctor's judgment. Image fusion is an effective solution—it automatically detects the information contained in those separate images and integrates them to produce one composite image."

Researchers are increasingly turning to deep learning to improve image fusion. Deep learning, a subset of machine learning, draws on that are designed to imitate how humans think and learn. That means it is capable of learning from data that is unstructured or unlabelled.

However much of the current research focuses on the application of deep learning in single image fusion processing. Studies that use it for multi-image batch processing are much rarer.

Li explains, "Medical images have specific practical requirements, including information richness and high clarity. During our study, we used successful image fusion results to build an image-training database. We were then able to use that database to fuse medical images in batches."

Li adds, "Our method also enhances the clarity of MRI, CT and SPECT image fusion, improving the accuracy of medical diagnosis. We have achieved state-of the-art performance in terms of both visual quality and quantitative evaluation metrics. For example, the fused images we produced look more natural, and have sharper edges and higher resolution. In addition, detailed information and features of interest are better preserved."

More information: Yi Li et al, Medical image fusion method by deep learning, International Journal of Cognitive Computing in Engineering (2021). DOI: 10.1016/j.ijcce.2020.12.004

Provided by KeAi Communications Co., Ltd.
Citation: New medical image fusion method draws on deep learning to improve patient outcomes (2021, May 17) retrieved 7 December 2023 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Discerning deep fakes digitally


Feedback to editors