Computed Tomography Image Quality Assessment Based on Deep Learning

Project Leaders

Siyi XUN

Partner Organisations

深圳人民医院

上海交通大学

In view of the problems existing in the non-homogeneity of CT image quality in clinical diagnosis and storage and management of medical data, scientific research on the following key issues is planned to focus on the development of effective automated CT-IQA datasets and models:

(1) Dataset

At present, there are few publicly available data sets for CT-IQA. Most of the existing data sets are simulated and synthesized by adding noise. The quality of simulation data is very different and easy to distinguish, but it cannot fully capture the physiological and anatomical differences between real patients, and it is difficult to accurately simulate the complex lesions and pathological conditions existing in the clinic. Therefore, we will make innovative use of real data collected from multiple medical institutions such as Shenzhen People's Hospital to build three datasets: 1) Chest CT image quality assessment dataset; 2) Chest CT body position and artifact assessment data set; 3) Cross-modal medical image quality assessment dataset. As far as we know, no such dataset currently exists, which would fill a gap in the field of medical data.

(2) A multi-task model for chest CT-IQA and classification is proposed for the first time.

The model is composed of backbone network, window and current classification module, assessment index regression module and quality assessment module modified by 3D VGG. This model can realize automatic classification and quality assessment of CT image window to a certain extent. To our knowledge, this is the first automated model to classify and evaluate the quality of CT images from different Windows.

(3) The pipeline of chest CT image position and artifact detection and quality assessment was innovatively proposed to effectively assist clinical diagnosis.

The deep learning model is first used to make regression prediction of the missing anatomical structure caused by the body dislocation, and then the presence and degree of artifacts are detected. The combination of the two effectively supplements the quality information of CT images, to automatically evaluate the quality of CT images.

(4) Innovative development of quality assessment models that can be used for different modes of medical images.

Based on the design model of global definition and local noise of medical images, the dual encoder structure of VGG improved by Hyper-conv and Swin-transformer is intended to be adopted for global and local feature extraction, and different modes are embedding as guidance information. It can improve network accuracy and generalization. The model enables automated quality assessment of medical images of multiple modes and anatomical sites. This will be the first universal quality assessment model for medical images of different modes.

Project Example