Multi-modality

Project Leaders

Zehui Lin

Our research is dedicated to exploring the intricate realm of cross-organ, multi-modality imaging, encompassing a wide range of medical imaging techniques. These include ultrasound with b-mode, elasticity, Doppler, contrast-enhanced imaging, mammography, as well as the wealth of information within MRI and CT scans, among others.

At the core of our endeavors, we strive to develop versatile and unified models that possess key attributes such as universality, adaptability, robustness, and interpretability. Achieving universality and adaptability is made possible through the integration of cutting-edge techniques such as prompt-based learning and embedding. These advancements enable our models to excel in diverse clinical scenarios and across different imaging modalities.

Our commitment to robustness is reflected in our comprehensive strategies to address the challenges arising from missing modalities. Whether through the use of generative models for modality recovery or mastering the art of learning universal placeholders, we ensure that our analyses remain resilient and informative even when confronted with missing data.

One of our distinguishing features is our emphasis on interpretability. We firmly believe in shedding light on the intricate decision-making processes within our models. This means that we can explain the relative importance of each modality in the model's final output, providing valuable insights for clinical decision-making.

In our pursuit of excellence, we actively collaborate with experts in the field, constantly pushing the boundaries of what is achievable in multi-modal medical image analysis. Our mission is clear: to equip healthcare professionals with the tools they need to make informed decisions, ultimately enhancing patient care.

We invite you to join us on this exciting journey as we unravel the complexities of multi-modal medical imaging and pave the way for a more accurate and personalized approach to healthcare. Together, we can unlock new possibilities and drive advancements in the field for the benefit of patients worldwide.

Project Example