nach oben

European Journal of Nuclear Medicine and Molecular Imaging

Erschienen in:

07.10.2023 | Editorial

Medical image Generative Pre-Trained Transformer (MI-GPT): future direction for precision medicine

verfasst von: Xiaohui Zhang, Yan Zhong, Chentao Jin, Daoyan Hu, Mei Tian, Hong Zhang

Erschienen in: European Journal of Nuclear Medicine and Molecular Imaging | Ausgabe 2/2024

Einloggen, um Zugang zu erhalten

Excerpt

Medical imaging has its earliest roots in 1895 when Wilhelm Roentgen discovered X-ray, providing physicians with the first approach to image internal conditions of human body [1]. After that, multiple imaging methods were developed and optimized in succession based on various imaging principles, such as computed tomography (CT) [2], magnetic resonance imaging (MRI) [3], and positron emission tomography (PET) [4]. The advent of these imaging techniques has rendered medical imaging a crucial pillar of clinical practice and a fundamental domain for the realization of precision medicine. …

Assmus A. Early history of X rays. Beam Line. 1995;25:10–24.

Richmond C. Sir Godfrey Hounsfield. British Medical Journal Publishing Group; 2004.

Mansfield P, Maudsley AA. Medical imaging by NMR. Br J Radiol. 1977;50:188–94. https://doi.org/10.1259/0007-1285-50-591-188.CrossRefPubMed

Nutt R. The history of positron emission tomography. Mol Imaging Biol. 2002;4:11–26. https://doi.org/10.1016/s1095-0397(00)00051-0.CrossRefPubMed

Zhang K, Sun Y, Wu S, Zhou M, Zhang X, Zhou R, et al. Systematic imaging in medicine: a comprehensive review. Eur J Nucl Med Mol Imaging. 2021;48:1736–58. https://doi.org/10.1007/s00259-020-05107-z.CrossRefPubMed

Wells RG. Instrumentation in molecular imaging. J Nucl Cardiol. 2016;23:1343–7. https://doi.org/10.1007/s12350-016-0498-z.CrossRefPubMed

Zhang X, Jiang H, Wu S, Wang J, Zhou R, He X, et al. Positron emission tomography molecular imaging for phenotyping and management of lymphoma. Phenomics. 2022;2:102–18. https://doi.org/10.1007/s43657-021-00042-x.CrossRefPubMedPubMedCentral

Tian M, Zuo C, Civelek AC, Carrio I, Watanabe Y, Kang KW, et al. International nuclear medicine consensus on the clinical use of amyloid positron emission tomography in Alzheimer’s disease. Phenomics. 2023;3:375–89. https://doi.org/10.1007/s43657-022-00068-9.CrossRefPubMed

Tian M, He X, Jin C, He X, Wu S, Zhou R, et al. Transpathology: molecular imaging-based pathology. Eur J Nucl Med Mol Imaging. 2021;48:2338–50. https://doi.org/10.1007/s00259-021-05234-1.CrossRefPubMedPubMedCentral

10.

Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RGPM, Granton P, et al. Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer. 2012;48:441–6. https://doi.org/10.1016/j.ejca.2011.11.036.CrossRefPubMedPubMedCentral

11.

Visvikis D, Lambin P, Beuschau Mauridsen K, Hustinx R, Lassmann M, Rischpler C, et al. Application of artificial intelligence in nuclear medicine and molecular imaging: a review of current status and future perspectives for clinical translation. Eur J Nucl Med Mol Imaging. 2022;49:4452–63. https://doi.org/10.1007/s00259-022-05891-w.CrossRefPubMedPubMedCentral

12.

Zhang X, Zhang Y, Zhang G, Qiu X, Tan W, Yin X, et al. Deep learning with radiomics for disease diagnosis and treatment: challenges and potential. Front Oncol. 2022;12: 773840. https://doi.org/10.3389/fonc.2022.773840.CrossRefPubMedPubMedCentral

13.

Ibrahim A, Primakov S, Beuque M, Woodruff HC, Halilaj I, Wu G, et al. Radiomics for precision medicine: current challenges, future prospects, and the proposal of a new framework. Methods. 2021;188:20–9. https://doi.org/10.1016/j.ymeth.2020.05.022.CrossRefPubMed

14.

Introducing ChatGPT. 2023. Accessed March 15, 2023. https://openai.com/blog/chatgpt

15.

Shen Y, Heacock L, Elias J, Hentel KD, Reig B, Shih G, et al. ChatGPT and other large language models are double-edged swords. Radiology. 2023;307: e230163. https://doi.org/10.1148/radiol.230163.CrossRefPubMed

16.

Baidoo-Anu D, Owusu Ansah L. Education in the era of generative artificial intelligence (AI): understanding the potential benefits of ChatGPT in promoting teaching and learning. 2023.

17.

Waisberg E, Ong J, Masalkhi M, Kamran SA, Zaman N, Sarker P, et al. GPT-4: a new era of artificial intelligence in medicine. Ir J Med Sci. 2023. https://doi.org/10.1007/s11845-023-03377-8.CrossRefPubMedPubMedCentral

18.

Gan Z, Li L, Li C, Wang L, Liu Z, Gao J. Vision-language pre-training: basics, recent advances, and future trends. Foundations and Trends® in Computer Graphics and Vision. 2022;14:163–352. doi: https://doi.org/10.1561/0600000105.

19.

Wang Z, Wu Z, Agarwal D, Sun J. MedCLIP: contrastive learning from unpaired medical images and text. ArXiv. 2022;abs/2210.10163.

20.

Radford A, Kim JW, Hallacy C, Ramesh A, Goh G, Agarwal S, et al. Learning transferable visual models from natural language supervision. In: Marina M, Tong Z, editors. Proceedings of the 38th International Conference on Machine Learning. Proceedings of Machine Learning Research: PMLR; 2021. p. 8748–63.

21.

Eslami S, de Melo G, Meinel C. Does clip benefit visual question answering in the medical domain as much as it does in the general domain? ArXiv. 2021:abs/2112.13906.

22.

Moor M, Banerjee O, Abad ZSH, Krumholz HM, Leskovec J, Topol EJ, et al. Foundation models for generalist medical artificial intelligence. Nature. 2023;616:259–65. https://doi.org/10.1038/s41586-023-05881-4.CrossRefPubMed

23.

Zhang S, Xu Y, Usuyama N, Bagga JK, Tinn R, Preston S, et al. Large-scale domain-specific pretraining for biomedical vision-language processing. ArXiv. 2023;abs/2303.00915.

Titel: Medical image Generative Pre-Trained Transformer (MI-GPT): future direction for precision medicine
verfasst von: Xiaohui Zhang
Yan Zhong
Chentao Jin
Daoyan Hu
Mei Tian
Hong Zhang
Publikationsdatum: 07.10.2023
Verlag: Springer Berlin Heidelberg
Erschienen in: European Journal of Nuclear Medicine and Molecular Imaging / Ausgabe 2/2024
Print ISSN: 1619-7070
Elektronische ISSN: 1619-7089
DOI: https://doi.org/10.1007/s00259-023-06450-7

Live-Webinar "Urologie und Sexualmedizin in der Praxis"

Springer Medizin

Medical image Generative Pre-Trained Transformer (MI-GPT): future direction for precision medicine

Excerpt

Live-Webinar "Urologie und Sexualmedizin in der Praxis"

Springer Medizin

Excerpt

Bitte loggen Sie sich ein, um Zugang zu diesem Inhalt zu erhalten

Weitere Artikel der Ausgabe 2/2024

International consensus on clinical use of presynaptic dopaminergic positron emission tomography imaging in parkinsonism

Total-body PET/CT with half-dose [68 Ga]Ga-PSMA-11 for biochemical recurrent prostate cancer: comparable diagnostic value to short axial field-of-view PET/CT with full-dose [68 Ga]Ga-PSMA-11

Sentinel lymph node detection in thyroid carcinoma using [68Ga]Ga-tilmanocept PET/CT: a proof-of-concept study

PET/CT-based deep learning grading signature to optimize surgical decisions for clinical stage I invasive lung adenocarcinoma and biologic basis under its prediction: a multicenter study

Prostate-specific membrane antigen radioguided surgery with negative histopathology: an in-depth analysis

Perceived risk and decision-making: navigating uncertainty in clinical practice