An Investigation of Lesion Detection Accuracy for Artificial Intelligence-Based Denoising of Low-Dose 64Cu-DOTATATE PET Imaging in Patients with Neuroendocrine Neoplasms

Research output: Contribution to journalJournal articleResearchpeer-review

Standard

An Investigation of Lesion Detection Accuracy for Artificial Intelligence-Based Denoising of Low-Dose 64Cu-DOTATATE PET Imaging in Patients with Neuroendocrine Neoplasms. / Loft, Mathias; Ladefoged, Claes N; Johnbeck, Camilla B; Carlsen, Esben A; Oturai, Peter; Langer, Seppo W; Knigge, Ulrich; Andersen, Flemming L; Kjaer, Andreas.

In: Journal of nuclear medicine : official publication, Society of Nuclear Medicine, Vol. 64, No. 6, 2023, p. 951-959.

Research output: Contribution to journalJournal articleResearchpeer-review

Harvard

Loft, M, Ladefoged, CN, Johnbeck, CB, Carlsen, EA, Oturai, P, Langer, SW, Knigge, U, Andersen, FL & Kjaer, A 2023, 'An Investigation of Lesion Detection Accuracy for Artificial Intelligence-Based Denoising of Low-Dose 64Cu-DOTATATE PET Imaging in Patients with Neuroendocrine Neoplasms', Journal of nuclear medicine : official publication, Society of Nuclear Medicine, vol. 64, no. 6, pp. 951-959. https://doi.org/10.2967/jnumed.122.264826

APA

Loft, M., Ladefoged, C. N., Johnbeck, C. B., Carlsen, E. A., Oturai, P., Langer, S. W., Knigge, U., Andersen, F. L., & Kjaer, A. (2023). An Investigation of Lesion Detection Accuracy for Artificial Intelligence-Based Denoising of Low-Dose 64Cu-DOTATATE PET Imaging in Patients with Neuroendocrine Neoplasms. Journal of nuclear medicine : official publication, Society of Nuclear Medicine, 64(6), 951-959. https://doi.org/10.2967/jnumed.122.264826

Vancouver

Loft M, Ladefoged CN, Johnbeck CB, Carlsen EA, Oturai P, Langer SW et al. An Investigation of Lesion Detection Accuracy for Artificial Intelligence-Based Denoising of Low-Dose 64Cu-DOTATATE PET Imaging in Patients with Neuroendocrine Neoplasms. Journal of nuclear medicine : official publication, Society of Nuclear Medicine. 2023;64(6):951-959. https://doi.org/10.2967/jnumed.122.264826

Author

Loft, Mathias ; Ladefoged, Claes N ; Johnbeck, Camilla B ; Carlsen, Esben A ; Oturai, Peter ; Langer, Seppo W ; Knigge, Ulrich ; Andersen, Flemming L ; Kjaer, Andreas. / An Investigation of Lesion Detection Accuracy for Artificial Intelligence-Based Denoising of Low-Dose 64Cu-DOTATATE PET Imaging in Patients with Neuroendocrine Neoplasms. In: Journal of nuclear medicine : official publication, Society of Nuclear Medicine. 2023 ; Vol. 64, No. 6. pp. 951-959.

Bibtex

@article{8f7a1ad0e4b845a69592962e770b3b49,
title = "An Investigation of Lesion Detection Accuracy for Artificial Intelligence-Based Denoising of Low-Dose 64Cu-DOTATATE PET Imaging in Patients with Neuroendocrine Neoplasms",
abstract = "Frequent somatostatin receptor PET, for example, 64Cu-DOTATATE PET, is part of the diagnostic work-up of patients with neuroendocrine neoplasms (NENs), resulting in high accumulated radiation doses. Scan-related radiation exposure should be minimized in accordance with the as-low-as-reasonably achievable principle, for example, by reducing injected radiotracer activity. Previous investigations found that reducing 64Cu-DOTATATE activity to below 50 MBq results in inadequate image quality and lesion detection. We therefore investigated whether image quality and lesion detection of less than 50 MBq of 64Cu-DOTATATE PET could be restored using artificial intelligence (AI). Methods: We implemented a parameter-transferred Wasserstein generative adversarial network for patients with NENs on simulated low-dose 64Cu-DOTATATE PET images corresponding to 25% (PET25%), or about 48 MBq, of the injected activity of the reference full dose (PET100%), or about 191 MBq, to generate denoised PET images (PETAI). We included 38 patients in the training sets for network optimization. We analyzed PET intensity correlation, peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), and mean-square error (MSE) of PETAI/PET100% versus PET25%/PET100% Two readers assessed Likert scale-defined image quality (1, very poor; 2, poor; 3, moderate; 4, good; 5, excellent) and identified lesion-suspicious foci on PETAI and PET100% in a subset of the patients with no more than 20 lesions per organ (n = 33) to allow comparison of all foci on a 1:1 basis. Detected foci were scored (C1, definite lesion; C0, lesion-suspicious focus) and matched with PET100% as the reference. True-positive (TP), false-positive (FP), and false-negative (FN) lesions were assessed. Results: For PETAI/PET100% versus PET25%/PET100%, PET intensity correlation had a goodness-of-fit value of 0.94 versus 0.81, PSNR was 58.1 versus 53.0, SSIM was 0.908 versus 0.899, and MSE was 2.6 versus 4.7. Likert scale-defined image quality was rated good or excellent in 33 of 33 and 32 of 33 patients on PET100% and PETAI, respectively. Total number of detected lesions was 118 on PET100% and 115 on PETAI Only 78 PETAI lesions were TP, 40 were FN, and 37 were FP, yielding detection sensitivity (TP/(TP+FN)) and a false discovery rate (FP/(TP+FP)) of 66% (78/118) and 32% (37/115), respectively. In 62% (23/37) of cases, the FP lesion was scored C1, suggesting a definite lesion. Conclusion: PETAI improved visual similarity with PET100% compared with PET25%, and PETAI and PET100% had similar Likert scale-defined image quality. However, lesion detection analysis performed by physicians showed high proportions of FP and FN lesions on PETAI, highlighting the need for clinical validation of AI algorithms.",
author = "Mathias Loft and Ladefoged, {Claes N} and Johnbeck, {Camilla B} and Carlsen, {Esben A} and Peter Oturai and Langer, {Seppo W} and Ulrich Knigge and Andersen, {Flemming L} and Andreas Kjaer",
note = "{\textcopyright} 2023 by the Society of Nuclear Medicine and Molecular Imaging.",
year = "2023",
doi = "10.2967/jnumed.122.264826",
language = "English",
volume = "64",
pages = "951--959",
journal = "The Journal of Nuclear Medicine",
issn = "0161-5505",
publisher = "Society of Nuclear Medicine",
number = "6",

}

RIS

TY - JOUR

T1 - An Investigation of Lesion Detection Accuracy for Artificial Intelligence-Based Denoising of Low-Dose 64Cu-DOTATATE PET Imaging in Patients with Neuroendocrine Neoplasms

AU - Loft, Mathias

AU - Ladefoged, Claes N

AU - Johnbeck, Camilla B

AU - Carlsen, Esben A

AU - Oturai, Peter

AU - Langer, Seppo W

AU - Knigge, Ulrich

AU - Andersen, Flemming L

AU - Kjaer, Andreas

N1 - © 2023 by the Society of Nuclear Medicine and Molecular Imaging.

PY - 2023

Y1 - 2023

N2 - Frequent somatostatin receptor PET, for example, 64Cu-DOTATATE PET, is part of the diagnostic work-up of patients with neuroendocrine neoplasms (NENs), resulting in high accumulated radiation doses. Scan-related radiation exposure should be minimized in accordance with the as-low-as-reasonably achievable principle, for example, by reducing injected radiotracer activity. Previous investigations found that reducing 64Cu-DOTATATE activity to below 50 MBq results in inadequate image quality and lesion detection. We therefore investigated whether image quality and lesion detection of less than 50 MBq of 64Cu-DOTATATE PET could be restored using artificial intelligence (AI). Methods: We implemented a parameter-transferred Wasserstein generative adversarial network for patients with NENs on simulated low-dose 64Cu-DOTATATE PET images corresponding to 25% (PET25%), or about 48 MBq, of the injected activity of the reference full dose (PET100%), or about 191 MBq, to generate denoised PET images (PETAI). We included 38 patients in the training sets for network optimization. We analyzed PET intensity correlation, peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), and mean-square error (MSE) of PETAI/PET100% versus PET25%/PET100% Two readers assessed Likert scale-defined image quality (1, very poor; 2, poor; 3, moderate; 4, good; 5, excellent) and identified lesion-suspicious foci on PETAI and PET100% in a subset of the patients with no more than 20 lesions per organ (n = 33) to allow comparison of all foci on a 1:1 basis. Detected foci were scored (C1, definite lesion; C0, lesion-suspicious focus) and matched with PET100% as the reference. True-positive (TP), false-positive (FP), and false-negative (FN) lesions were assessed. Results: For PETAI/PET100% versus PET25%/PET100%, PET intensity correlation had a goodness-of-fit value of 0.94 versus 0.81, PSNR was 58.1 versus 53.0, SSIM was 0.908 versus 0.899, and MSE was 2.6 versus 4.7. Likert scale-defined image quality was rated good or excellent in 33 of 33 and 32 of 33 patients on PET100% and PETAI, respectively. Total number of detected lesions was 118 on PET100% and 115 on PETAI Only 78 PETAI lesions were TP, 40 were FN, and 37 were FP, yielding detection sensitivity (TP/(TP+FN)) and a false discovery rate (FP/(TP+FP)) of 66% (78/118) and 32% (37/115), respectively. In 62% (23/37) of cases, the FP lesion was scored C1, suggesting a definite lesion. Conclusion: PETAI improved visual similarity with PET100% compared with PET25%, and PETAI and PET100% had similar Likert scale-defined image quality. However, lesion detection analysis performed by physicians showed high proportions of FP and FN lesions on PETAI, highlighting the need for clinical validation of AI algorithms.

AB - Frequent somatostatin receptor PET, for example, 64Cu-DOTATATE PET, is part of the diagnostic work-up of patients with neuroendocrine neoplasms (NENs), resulting in high accumulated radiation doses. Scan-related radiation exposure should be minimized in accordance with the as-low-as-reasonably achievable principle, for example, by reducing injected radiotracer activity. Previous investigations found that reducing 64Cu-DOTATATE activity to below 50 MBq results in inadequate image quality and lesion detection. We therefore investigated whether image quality and lesion detection of less than 50 MBq of 64Cu-DOTATATE PET could be restored using artificial intelligence (AI). Methods: We implemented a parameter-transferred Wasserstein generative adversarial network for patients with NENs on simulated low-dose 64Cu-DOTATATE PET images corresponding to 25% (PET25%), or about 48 MBq, of the injected activity of the reference full dose (PET100%), or about 191 MBq, to generate denoised PET images (PETAI). We included 38 patients in the training sets for network optimization. We analyzed PET intensity correlation, peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), and mean-square error (MSE) of PETAI/PET100% versus PET25%/PET100% Two readers assessed Likert scale-defined image quality (1, very poor; 2, poor; 3, moderate; 4, good; 5, excellent) and identified lesion-suspicious foci on PETAI and PET100% in a subset of the patients with no more than 20 lesions per organ (n = 33) to allow comparison of all foci on a 1:1 basis. Detected foci were scored (C1, definite lesion; C0, lesion-suspicious focus) and matched with PET100% as the reference. True-positive (TP), false-positive (FP), and false-negative (FN) lesions were assessed. Results: For PETAI/PET100% versus PET25%/PET100%, PET intensity correlation had a goodness-of-fit value of 0.94 versus 0.81, PSNR was 58.1 versus 53.0, SSIM was 0.908 versus 0.899, and MSE was 2.6 versus 4.7. Likert scale-defined image quality was rated good or excellent in 33 of 33 and 32 of 33 patients on PET100% and PETAI, respectively. Total number of detected lesions was 118 on PET100% and 115 on PETAI Only 78 PETAI lesions were TP, 40 were FN, and 37 were FP, yielding detection sensitivity (TP/(TP+FN)) and a false discovery rate (FP/(TP+FP)) of 66% (78/118) and 32% (37/115), respectively. In 62% (23/37) of cases, the FP lesion was scored C1, suggesting a definite lesion. Conclusion: PETAI improved visual similarity with PET100% compared with PET25%, and PETAI and PET100% had similar Likert scale-defined image quality. However, lesion detection analysis performed by physicians showed high proportions of FP and FN lesions on PETAI, highlighting the need for clinical validation of AI algorithms.

U2 - 10.2967/jnumed.122.264826

DO - 10.2967/jnumed.122.264826

M3 - Journal article

C2 - 37169532

VL - 64

SP - 951

EP - 959

JO - The Journal of Nuclear Medicine

JF - The Journal of Nuclear Medicine

SN - 0161-5505

IS - 6

ER -

ID: 347318032