|
|
AbstractObjectiveWe aim to develop an interactive segmentation model that can offer accuracy and reliability for the segmentation of the irregularly shaped spinal cord and canal in degenerative cervical myelopathy (DCM) through manual click and model refinement.
MethodsA dataset of 1444 frames from 294 magnetic resonance imaging records of DCM patients was used and we developed two different segmentation models for comparison : auto-segmentation and interactive segmentation. The former was based on U-Net and utilized a pretrained ConvNeXT-tiny as its encoder. For the latter, we employed an interactive segmentation model structured by SimpleClick, a large model that utilizes a vision transformer as its backbone, together with simple fine-tuning. The segmentation performance of the two models were compared in terms of their Dice scores, mean intersection over union (mIoU), Average Precision and Hausdorff distance. The efficiency of the interactive segmentation model was evaluated by the number of clicks required to achieve a target mIoU.
ResultsOur model achieved better scores across all four-evaluation metrics for segmentation accuracy, showing improvements of +6.4%, +1.8%, +3.7%, and -53.0% for canal segmentation, and +11.7%, +6.0%, +18.2%, and -70.9% for cord segmentation with 15 clicks, respectively. The required clicks for the interactive segmentation model to achieve a 90% mIoU for spinal canal with cord cases and 80% mIoU for spinal cord cases were 11.71 and 11.99, respectively.
ConclusionWe found that the interactive segmentation model significantly outperformed the auto-segmentation model. By incorporating simple manual inputs, the interactive model effectively identified regions of interest, particularly in the complex and irregular shapes of the spinal cord, demonstrating both enhanced accuracy and adaptability.
INTRODUCTIONDegenerative cervical myelopathy (DCM) encompasses conditions like cervical spondylotic myelopathy and degenerative disc disease, often linked to ligamentous abnormalities such as ossification of the posterior longitudinal ligament [5]. DCM is a leading cause of spinal cord dysfunction in the elderly, with a progressive course where symptoms deteriorate in 20−60% of patients [9,19,23]. Surgery is typically aimed at halting symptom progression, given the spinal cord’s limited regenerative potential [1]. As the elderly population increases, the prevalence of DCM is expected to rise, making it an important public health issue.
Magnetic resonance imaging (MRI) is vital for diagnosing DCM due to its superior ability to capture soft-tissue contrasts and assess spinal cord changes [6]. Early detection and accurate assessment of DCM severity are crucial for predicting outcomes and tailoring treatments. However, manual analysis of MRI data is labor-intensive and subjective, often leading to variability between observers. This has highlighted the need for more efficient, reliable analytical methods.
Artificial intelligence (AI) and deep learning (DL), particularly in the realm of computer vision, offer significant advancements in automating the detection, segmentation, and classification of pathological features in MRI images [15]. Image segmentation plays a critical role in improving diagnostic sensitivity and patient outcomes by enabling models to better localize pathological areas. While segmentation has been incorporated into many DL models for spine MRI, its application to DCM—where the compressed spinal cord and irregular anatomy pose challenges—remains underexplored [3,8,11,12,16].
In this study, we develop and evaluate segmentation models tailored to MRI images of DCM patients using a relatively small dataset of 294 patients. We compared two types of pretrained segmentation models : an auto-segmentation model based on convolutional neural networks (CNNs) using a U-Net architecture, and an interactive segmentation model that adopts a vision transformer backbone, following the recent trend of employing ViT-based architectures in interactive segmentation [10,13,14,18,22].
We demonstrated that the performance of the interactive segmentation model—augmented by minimal manual input from human experts—surpasses that of the auto-segmentation model. In addition, we investigated the relationship between the number of manual interactions and model performance, confirming the efficiency and practicality of the interactive approach.
MATERIALS AND METHODSThis study was approved by the Institutional Review Board (IRB) of Boramae Medical Center (IRB number 30-2020-20), which waived the requirement for informed consent for data analysis. A waiver permission letter was obtained from the IRB administrators before data collection. Because the enrolled patients were not directly involved in this study (the data were obtained from chart reviews), informed consent was not required. Nevertheless, the extracted data from the medical records were stored confidentially. Our results have been presented in accordance with the guidelines and recommendations established for AI research involving medical data [13,18]. All MRI digital imaging and private information in medical files were anonymized before being used in the research.
Participant selectionThe MRI images and clinical data for a total of 294 patients with DCM, recorded between March 2010 and September 2022, were retrospectively reviewed. Individuals were included according to the following criteria : (a) age >17 years, (b) had been diagnosed with DCM using spinal MRI, (c) had no previous history of cervical spine surgery. More demographic details about participants are given in Table 1.
MR data acquisitionCervical spine MRI scanning was performed with a 3T (MAGNETOM Vida; Siemens Healthineers, Erlangen, Germany) MRI scanner. We used images from a turbo spin echo T2-weighted sequence in the sagittal plane (T2-TSE Sag). The MRI parameter values for the T2-TSE Sag were slices for a group=15, distance factor=10%, position=isocenter, phase encoding direction=head to feet, phase oversampling=50%, field of view=200×200 mm, slice thickness=3.0 mm, repetition time=3500.0 ms, echo time=82.0 ms, flip angle=110°, average=3, and concatenation=1. The number of slices was occasionally different from 15 because of the variation in spine shapes in diseased patients.
Data preprocessing and augmentationWe utilized a labeling procedure to create a bounding box for the region of interest (RoI) and binary masks for the spinal canal and cord in 3-5 frames from each MRI recording. The selected frames in this MRI sequence are the key frame (middle frame of the sequence) and the front and back frames of the sequence. Because the spinal canal image has the cord in the middle for a sagittal-view MRI, the binary mask of the canal is represented by integrating the canal and cord area for simplicity.
As shown in Fig. 1, each MRI was preprocessed using a series of steps : (a) N4 bias correction to mitigate inherent biases, (b) quantile clipping to eliminate outliers among pixel values, (c) min-max normalization, (d) RoI cropping, where the RoI bounding box was labeled during the labeling phase, and (e) resizing to a uniform resolution of 256×256 pixels, the size mode for the cropped frames.
To ensure the stability of the pixel distribution while seeking a consistent structure for the medical images, additional augmentation methods, including rotation and random cropping, were adopted. The total dataset was partitioned into a training subset (235 cases) and a testing subset (59 cases) in an 8 : 2 ratio. In this way, 1164 frames and 280 frames were utilized in the training and test phases, respectively.
Development of the modelsAs shown in Fig. 1, we developed two different models to enable comparisons of segmentation performance, namely an auto-segmentation model and an interactive segmentation model. Both models predicted binary masks for the spinal canal and cord separately because of overlapping areas in each ground-truth mask.
For more details, we leveraged U-Net for the auto-segmentation model, which uses ConvNeXT-tiny pretrained on ImageNet as its encoder. The randomly initialized CNN-based decoder was trained to predict the segmentation mask using features encoded from each layer of the encoder as skip connections.
We employed an interactive segmentation model based on SimpleClick [13], which utilizes a plain vision transformer pretrained on the COCO-LVLS [4] dataset as its backbone. The model constructed a multi-scale feature pyramid from the transformer and used it as input for a segmentation head composed of multi-layer perceptrons. The head produced a 1/4-scale probability map, which was then upsampled to generate the final output. Positive and negative user clicks were encoded into a two-channel disk map and embedded as patches. These were combined element-wise and fed into a self-attention block. The model received as input an MRI frame, the previous mask, and the number of clicks. The reason of utilizing SimpleClick for our model stems from its demonstrated performance in medical imaging tasks. For instance, in the BraTS dataset, which shared imaging modality characteristics with our DCM MRI data, SimpleClick achieved a mean intersection over union (mIoU) of 88.98% with just 10 clicks.
For DL, an NVIDIA RTX A5000 (NVIDIA, Santa Clara, CA, USA) graphics processing unit was utilized. DL was executed using Python 3.8.10 and the PyTorch 2.0.0 framework on the Ubuntu 20.04.5 operating system. The Visual Studio Code application (Microsoft Corp., Redmond, WA, USA) was also used in the experiments.
Segmentation assessmentFirst, we obtained a Dice score, mIoU, Average Precision and Hausdorff distance to evaluate the segmentation accuracy. We tracked changes in the four metrics over 15 clicks to conduct a self-evaluation of the interactive segmentation model. We then compared the scores for auto-segmentation and interactive segmentation after the 15th click.
Next, we used the number of clicks to evaluate the models’ efficiency. We recorded the number of clicks required to achieve mIoU values of 80%, 85%, and 90% (to avoid infeasible numbers of clicks, we limited the number to 20).
We conducted additional statistical analyses to assess whether the observed improvements between the auto-segmentation and interactive segmentation models were statistically significant. Specifically, we applied Wilcoxon signed-rank tests to compare the performance metrics across matched test samples.
RESULTSComparison of performance between the modelsThe training processes for canal and cord segmentation are both performed. In each task, the models predicted binary masks, with 0 representing the background and one representing the RoI. The DICE scores, mIoU, Average Precision, and Hausdorff distance for canal segmentation were better than for cord segmentation in both models, which may be attributed to the complex shape of the spinal cord, as shown in Table 2.
The auto-segmentation model obtained a DICE score of 0.8226±0.0176 for the canal with cord mask segmentation and 0.7363±0.0210 for the cord mask segmentation, using three different seeds. The interactive segmentation model with only two clicks was superior to the auto-segmentation model, obtaining DICE scores of 0.8417 (+2.3%) and 0.8063 (+2.1%) for canal and cord mask segmentation, respectively. With additional clicks, the performance of the interactive segmentation model continued to improve, finally obtaining DICE scores of 0.8756 (+6.4%) and 0.8228 (+11.7%) for canal and cord mask segmentation, respectively, with 15 clicks.
Our model also achieved improved segmentation accuracy in other metrics. For mIoU, our model showed 0.8896 (+1.8%) and 0.8164 (+6.0%) scores. Average Precision of our model showed 0.9589 (+3.7%) and 0.9107 (+18.2%) scores. In the Hausdorff distance metric, which is a surface distance-based metric in contrast to former metrics, our model achieved 4.36 (-53.0%) and 5.92 (-70.9%) distance values. All of these results are with 15 clicks.
Additionally, we perform Wilcoxon signed-rank tests to evaluate the statistical significance of performance differences between the auto segmentation and interactive segmentation models across different segmentation categories and click settings.
As shown in Table 3, the results demonstrate that the improvements achieved by interactive segmentation are statistically significant in all cases (p<1e-20), confirming the robustness and reliability of the observed gains.
Efficiency of the interactive segmentation modelAlthough the segmentation results could be improved indefinitely by continuing human guidance, the number of clicks required to achieve adequate performance is also important as a measure of efficiency. We checked the efficiency metric for achieving mIoU values of 80%, 85%, and 90% for 287 cases from the testing set, allowing a maximum of 20 clicks. The average number of clicks required to achieve an mIoU of 80% for canal and cord mask prediction was 6.28 and 11.99, respectively (Table 4). Fig. 2 shows a histogram of the number of cases for each number of clicks to achieve an mIoU of 80%, omitting 94 cases with 20 clicks caused by unclear or not visible border of the cord. The figure shows that 53.5% of the residual dataset cases required up to six clicks to achieve an mIoU of 80%.
DISCUSSIONDCM is a progressive spinal cord disease, and the primary goal of surgical treatment is to halt symptom progression, as functional recovery is often limited due to the spinal cord’s low regenerative potential [1,19].
MRI is highlighted for understanding the progression of DCM because of its ability to enable visualization and quantify temporal changes in the spinal cord. However, manual analysis of MRI data can be time-consuming, subjective, and prone to interobserver variability.
To tackle this problem, we have explored the applicability of AI for the image segmentation task in MRI analysis, which localizes the spinal canal and cord and has the potential to improve pathological findings, diagnostic sensitivity, and patient outcomes. To this end, we have developed a DL-based interactive segmentation model to support MRI analysis in terms of both accuracy and efficiency.
Although the segmentation of the spinal cord alone may appear sufficient in some clinical settings, we intentionally segmented both the spinal cord and the spinal canal in this study. This was based on the hypothesis that the morphological relationship between these two structures—including the degree and shape of compression—may serve as important imaging features in future predictive models for neurological outcomes in DCM. An auto-segmentation model based on a U-Net architecture with a ConvNeXt-tiny backbone segmented the spinal canal and cord in 287 patients within approximately three seconds, achieving average DICE scores of 0.8226 and 0.7363, respectively. While the automated model demonstrated good efficiency shown in Fig. 3, it was outperformed by our interactive segmentation model as shown in Fig. 4 with a few user clicks. With 15 clicks, the interactive model exhibited a substantial improvement, reaching 0.8756 and 0.8228 in Dice score, respectively. These findings highlight the practical value of incorporating user input into the segmentation process. Even minimal human interaction can provide contextual cues that are difficult for fully automated models to infer—especially in cases with ambiguous boundaries or irregular morphologies, which are common in DCM. The interactive segmentation model developed here is intended to lay the foundation for such prognostic research by providing accurate and reproducible delineation of both anatomical regions. And, this observation aligns with recent trends in medical imaging, where human-in-the-loop approaches have shown promise in improving both accuracy and interpretability [20,21].
While prior studies have addressed spinal cord segmentation, many have faced limitations such as morphological variability, dependence on large annotated datasets, or lack of adaptability to irregular anatomical structures typical of DCM. Recent efforts have begun to explore more robust and efficient methods, including transformer-based and interactive approaches, which informed the development of our proposed mode [2,7,17]. To the best of our knowledge, this study is the first to apply a DL-based interactive segmentation model to localize the compressed and irregularly shaped spinal cord in MRI scans for DCM assessment. Our model, fine-tuned with a relatively small dataset of 220 patients, demonstrates that expert-guided interactions can effectively compensate for the limitations of purely automated segmentation. The interactive segmentation model highlights the accessibility and adaptability of such approaches for integration into clinical workflows.
While this study explores the applicability of both segmentation models to MRI images of DCM patients, it has some limitations. First, external validation is not performed for evaluating robustness due to challenges in obtaining diverse datasets from different institutions or imaging protocols. Second, our analysis focused exclusively on mild DCM cases; severe cases exhibiting more pronounced cord deformation or ambiguous boundaries were not included. We plan to evaluate the models on an external dataset to further assess their robustness and to extend the analysis to severe DCM cases with more complex anatomical variations.
In addition, future studies could explore using the segmentation results obtained through the interactive model to fine-tune the auto-segmentation model. This approach could enhance the auto-segmentation model’s ability to handle complex anatomical structures by leveraging high-accuracy segmentation masks as training data. Another potential avenue for improvement is to retrain the interactive segmentation model using accumulated click-based data, which may reduce the number of required clicks while improving segmentation accuracy. These adaptations could further increase the efficiency and applicability of our model in various clinical settings.
CONCLUSIONIn this study, we have demonstrated that using simple manual inputs enables the DL model to better identify the RoI in the image, particularly for cases where drawing the mask is challenging, such as for the spinal cord of patients with DCM. In addition, the masks obtained via our model could be leveraged to investigate changes in the spinal cord over time.
NotesAuthor contributions Conceptualization : SBP, WC; Data curation : SH, JKO; Formal analysis : SH; Funding acquisition : SBP; Methodology : SH, JKO, WC; Project administration : SBP; Visualization : TJK, NH; Writing - original draft : SH; Writing - review & editi ng : SBP, WC Fig. 1.Overview of data processing and model development of our work. RoI : region of interest, mIoU : mean intersection over union, AP : average precision, VIT : vision transformer, MLP : multilayer perceptron. Fig. 2.Distribution of clicks required to achieve 80% mean intersection over union (mIoU) in interactive segmentation. Fig. 3.The pairs of ground truth and segmentation masks from the auto-segmentation model. A : Ground truth of spinal canal with cord. B : Ground truth of spinal cord. C : Predicted masks for spinal canal with cord. And (D) predicted masks for spinal cord. Fig. 4.Pairs of predicted segmentation masks and probability maps from the interactive model. A : Segmentation of the spinal canal with 1 click. B : Segmentation of the spinal canal with 10 clicks. C : Segmentation of the spinal cord with 1 click. And (D) segmentation of the spinal cord with 10 clicks. The green dots guide the region to include, and the red dots guide the region to exclude. Table 1.Characteristics of included patients Table 2.Segmentation accuracy of each model Table 3.Wilcoxon signed-rank test between auto segmentation model and interactive segmentation model across different segmentation categories and number of clicks References1. Davies BM, Khan DZ, Mowforth OD, McNair AGK, Gronlund T, Kolias AG, et al : RE-CODE DCM (REsearch Objectives and Common Data Elements for Degenerative Cervical Myelopathy): a consensus process to improve research efficiency in DCM, through establishment of a standardized dataset for clinical research and the definition of the research priorities. Global Spine J 9(1 Suppl):65S-76S, 2019
2. Enamundram NK, Valosek J, Smith AC, Pfyffer D, Schading-Sassenhausen S, Farner L, et al : SCIseg: automatic segmentation of T2-weighted hyperintense lesions in spinal cord injury. Available at : https://doi.org/10.1101/2024.01.03.24300794
3. Feng R, Zheng X, Gao T, Chen J, Wang W, Chen DZ, et al : Interactive few-shot learning: limited supervision, better medical image segmentation. IEEE Trans Med Imaging 40 : 2575-2588, 2021
4. Gupta A, Dollar P, Girshick R : Lvis: a dataset for large vocabulary instance segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp5356-5364
5. Hejrati N, Moghaddamjou A, Marathe N, Fehlings MG : Degenerative cervical myelopathy: towards a personalized approach. Can J Neurol Sci 49 : 729-740, 2022
6. Hilton B, Tempest-Mitchell J, Davies BM, Francis J, Mannion RJ, Trivedi R, et al : Cord compression defined by MRI is the driving factor behind the decision to operate in Degenerative Cervical Myelopathy despite poor correlation with disease severity. PLoS One 14 : e0226020, 2019
7. Hohenhaus M, Klingler JH, Scholz C, Volz F, Hubbe U, Beck J, et al : Automated signal intensity analysis of the spinal cord for detection of degenerative cervical myelopathy - a matched-pair MRI study. Neuroradiology 65 : 1545-1554, 2023
8. Jiang X, Ge Y, Ge Y, Shi D, Yuan C, Shan Y : Supervised fine-tuning in turn improves visual foundation models. Available at : https://doi.org/10.48550/arXiv.2401.1022
9. Karadimas SK, Erwin WM, Ely CG, Dettori JR, Fehlings MG : Pathophysiology and natural history of cervical spondylotic myelopathy. Spine (Phila Pa 1976) 38(22 Suppl):S21-S36, 2013
10. Kirillov A, Mintun E, Ravi N, Mao H, Rolland C, Gustafson L, et al : Segment anything. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp4015-4026
11. LewandrowskI KU, Muraleedharan N, Eddy SA, Sobti V, Reece BD, Ramírez León JF, et al : Feasibility of deep learning algorithms for reporting in routine spine magnetic resonance imaging. Int J Spine Surg 14(s3):S86-S97, 2020
12. Lewandrowski KU, Muraleedharan N, Eddy SA, Sobti V, Reece BD, Ramírez León JF, et al : Reliability analysis of deep learning algorithms for reporting of routine lumbar MRI scans. Int J Spine Surg 14(s3):S98-S107, 2020
13. Liu Q, Xu Z, Bertasius G, Niethammer M : Simpleclick: interactive image segmentation with simple vision transformers. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp22290-22300
14. Luo X, Wang G, Song T, Zhang J, Aertsen M, Deprest J, et al : MIDeepSeg: minimally interactive segmentation of unseen objects from medical images using deep learning. Med Image Anal 72 : 102102, 2021
15. Martín-Noguerol T, Oñate Miranda M, Amrhein TJ, Paulano-Godino F, Xiberta P, Vilanova JC, et al : The role of artificial intelligence in the assessment of the spine and spinal cord. Eur J Radiol 161 : 110726, 2023
16. Merali Z, Wang JZ, Badhiwala JH, Witiw CD, Wilson JR, Fehlings MG : A deep learning model for detection of cervical spinal cord compression in MRI scans. Sci Rep 11 : 10473, 2021
17. Nozawa K, Maki S, Furuya T, Okimatsu S, Inoue T, Yunde A, et al : Magnetic resonance image segmentation of the compressed spinal cord in patients with degenerative cervical myelopathy using convolutional neural networks. Int J Comput Assist Radiol Surg 18 : 45-54, 2023
18. Sofiiuk K, Petrov IA, Konushin A : Reviving iterative training with mask guidance for interactive segmentation. 2022 IEEE International Conference on Image Processing (ICIP), IEEE, 2022, pp3141-3145
19. Takamiya S, Iwasaki M, Yokohama T, Oura D, Niiya Y, Fujimura M : The prediction of neurological prognosis for cervical spondylotic myelopathy using diffusion tensor imaging. Neurospine 20 : 248-254, 2023
20. Wu J, Wang Z, Hong M, Ji W, Fu H, Xu Y, et al : Medical SAM adapter: adapting segment anything model for medical image segmentation. Med Image Anal 102 : 103547, 2025
21. Xu G, Qian X, Shao HC, Luo J, Lu W, Zhang Y : A segment anything model-guided and match-based semi-supervised segmentation framework for medical imaging. Med Phys 52 : 4513-4527, 2025
|
|
||||||||||||||||||||||||||||||||||||||||