Multicenter evaluation of an AI tool for multi-step imaging in acute stroke diagnosis

Multicenter evaluation of an AI tool for multi-step imaging in acute stroke diagnosis

A French retrospective study assessed CINA-HEAD (Avicenna.AI), an AI tool for acute stroke imaging, using NCCT and CTA scans from 405 patients. The software integrates three modules: CINA-ICH for detecting intracerebral hemorrhage, CINA-LVO for identifying large vessel occlusion, and CINA-ASPECTS for computing ASPECT scores. Ground truth was established through consensus of three expert neuroradiologists, finalized by a fourth.

The tool achieved 94.6% accuracy for ICH detection (sens 86.0%, spec 98.1%), 86.4% accuracy for LVO detection (sens 55.4%, spec 96.8%), and 88.6% region-based accuracy for ASPECTS (sens 68.0%, spec 89.3%) with 80.4% accuracy for dichotomized scoring (ASPECTS ≥ 6).

The tool mirrors the clinical stroke workflow by sequentially addressing ICH exclusion, LVO confirmation, and ischemia assessment. It delivered high accuracy for ICH detection and clinically meaningful results for LVO and ASPECT scoring, demonstrating potential to accelerate triage and guide treatment. Still, its lower sensitivity for distal LVOs and inconsistent ASPECTS agreement in some regions highlight the need for expert oversight, particularly in subtle or diagnostically challenging cases.

Read full study


Performance of an artificial intelligence tool for multi-step acute stroke imaging: A multicenter diagnostic study

European Journal of Radiology, 2025

Abstract

Objective

Several artificial intelligence (AI) tools have been developed to assist in the stroke imaging workflow, which remains a major disease of the 21st century. This study evaluated the combined performance of an FDA-cleared and CE-marked AI-based device with three modules designed to detect intracerebral hemorrhage (ICH), identify large vessel occlusion (LVO), and calculate Alberta Stroke Program Early CT Scores (ASPECTS).

Materials & methods

Non-contrast CT (NCCT) and/or computed tomography angiography (CTA) for suspicion of stroke acquired at La Timone and Nord University hospitals (Marseille, France) between March 2019 and March 2020 were retrospectively collected. The AI tool, CINA-HEAD (Avicenna.AI), processed the data to flag ICH, LVO, and calculate ASPECTS. The results were compared to ground truth evaluations by four expert neuroradiologists to compute diagnostic performances.

Results

A total of 373 NCCT and 331 CTA from 405 patients (mean age 64.9 ± 18.9 SD, 52.6 % female) were included. The AI tool achieved an accuracy of 94.6 % [95 % CI: 91.8 %-96.7 %] for ICH detection on NCCT and of 86.4 % [95 % CI: 82.2 %-89.9 %] for LVO identification on CTA. The region-based ASPECTS analysis yielded an accuracy of 88.6 % [95 % CI: 87.8 %-89.3 %] and the dichotomized ASPECTS classification (ASPECTS ≥ 6) achieved 80.4 % accuracy.

Conclusion

This study demonstrates the reliable, stepwise performance of an AI-based stroke imaging tool across the diagnostic cascade of ICH and LVO detection and ASPECTS scoring. Such robust multi-stage evaluation supports its potential for streamlining acute stroke triage and decision-making.

Related to this article