The recent article by Drs. Johnston and Goldstein [1] adds to the
studies comparing “non-invasive” and “invasive” methods of assessing
carotid stenosis. Unfortunately, we believe there are too many flaws in
this article to contribute to the debate.
Obvious problems relate to the retrospective design, and therefore,
non-standardized and non-blinded performance and reporting of the tests.
Whether “tandem lesions” should be a contraindication to endarterectomy,
and whether the distinction between critical stenosis and occlusion is as
important as is suggested demands further scrutiny, given recent evidence
from the endarterectomy trials. [2, 3]
Perhaps the most important omission from this article, and from the
accompanying Editorial [4], relates to observer variability in reporting.
When two individuals report a test they will disagree in a proportion of
cases. When reporting carotid stenosis, the rate of disagreement will in
part depend upon what proportion of individuals studied have stenosis
close to the “cut-off” chosen. Therefore, the degree of observer
variability is specific to the patient population studied and should be
quoted for any method comparison study. When observer variability is
considered, it is clear that it accounts for a large proportion of the
“disagreements” between different methods of measurement. We found in two
separate studies that observer variation in reporting the same
conventional catheter angiograms can result in “surgically-significant”
disagreements in 3.4% to 7.3% and 3.8% to 12.4% of vessels studied. [5, 6]
Compare this figure to the “misclassification rate” of 7.9% reported by
Johnston and Goldstein when concordant MRA and ultrasound were compared to
catheter angiography. Whatever technique is chosen to measure carotid
stenosis, “inappropriate” decisions concerning surgery will be made due to
the inevitable differences that occur between individuals (or on different
occasions by the same individual) when the measurement is made. Given
that there are disagreements when the same technique is assessed on two
occasions, it is obvious that comparing any alternative technique will
also inevitably produce disagreements, a fact, which should not be as
surprising as suggested in the accompanying editorial. [4]
In the carotid imaging literature, there tends to be polarization of
views with recommendations to rely solely on catheter angiography or
solely on non-invasive techniques. Perhaps the pragmatic approach to
adopt would be to suggest performing the safest test that gives a reliable
answer. In most cases it is possible to identify appropriate individuals
with complete confidence by non-invasive techniques, while on some
occasions, when non-invasive imaging gives uncertain results, catheter
angiography should be performed.
References:
1) Johnston DCC, Goldstein LB. Clinical carotid endarterectomy decision-
making. Non-invasive vascular imaging versus angiography. Neurology
2001;56:1009-1015.
2) Kappelle LJ, Eliasziw M, Fox AJ, Sharpe BL, Barnett HJM; for the
North American Symptomatic Carotid Endarterectomy Trial (NASCET) Group.
Importance of intracranial atherosclerotic disease in patients with
symptomatic stenosis of the internal carotid artery. Stroke 1999;30:282-
286.
3) Rothwell PM, Warlow CP; on behalf of the European Carotid Surgery
Trialists’ Collaborative Group. Low risk of ischaemic stroke in patients
with reduced internal carotid artery lumen diameter distal to severe
symptomatic carotid stenosis: Cerebral protection due to low poststenotic
flow? Stroke 2000;31:615-621.
4) Norris JW, Rothwell PM. Noninvasive carotid imaging to select
patients for endarterectomy. Neurology 2001;56:990-991.
5) Young GR, Sandercock PAG, Slattery J, Humphrey PRD, Smith ETS,
Brock L. Observer variation in the interpretation of intra-arterial
angiograms and the risk of inappropriate decisions about carotid
endarterecomy. Journal of Neurology, Neurosurgery, and Psychiatry
1996;60:152-157.
6) Young GR, Humphrey PRD, Nixon TE, Smith ETS. Variability in the
measurement of extracranial internal carotid artery stenosis as displayed
by both digital subtraction and magnetic resonance angiography: An
assessment of three calliper techniques as well as the visual impression
of stenosis. Stroke 1996;27:467-473.