Skip to main content
AAN.com
Articles
September 11, 2006

The quality of diagnostic accuracy studies since the STARD statement
Has it improved?

This article has been corrected.
VIEW CORRECTION
This article has been corrected.
VIEW CORRECTION
September 12, 2006 issue
67 (5) 792-797

Abstract

Objective: To assess whether the quality of reporting of diagnostic accuracy studies has improved since the publication of the Standards for the Reporting of Diagnostic Accuracy studies (STARD statement).
Methods: The quality of reporting of diagnostic accuracy studies published in 12 medical journals in 2000 (pre-STARD) and 2004 (post-STARD) was evaluated by two reviewers independently. For each article, the number of reported STARD items was counted (range 0 to 25). Differences in completeness of reporting between articles published in 2000 and 2004 were analyzed, using multilevel analyses.
Results: We included 124 articles published in 2000 and 141 articles published in 2004. Mean number of reported STARD items was 11.9 (range 3.5 to 19.5) in 2000 and 13.6 (range 4.0 to 21.0) in 2004, an increase of 1.81 items (95% CI: 0.61 to 3.01). Articles published in 2004 reported the following significantly more often: methods for calculating test reproducibility of the index test (16% vs 35%); distribution of the severity of disease and other diagnoses (23% vs 53%); estimates of variability of diagnostic accuracy between subgroups (39% vs 60%); and a flow diagram (2% vs 12%).
Conclusions: The quality of reporting of diagnostic accuracy studies has improved slightly over time, without a more pronounced effect in journals that adopted the STARD statement. As there is still room for improvement, editors should mention the use of the STARD statement as a requirement in their guidelines for authors, and instruct reviewers to check the STARD items. Authors should include a flow diagram in their manuscript.

Get full access to this article

View all available purchase options and get full access to this article.

References

1.
Chan AW, Altman DG. Epidemiology and reporting of randomized trials published in journals. Lancet 2005;365:1159–1162.
2.
Honest H, Khan KS. Reporting of measures of accuracy in systematic reviews of diagnostic literature. BMC Health Services Research 2002;2:1–4.
3.
Pocock SJ, Collier TJ, Dandreo KJ, et al. Issues in the reporting of epidemiological studies: a survey of recent practice. BMJ 2004;329:883.
4.
Begg CB, Cho MK, Eastwood S, et al. Improving the quality of reporting of randomized controlled trials: the CONSORT statement. JAMA 1996;276:637–639.
5.
Moher D, Schulz KF, Altman DG, for the CONSORT Group. The CONSORT Statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. Ann Intern Med 2001;134:657–662.
6.
Altman DG, Schultz KF, Moher D, for the CONSORT Group. The revised CONSORT Statement for reporting randomized trials: explanation and elaboration. Ann Intern Med 2001;134:663–694.
7.
Bossuyt PM, Reitsma JB, Bruns DE, et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin Chem 2003;49:7–18.
8.
Bossuyt PM, Reitsma JB, Bruns DE, et al. Towards complete and accurate reporting of studies of diagnostic accuracy; the STARD initiative. Clin Chem 2003;49:1–6.
9.
Moher D, Cook DJ, Eastwood S, for the QUOROM group. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Lancet 1999;354:1896–1900.
10.
Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000;283:2008–2012.
11.
Von Elm E, Egger M. The scandal of poor epidemiological research. BMJ 2004;329:868–869.
12.
Siddiqui MAR, Azuara-Blanco A, Burr J. The quality of reporting of diagnostic accuracy studies published in ophthalmic journals. Br J Ophthalmol 2005;89:261–265.
13.
Stengel D, Bauwens K, Rademacher G, Mutze S, Ekkernkamp A. Association between compliance with methodological standards of diagnostic research and reported test accuracy: meta-analysis of focused assessment of US for trauma. Radiology 2005;236:102–111.
14.
Smidt N, Rutjes AWS, Van der Windt AWM, et al. Quality of reporting of diagnostic accuracy studies. Radiology 2005;235:347–353.
15.
Devillé WL, Bezemer PD, Bouter LM. Publications on diagnostic test evaluation in family medicine journals: an optimal search strategy. J Clin Epidemiol 2000;53:65–69.
16.
Holloway RG. Improving the flow of diagnostic information. The importance of STARD for authors and readers. Neurology 2003;61:600–601.
17.
Moher D, Jones A, Lepage L, for the CONSORT group. Use of the CONSORT statement and quality of reports of randomized trials. A comparative before-and-after evaluation. JAMA 2001;285:1992–1995.
18.
Reeves BC. Evidence about evidence. Br J Ophthalmol 2005;89:253–254.
19.
Smidt N, Rutjes AWS, Van der Windt DAWM, et al. Reproducibility of the STARD checklist: an instrument to assess the quality of reporting of diagnostic accuracy studies. BMC Medical Research Methodology 2006;6:12.
20.
Lijmer JG, Mol BW, Heisterkamp S, et al. Empirical evidence of design-related bias in studies of diagnostic tests. JAMA 1999;282:1061–1066.
21.
Whiting P, Rutjes AWS, Reitsma JB, Glas AS, Bossuyt PMM, Kleijnen J. Sources of variation and bias in studies of diagnostic accuracy. Ann Intern Med 2004;140:189–202.

Information & Authors

Information

Published In

Neurology®
Volume 67Number 5September 12, 2006
Pages: 792-797
PubMed: 16966539

Publication History

Published online: September 11, 2006
Published in print: September 12, 2006

Permissions

Request permissions for this article.

Authors

Affiliations & Disclosures

N. Smidt, PhD
From the Institute for Research in Extramural Medicine (N.S., D.A.W.M.v.d.W., R.W.J.G.O., L.M.B., H.C.W.d.V.), VU University Medical Center, Amsterdam; and Department of Clinical Epidemiology & Biostatistics (A.W.S.R., P.M.B., J.B.R.), Academic Medical Center, University of Amsterdam, The Netherlands.
A.W.S. Rutjes, PhD
From the Institute for Research in Extramural Medicine (N.S., D.A.W.M.v.d.W., R.W.J.G.O., L.M.B., H.C.W.d.V.), VU University Medical Center, Amsterdam; and Department of Clinical Epidemiology & Biostatistics (A.W.S.R., P.M.B., J.B.R.), Academic Medical Center, University of Amsterdam, The Netherlands.
D. A.W.M. van der Windt, PhD
From the Institute for Research in Extramural Medicine (N.S., D.A.W.M.v.d.W., R.W.J.G.O., L.M.B., H.C.W.d.V.), VU University Medical Center, Amsterdam; and Department of Clinical Epidemiology & Biostatistics (A.W.S.R., P.M.B., J.B.R.), Academic Medical Center, University of Amsterdam, The Netherlands.
R. W.J.G. Ostelo, PhD
From the Institute for Research in Extramural Medicine (N.S., D.A.W.M.v.d.W., R.W.J.G.O., L.M.B., H.C.W.d.V.), VU University Medical Center, Amsterdam; and Department of Clinical Epidemiology & Biostatistics (A.W.S.R., P.M.B., J.B.R.), Academic Medical Center, University of Amsterdam, The Netherlands.
P. M. Bossuyt, PhD
From the Institute for Research in Extramural Medicine (N.S., D.A.W.M.v.d.W., R.W.J.G.O., L.M.B., H.C.W.d.V.), VU University Medical Center, Amsterdam; and Department of Clinical Epidemiology & Biostatistics (A.W.S.R., P.M.B., J.B.R.), Academic Medical Center, University of Amsterdam, The Netherlands.
J. B. Reitsma, PhD
From the Institute for Research in Extramural Medicine (N.S., D.A.W.M.v.d.W., R.W.J.G.O., L.M.B., H.C.W.d.V.), VU University Medical Center, Amsterdam; and Department of Clinical Epidemiology & Biostatistics (A.W.S.R., P.M.B., J.B.R.), Academic Medical Center, University of Amsterdam, The Netherlands.
L. M. Bouter, PhD
From the Institute for Research in Extramural Medicine (N.S., D.A.W.M.v.d.W., R.W.J.G.O., L.M.B., H.C.W.d.V.), VU University Medical Center, Amsterdam; and Department of Clinical Epidemiology & Biostatistics (A.W.S.R., P.M.B., J.B.R.), Academic Medical Center, University of Amsterdam, The Netherlands.
H. C.W. de Vet, PhD
From the Institute for Research in Extramural Medicine (N.S., D.A.W.M.v.d.W., R.W.J.G.O., L.M.B., H.C.W.d.V.), VU University Medical Center, Amsterdam; and Department of Clinical Epidemiology & Biostatistics (A.W.S.R., P.M.B., J.B.R.), Academic Medical Center, University of Amsterdam, The Netherlands.

Notes

Address correspondence and reprint requests to Dr. Nynke Smidt, Department of Clinical Epidemiology & Biostatistics, Academic Medical Center, University of Amsterdam, PO Box 22700, 1100 DE Amsterdam, The Netherlands; e-mail: [email protected]

Metrics & Citations

Metrics

Citation information is sourced from Crossref Cited-by service.

Citations

Download Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Select your manager software from the list below and click Download.

Cited By
  1. Meta-research on reporting guidelines for artificial intelligence: are authors and reviewers encouraged enough in radiology, nuclear medicine, and medical imaging journals?, Diagnostic and Interventional Radiology, 0, 0, (0-0), (2024).https://doi.org/10.4274/dir.2024.232604
    Crossref
  2. Endorsements of five reporting guidelines for biomedical research by journals of prominent publishers, PLOS ONE, 19, 2, (e0299806), (2024).https://doi.org/10.1371/journal.pone.0299806
    Crossref
  3. Self-reported checklists and quality scoring tools in radiomics: a meta-research, European Radiology, 34, 8, (5028-5040), (2024).https://doi.org/10.1007/s00330-023-10487-5
    Crossref
  4. Consolidated Reporting Guidelines for Prognostic and Diagnostic Machine Learning Modeling Studies: Development and Validation, Journal of Medical Internet Research, 25, (e48763), (2023).https://doi.org/10.2196/48763
    Crossref
  5. Has the quality of reporting improved since it became mandatory to use the Standards for Reporting Diagnostic Accuracy?, Insights into Imaging, 14, 1, (2023).https://doi.org/10.1186/s13244-023-01432-7
    Crossref
  6. Reporting Eye-tracking Studies In DEntistry (RESIDE) checklist, Journal of Dentistry, 129, (104359), (2023).https://doi.org/10.1016/j.jdent.2022.104359
    Crossref
  7. Overviews of reviews in the cardiovascular field underreported critical methodological and transparency characteristics: a methodological study based on the Preferred Reporting Items for Overviews of Reviews (PRIOR) statement, Journal of Clinical Epidemiology, 159, (139-150), (2023).https://doi.org/10.1016/j.jclinepi.2023.05.018
    Crossref
  8. A methodological quality review of citations of randomized controlled trials of diabetes type2 in leading clinical practice guidelines and systematic reviews, Journal of Diabetes & Metabolic Disorders, 23, 1, (101-114), (2023).https://doi.org/10.1007/s40200-023-01328-9
    Crossref
  9. Development of the Reporting Essentials for DElirium bioMarker Studies (REDEEMS) guideline, Delirium, (2022).https://doi.org/10.56392/001c.36531
    Crossref
  10. Hello Authors! We Are the Technical Reviewers and Are Here to Help You!, Stroke, 53, 2, (307-310), (2022).https://doi.org/10.1161/STROKEAHA.121.035647
    Crossref
  11. See more
Loading...

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Personal login Institutional Login
Purchase Options

The neurology.org payment platform is currently offline. Our technical team is working as quickly as possible to restore service.

If you need immediate support or to place an order, please call or email customer service:

  • 1-800-638-3030 for U.S. customers - 8:30 - 7 pm ET (M-F)
  • 1-301-223-2300 for customers outside the U.S. - 8:30 - 7 pm ET (M-F)
  • [email protected]

We appreciate your patience during this time and apologize for any inconvenience.

View options

PDF and All Supplements

Download PDF and Supplementary Material

Full Text

View Full Text

Full Text HTML

View Full Text HTML

Figures

Tables

Media

Share

Share

Share article link

Share