Observer variation in the classification of information from medical records

https://doi.org/10.1016/0021-9681(79)90088-2Get rights and content

Abstract

The medical records of patients are among the most detailed existing accounts of clinical experience and should provide a unique source of data for research on the clinical course of disease. To assess the suitability of the record as a source of data for such studies we have examined the reproducibility and validity of the information recorded in the patients clinical history. Reproducibility was assessed by a study of observer variation, in which four physicians independently read the same 110 records of patients with Hodgkin's disease. Two physicians used explicit criteria to identify the clinical events of first symptom, duration of symptoms, and systemic symptoms and the remaining two observers worked without criteria. Levels of agreement between the observers who used criteria to identify these events were high, and the associated Kappa scores varied from 0.75 to 0.93, whereas the Kappa scores for the observers who did not use criteria varied from 0.29 to 0.59. When the data recorded in the clinical history was used to classify patients according to previously described prognostically distinctive groups, similar prognostic gradients were created in two patient populations, suggesting that the recorded data corresponded to true biologic differences and indicating its validity.

References (10)

  • AR Feinstein

    Clinical Judgment

    (1967)
  • AR Feinstein et al.

    The epidemiology of cancer therapy III. The management of imperfect data

    Arch Intern Med

    (1969)
  • NF Boyd et al.

    Symptoms as an index of growth rates and prognosis in Hodgkin's disease

    Clin Invest Med

    (1978)
  • J Cohen

    A coefficient of agreement for nominal scales

    Educ Psychol Meas

    (1960)
  • R Peto et al.

    Design and analysis of randomised clinical trials requiring prolonged observation of each patient. II Analysis and examples

    Brit J Can

    (1977)
There are more references available in the full text version of this article.

Cited by (46)

  • Descriptive and Drug Utilization Studies

    2019, Encyclopedia of Pharmacy Practice and Clinical Pharmacy: Volumes 1-3
  • Descriptive and drug utilization studies

    2019, Encyclopedia of Pharmacy Practice and Clinical Pharmacy
View all citing articles on Scopus

Presented in part at the Annual Meeting of the Royal College of Physicians and Surgeons of Canada, Section of Health Care Delivery and Evaluation, Vancouver, Canada, January, 1978.

§

Present address: NCIC-Epidemiology Unit, Faculty of Medicine, McMurrich Building, University of Toronto, Toronto, Ontario M5S 1A8, Canada.

View full text