Accuracy of Data Collected by Surgical Residents

Shetty, Vivek; Murphy, Debra A.; Zigler, Cory; Resell, Judith; Yamashita, Dennis Duke

doi:10.1016/j.joms.2008.01.065

« Previous Next »Journal of Oral and Maxillofacial Surgery
Volume 66, Issue 7 , Pages 1335-1342, July 2008

Accuracy of Data Collected by Surgical Residents

Vivek Shetty, DDS, DrMedDent
- Professor, Section of Oral and Maxillofacial Surgery, University of California at Los Angeles, Los Angeles, CA.
- Address correspondence and reprint requests to Dr Shetty: Section of Oral and Maxillofacial Surgery, UCLA School of Dentistry, 10833 Le Conte Avenue, Los Angeles, CA 90095-1668
Debra A. Murphy, PhD
- Research Psychologist, Health Risk Reduction Projects, Integrated Substance Abuse Programs, Department of Psychiatry, University of California at Los Angeles, Los Angeles, CA.
Cory Zigler, MS
- Research Assistant, Section of Oral and Maxillofacial Surgery, University of California at Los Angeles, Los Angeles, CA.
Judith Resell, PhD
- Research Associate, Health Risk Reduction Projects, Integrated Substance Abuse Programs, Department of Psychiatry, University of California at Los Angeles, Los Angeles, CA.
Dennis Duke Yamashita, DDS
- Clinical Professor, Department of Oral and Maxillofacial Surgery, University of Southern California, Los Angeles, CA.

Purpose

Clinician records are the primary information source for assessing the quality of facial injury care, billing, risk management, planning of health services, and health-system management and reporting. Inaccuracies obscure outcomes assessment and affect the planning of health services. We sought to determine the accuracy of the clinician collected data by comparing them to similar information elicited by professional interviewers.

Materials and Methods

We abstracted admissions data from the medical records of 185 patients treated for orofacial injury between January 2005 and January 2007. Clinician data on sociodemographics and substance use were compared with similar information elicited by trained research staff as part of a prospective study.

Results

The accuracy of the clinician data sets varied considerably depending on the variable. Concordance with the interviewer data sets was highest for age (paired t test P = .09), gender (κ = 1), and ethnicity (κ = .84) but dropped off considerably for marital status (κ = .22) and alcohol (κ = .18) and drug use (κ = .16). The missing data per variable ranged from 4.5% (gender) to 46.9% (employment and education).

Conclusions

Although more research is needed to evaluate the cause of inaccuracies and the relative contributions of patient, provider, and system level effects, it seems that significant inaccuracies in administrative data are common. In particular, patient information collected by surgical residents under-reports substance use behaviors. Interventions aimed at identifying the sources and correcting these errors are necessary.