Electronic Health Record (EHR) Abstraction

The purpose of electronic health record (EHR) abstraction includes collection of data related to administrative coding functions, quality improvement, clinical registry functions and clinical research. This article examines the different abstraction methods, such as manual abstraction, simple query, and natural language processing (NLP). It also discusses the advantages and disadvantages of each of those methods. The process used for successful EHR abstraction is also discussed and includes the scope and resources needed (time, budget, type of healthcare professionals RHIA, RHIT, etc.). The relationship between EHRs and the clinical registry is also examined with a focus on validity of the data extracted. Future research in this area to examine abstraction methods across hospitals who do data abstraction are being finalized for a future publication.

Keywords: Electronic health record, EHR, abstraction, natural language processing, NLP, query, quality improvement, patient safety

Introduction

The widespread adoption of electronic health record (EHR) systems makes it possible to retrieve patient records digitally and to extract useful clinical data. Therefore, several secondary applications have become accessible such as quality management, health management and translational research. 1 All of these secondary applications aim to improve patient care. 2 , 3 The overall quality of healthcare and patient treatment depends heavily on the quality of data. Therefore, having inaccurate, incomplete, and inconsistent data and documentation can result in errors and adverse events 4 that may affect patient safety 5 , limit health information exchange (HIE), and hinder clinical research. 6

In the remainder of this article, we discuss the methods of data abstraction. Advantage and disadvantages of data abstraction, the key factors for successful abstraction within EHRs and registries will also be discussed. We also discuss the importance of having a health information management professional at the forefront of clinical data abstraction methods.

Background

The Centers for Medicare & Medicaid Services (CMS) developed the Meaningful Use program, now called Promoting Interoperability, to help healthcare professionals and hospitals improve quality, efficiency, and safety of patient health through the use of certified EHRs. 7 , 8 Thus, it is increasingly important to get meaningful and efficient methods for data collection, sharing and reporting. Furthermore, it is important to have efficient methods for abstracting the needed clinical data from EHR systems and other clinical documents. Three methods that can be used for data abstraction include, manual abstraction, search engines, and abstraction using natural language processing (NLP). Several measures can be used to evaluate the quality of each one of these methods, including, completeness, correctness, concordance, currency, and plausibility. 9

Abstraction Methods

Manual Record Abstraction.

Manual abstraction is the process of collecting important information from a medical record and transcribing it into discrete fields within the new EHR. Structured data parts (coded data) in the EHR such as, medications, diagnoses, and an active medication allergy list, helps to abstract the needed information from EHR systems. 10 Manual abstraction can be performed by health information management professionals, nurses, physicians, or other individuals who have training in data abstraction. The review of the entire medical record allows one to collect more specific clinical details, especially for the information that is not readily coded using the existing coding systems. 11

Manual abstraction helps to integrate discrete patient data into the EHR and make them readily available for healthcare providers. It also allows for triggering some decision support alerts that are related to information integrated into the EHR. 12

Although the manual abstraction method is convenient and easy to understand, it has several limitations:

Some outcome measures, such as those related to cancer recurrence, are usually documented in unstructured notes and reports. Thus, it will be hard to extract all the required information since there are limited structured parts. 13 , 14

Manual abstraction may increase errors. For compliance with CMS regulations, clinical data abstractors need to review patient records to identify the ones that meet the guidelines. 16 Reviewing this large volume of data increases the risk of making errors. The situation will be worse when dealing with narrative information that lacks standardization. Therefore, data abstractors may get unreliable results.

Search Engines (Simple query). Several studies have shown that physicians prefer to enter their comments in some unstructured free-text entries even if there are options for structured coding elements in the system. 17 , 18 Additionally, unstructured free text entries are always required for some complex tasks such as, clinical trial recruitment. 19 Extracting some useful clinical data from such unstructured free-text entries is a complex task that face several challenges 20 including; the physician tendency to use some acronyms, abbreviations 21 , negation 22 , 23 , and hedge phrases. 24 Lack of standard grammar and punctuation may lead to ambiguity and misunderstanding. 21 The difficulty in automatically processing some context-sensitive meanings 25 and temporal relationships 26 is another challenge. There is a significant need for searching full text medical records. 27 Having some simple SQL queries 28 and search engine tools can help in conducting this full-text search. In order to solve the problem with abstraction and obtain useful information from the unstructured clinical notes, researchers at the University of Michigan have developed the Electronic Medical Record Search Engine (EMERSE). 1 This is a full-text search engine that is mainly designed to extract useful information from the narrative clinical notes in the EHR systems. CISearch is another tool for searching free-text reports within EHR systems. 29

Abstraction Using NLP

NLP can be defined as computation algorithms for analyzing machine readable unstructured text. 15 NLP can conclude the meaning behind the words. Automated data abstraction using NLP has the potential to convert the unstructured text-free notes into structured and codified format. 14 Thus, NLP is an efficient alternative for manual abstraction. 30 NLP-based systems can reduce the time and efforts of manual abstraction in large-scale population-based studies.

NLP has the potential to extract all the needed information and perform some complex multivariable queries. 31 It tags every word and puts it into a discrete format that can be used for reporting. Additionally, NLP can recognize related words and phrases. For example, high blood pressure and hypertensive can be considered as fitting in the overall description of the term hypertension. Experts agree that meaningful use/promoting interoperability may be the largest driving factor behind NLP adoption. 31 This is due to the ability of the NLP system to search through a large volume of documents and extract information that are related to meaningful use data elements, such as, a problem list, procedures, medications, allergies, vital signs, social history, and quality measure information.

NLP has been successfully used to abstract useful information in several applications including; emergency medicine physician visit notes 32 , pathology reports 33 , 34 , identifying individuals based on cancer screening 35 , abstracting findings from imaging 36 , conducting pharmacogenomics research 37 , extracting cancer stage information from narrative EHR data 38 , and identification of breast and prostate malignancies described in pathology reports. 39

Advantages and Disadvantages of Abstraction

Advantages of the abstraction process include: 40

Speed up the go-live process for physicians since the abstraction can help to provide easy and rapid access to patient data.

Save electronic storage space since abstracting only the needed information requires less storage space than whole clinical documents.

Abstraction is a source of supplemental information that supports claims information, which in turn provides more specific evidence for clinical care. 41 For example, for some measures, claims information is incomplete. So, information from the abstraction process can be used to supplement evidence of the service provided, to verify the population that is being measured.

Abstraction supports key processes such as coding and reimbursement, quality improvement, billing audits, and clinical research. 42

Also, abstraction can have some disadvantages since it may take extra time and resources in order to enter all the patient information into the EHR. Table ​ Table1 1 . provides a summary of the advantages and disadvantages for each type of clinical data abstraction method.

Table 1

Summary of the advantages and disadvantages of the clinical data abstraction methods

Discussion

Successful Abstraction Process:

One example of successful data abstraction was provided by Care Communications, Inc. which was a leader in providing data abstraction services and is now a part of Ciox Health. Based on their experience in data abstraction it is important to satisfy some key factors including 43 : Increasing the medical records procurement rate, enhancing data integrity using an inter-rater approach and working with specialists in the field of health information management who are familiar with HIPAA, ongoing status reporting, and personalized project management.

Several decisions should be taken in order to guarantee a successful abstraction process, such as 12 :

Determine the scope of the abstraction, which means deciding what data should be abstracted and when and whether there are some special abstraction needs for sub-specialists.

Scope of Abstraction: Examples of abstracted data include: 12 , 44 demographics, scheduled appointments, active orders, allergies, medications, immunizations, chronic conditions, problem lists, hospital discharge summaries, special studies (echocardiograms, pulmonary function tests, etc.), and patient history (medical, surgical, social and family). The chart abstraction process may also include the identification of key paper clinical documents that need to be included in the new EHR by scanning those records into the electronic chart prior to bringing the new EHR live.

Six important categories should be recorded when doing abstraction including: 45

Impact on clinical outcomes (length of stay, morbidity, mortality, validated measure of health-related quality of life (HRQOL) or functional status, adverse events).

Impact on health care process outcomes (preventative care ordered/completed, clinical study ordered/completed, treatment ordered/prescribed, impact on user knowledge).

Impact on workload, efficiency, and organization of health care delivery (number of patients seen/unit time, clinician workload, efficiency).

Impact on health care providers (HCP) use and implementation (HCP acceptance and satisfaction, implementation of clinical decision support system (CDSS).

In general, coders abstract Present on Admission (POA), Hospital-Acquired conditions (HAC), some patient safety indicators (PSI) and the Core Measures. 46 Additionally, many facilities require their coders to check the charges for services or enter charges altogether based on the type of record they code. Based on a survey done by Himagine solutions (https://www.himaginesolutions.com'>www.himaginesolutions.com) on their field coders 47 , the coders reported that there are many more elements that are currently being abstracted in an effort to capture data, streamline the process, and assure the accuracy of input.

Time of Abstraction.

The time required to complete the abstraction depends on the clinical practice 48 (NextGen Healthcare 49 ). Generally, patients see their physician three to five times per year. Thus, the abstraction volume will decrease in the first two months. However, the abstraction volume will keep increasing when having new patients, and thus the time will also increase.

Budget. Generally, the data abstraction process is labor intensive and requires solid data validation and quality control mechanisms. 50 The budget for abstraction and the needed information varies depending on the scope, size, and the needs of the clinical practice. 12 Thus, the budget can range from very little to very high.

Who Will Do the Abstraction?

Based on the NextGen Healthcare experience, the abstraction process needs to be delegated to either; nurses or medical abstractors which can include health information management professionals. Some of the NextGen Healthcare clients have used their current health information staff to do the abstraction. One benefit of using the current HIM staff as data abstractors is to reduce the time required to do abstraction since they will be familiar with the practice and the EHR. NextGen Healthcare clients have suggested that there might be a need to hire some temporary abstractors for the first two to three months. Through time, the amount of information that needs to be abstracted will decrease. Additionally, HIM staff, physicians, nurses will become more proficient with the abstraction process, and thus, they will be able to keep up with the abstraction.

Using credentialed HIM professionals (RHIAs and RHITs) and Registered Nurses (RNs) to do the data abstraction will be better than assigning the abstraction task to clinical coders. 51 The reason for this claim is that health information management professionals (RHIAs and RHITs) and RNs are consistently focused on clinical data integrity in their day-to-day tasks. Thus, they will be able to provide the most valuable details about the continuity of patient care. Furthermore, RHIAs, RHITs, and RNs can understand patient data in a broader way and they will be able to extract the critical details since they understand all the different clinical components that shape the picture of the individual's whole health. 51

Organizations can use their health information management professionals, internal nurses, and physicians to do the abstraction, or they can outsource the abstraction to other organizations that have some clinical experts who can do the abstraction. 51 Although it seems that doing the abstraction internally can be feasible and cost effective it may reduce the productivity of the internal staff.

The ideal clinical abstraction team can include: 52

Research manager who can monitor the quality of the abstracted data. He/she needs to have a high clinical and technical expertise.

Lead abstractor who can monitor the daily details of the abstraction process and supervise the abstractors.

Abstractors who will conduct the actual abstraction and they should have experience in clinical data abstraction and familiarity with the EHR.

Ideally, data abstractors need to have the following qualifications: 53

It is important to identify the required resources, budget, and time constraints ahead and before the real abstraction process. Some studies are resource intensive that need high-level planning for all the steps of the abstraction process. For example, the abstraction of charts in the study of screening lung cancer that was performed by Care Communications is very complex and challenging 54 and requires high level project management and clinical experience. This study requires screening thousands of medical records within more than twenty hospitals in the nation.

EHRs and Registries

A registry can be defined as an organized system that uses observational study methods to collect uniform clinical data to evaluate specified outcomes for a population defined by a particular disease, condition, or exposure, and that serves one or more predetermined scientific, clinical, or policy purposes. Registries are focused on populations and are designed to fulfill specific purposes defined before the data are collected and analyzed. 55 On the other hand, EHRs are focused on the collection and use of individual patient health-related information. Although, it seems that both registries and EHRs overlap in functionality, their roles are different. According to the Institute of Medicine (IOM), (which is now called the National Academy of Medicine), an EHR has four core functionalities: health information and data, results management, order entry and support, and decision support. 56 There are several obstacles to achieve the meaningful communication between systems such as, EHRs and registries. These obstacles are related to confidentiality, security, privacy and data access. 55

Currently, there is an increasing demand for physicians to participate in the registries in order to manage safety, evaluate effectiveness, and measure and improve the quality of patient care. Therefore, it is becoming increasingly important that EHRs should serve as an interface for several registries with different purposes at the same time. EHRs can enable health care information to be available and accessible to registries. Additionally, EHRs can provide some relevant information from the registry to the physicians such as, information about natural history of disease, safety 57 , effectiveness, and quality. 58 Figure ​ Figure1 1 demonstrates the relationship between the EHR and the registry.

Relationship between EHR and Registries

Navaneethan et al. 59 have described the development of a registry for patients with chronic kidney disease (CKD) that is derived from EHR data. The benefits of this kind of patient registry can range from allowing better aggregation of patient data for practice assessment or quality improvement, to facilitating clinical research. The study shows that the quality of data in this registry is comparable to that of the data from a much more labor-intensive and expensive process of human abstraction. This registry can be used for quality improvement, clinical research, and other important tasks.

Conclusion

Abstraction Validity.

Medical record abstraction is a primary mode of data collection in secondary data use. Abstraction is associated with high error rates. 60 It is important to validate the abstracted data and ensure that the data are abstracted correctly and consistently. There are several benefits of the validation process 41 including:

Enhance the clarity of specification through the identification of specification ambiguities that are related to the abstraction process.

Provide some information for future internal quality improvement. Strategies for improving the validity of data abstracted from medical records include 61 training abstractors, masking abstractors to study hypotheses, assessing interrater reliability and agreement, and the re-abstraction of records. 62

There are three components of validation 41 including:

Validating the abstraction process and this can be done during the data collection by taking a convenience sample of records and ensure that all measures are abstracted consistently by different vendors to uncover any specific ambiguities.

Validating at the end of data collection in order to ensure the integrity and accuracy of the abstracted data.

Future Research

We have conducted a study to examine abstraction methods across hospitals using interviews of managers of abstraction within their healthcare organizations as well as a survey of clients of a large consulting company (Ciox Health) who do data abstraction. Those results are being finalized and will be provided in Part II of a future publication.

Acknowledgements:

This research study was supported by a unique research entity between CIOX Health and the University of Pittsburgh, Department of Health Information Management, School of Health and Rehabilitation Sciences.

AUTHOR BIOGRAPHIES

Amal A. Alzu'bi, PhD, (aazoubi9@just.edu.jo) is Assistant Professor- Department of Computer Information Systems, Jordan University of Science and Technology in Irbid, Jordan.

Valerie J. M. Watzlaf, MPH, PhD, RHIA, FAHIMA, (valgeo@pitt.edu) is Associate Professor and Vice Chair of Education, Department of Health Information Management, University of Pittsburgh, School of Health and Rehabilitation Sciences,.

Patty Sheridan, MBA, RHIA, FAHIMA, (pattytsheridan@gmail.com)) is President, Sheridan Leadership Consulting (formerly Senior Vice President, HIM Services, at Ciox Health).

References

1. University of Michigan's nine-year experience in developing and using the Electronic Medical Record Search Engine (EMERSE). J Biomed Inform. 2015; 55 :p. 290–300. [PMC free article] [PubMed] [Google Scholar]

2. Friedman C., Rigby M. Conceptualising and creating a global learning health system. Int J Med Inform. 2013; 82 ((4)):p. e63–71. [PubMed] [Google Scholar]

3. Friedman C.P., Wong A.K., Blumenthal D. Achieving a nationwide learning health system. Sci Transl Med. 2010; 2 ((57)):p. 57cm29. [PubMed] [Google Scholar]

4. Maurette P., Comite S. analyse et maitrise du risque dela. Ann Fr Anesth Reanim. 2002; 21 ((6)):p. 453–4. [PubMed] [Google Scholar]

5. Abramson E.L., et al. Transitioning between electronic health records: effects on ambulatory prescribing safety. J Gen Intern Med. 2011; 26 ((8)):p. 868–74. [PMC free article] [PubMed] [Google Scholar]

6. Clark J.S., et al. Assessing and improving EHR data quality (updated). J AHIMA. 2013; 84 ((3)):p. 48–53. [PubMed] [Google Scholar]

7. Office of the National Coordinator for Health Information Technology, D.o.H. Human S. Health information technology: initial set of standards, implementation specifications, and certification criteria for electronic health record technology. Final rule. Fed Regist. 2010; 75 ((144)):p. 44589–654. [PubMed] [Google Scholar]

8. Blumenthal D., Tavenner M. The “meaningful use” regulation for electronic health records. N Engl J Med. 2010; 363 ((6)):p. 501–4. [PubMed] [Google Scholar]

9. Weiskopf N.G., Weng C. Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc. 2013; 20 ((1)):p. 144–51. [PMC free article] [PubMed] [Google Scholar]

10. Floyd J.S., et al. Use of administrative data to estimate the incidence of statin-related rhabdomyolysis. JAMA. 2012; 307 ((15)):p. 1580–2. [PMC free article] [PubMed] [Google Scholar]

11. Leon-Chisen N. Coding and quality reporting: resolving the discrepancies, finding opportunities. J AHIMA. 2007; 78 ((7)):p. 26–30. quiz 33-4. [PubMed] [Google Scholar]

13. Meystre S.M., et al. Extracting information from textual documents in the electronic health record: a review of recent research. Yearb Med Inform; 2008. pp. p. 128–44. [PubMed] [Google Scholar]

14. Jha A.K. The promise of electronic records: around the corner or down the road? JAMA. 2011; 306 ((8)):p. 880–1. [PubMed] [Google Scholar]

15. Carrell D.S., et al. Using natural language processing to improve efficiency of manual chart abstraction in research: the case of breast cancer recurrence. Am J Epidemiol. 2014; 179 ((6)):p. 749–58. [PMC free article] [PubMed] [Google Scholar]

16. Angi P. The Challenges of Capturing Meaningful Use Data For The Record. 2013; 25 ((15)):p. 30. [Google Scholar]

17. Zheng K., et al. Handling anticipated exceptions in clinical care: investigating clinician use of ‘exit strategies’ in an electronic health records system. J Am Med Inform Assoc. 2011; 18 ((6)):p. 883–9. [PMC free article] [PubMed] [Google Scholar]

18. Zhou L., et al. How many medication orders are entered through free-text in EHRs?–a study on hypoglycemic agents. AMIA Annu Symp Proc. 2012; 2012 :p. 1079–88. [PMC free article] [PubMed] [Google Scholar]

19. Raghavan P., et al. How essential are unstructured clinical narratives and information fusion to clinical trial recruitment? AMIA Jt Summits Transl Sci Proc. 2014; 2014 :p. 218–23. [PMC free article] [PubMed] [Google Scholar]

20. Edinger T., et al. Barriers to retrieving patient information from electronic health record data: failure analysis from the TREC Medical Records Track. AMIA Annu Symp Proc, 2012. 2012:p. 180–8. [PMC free article] [PubMed] [Google Scholar]

21. Barrows R.C., Jr, Busuioc M., Friedman C. Limited parsing of notational text visit notes: ad-hoc vs. NLP approaches. Proc AMIA Symp. 2000:p. 51–5. [PMC free article] [PubMed] [Google Scholar]

22. Agarwal S., Yu H. Biomedical negation scope detection with conditional random fields. J Am Med Inform Assoc. 2010; 17 ((6)):p. 696–701. [PMC free article] [PubMed] [Google Scholar]

23. Mitchell K.J., et al. Implementation and evaluation of a negation tagger in a pipeline-based system for information extract from pathology reports. Stud Health Technol Inform. 2004; 107 ((Pt 1)):p. 663–7. [PubMed] [Google Scholar]

24. Hanauer D.A., et al. Hedging their mets: the use of uncertainty terms in clinical documents and its potential implications when sharing the documents with patients. AMIA Annu. Symp. Proc. 2012; 2012 ((2012)):p. 321–330. [PMC free article] [PubMed] [Google Scholar]

25. Jagannathan V., et al. Assessment of commercial NLP engines for medication information extraction from dictated clinical notes. Int J Med Inform. 2009; 78 ((4)):p. 284–91. [PubMed] [Google Scholar]

26. Tang B., et al. A hybrid system for temporal information extraction from clinical text. J Am Med Inform Assoc. 2013; 20 ((5)):p. 828–35. [PMC free article] [PubMed] [Google Scholar]

27. Yang L., et al. Query log analysis of an electronic health record search engine. AMIA Annu Symp Proc, 2011. 2011:p. 915–24. [PMC free article] [PubMed] [Google Scholar]

28. Botsis T., et al. Secondary Use of EHR: Data Quality Issues and Informatics Opportunities. AMIA Jt Summits Transl Sci Proc, 2010. 2010:p. 1–5. [PMC free article] [PubMed] [Google Scholar]

29. Natarajan K., et al. An analysis of clinical queries in an electronic health record search utility. Int J Med Inform. 2010; 79 ((7)):p. 515–22. [PMC free article] [PubMed] [Google Scholar]

30. Nadkarni P.M., Ohno-Machado L., Chapman W.W. Natural language processing: an introduction. J Am Med Inform Assoc. 2011; 18 ((5)):p. 544–51. [PMC free article] [PubMed] [Google Scholar]

32. Kimia A.A., et al. An Introduction to Natural Language Processing: How You Can Get More From Those Electronic Notes You Are Generating. Pediatr Emerg Care. 2015; 31 ((7)):p. 536–41. [PubMed] [Google Scholar]

33. Crowley R.S., et al. caTIES: a grid based system for coding and retrieval of surgical pathology reports and tissue specimens in support of translational research. J Am Med Inform Assoc. 2010; 17 ((3)):p. 253–64. [PMC free article] [PubMed] [Google Scholar]

34. Coden A., et al. Automatically extracting cancer disease characteristics from pathology reports into a Disease Knowledge Representation Model. J Biomed Inform. 2009; 42 ((5)):p. 937–49. [PubMed] [Google Scholar]

35. Denny J.C., et al. Natural language processing improves identification of colorectal cancer testing in the electronic medical record. Med Decis Making. 2012; 32 ((1)):p. 188–97. [PMC free article] [PubMed] [Google Scholar]

36. Hripcsak G., et al. Use of natural language processing to translate clinical information from a database of 889,921 chest radiographic reports. Radiology. 2002; 224 ((1)):p. 157–63. [PubMed] [Google Scholar]

37. Wilke R.A., et al. The emerging role of electronic medical records in pharmacogenomics. Clin Pharmacol Ther. 2011; 89 ((3)):p. 379–86. [PMC free article] [PubMed] [Google Scholar]

38. Warner J.L., Levy M.A., Neuss M.N. Feasibility and Accuracy of Extracting Cancer Stage Information From Narrative Electronic Health Record Data. J Oncol Pract. 2015 [PubMed] [Google Scholar]

39. Strauss J.A., et al. Identifying primary and recurrent cancers using a SAS-based natural language processing algorithm. J Am Med Inform Assoc. 2013; 20 ((2)):p. 349–55. [PMC free article] [PubMed] [Google Scholar]

40. Hundt A. Legacy Data Management: Strategic Considerations for Successful Clinical Data Abstraction.

41. Stieg J. Medical Record Review, D.o. Health, Editor. New York County Health Services Review Organization (NYCHSRO) New York.: 2015. [Google Scholar]

44. Gettinger A., Csatari A. Transitioning from a legacy EHR to a commercial, vendor-supplied, EHR: one academic health system's experience. Appl Clin Inform. 2012; 3 ((4)):p. 367–76. [PMC free article] [PubMed] [Google Scholar]

45. Lobach D., Sanders G., Bright T. Evidence Report/Technology Assessments. Vol. 203. Rockville (MD): Agency for Healthcare Research and Quality (US).; 2012. Enabling Health Care Decisionmaking Through Clinical Decision Support and Knowledge Management. [PMC free article] [PubMed] [Google Scholar]

46. Bowling C. Coding Productivity: How Are You Measuring Success? himagine solutions; 2015. [Google Scholar]

48. Noss R., Hoyles C., Pozzi S. Abstraction in Expertise: A Study of Nurses’ Conceptions of Concentration. Journal for Research in Mathematics Education. 2002; 33 ((3)) [Google Scholar]

50. Dinh A., et al. Migrating from paper to EHRs in physician practices. J AHIMA. 2010; 81 ((11)):p. 60–4. [PubMed] [Google Scholar]

51. Abatjoglou G. Uncovering the Unexplored Role and Benefits of Clinical Data Abstraction HIS talk. 2013.

52. Medical Record Abstraction for Real World Data … Simplified Keeping your sanity when integrating medical record data into large scale research projects. 2014. Available from: http://www.slideshare.net/CareCommunications/medical-recordabstractionforrealworlddata.

53. Gregory C., Radovinsky L. Research strategies that result in optimal data collection from the patient medical record. Appl Nurs Res. 2012; 25 ((2)) [PMC free article] [PubMed] [Google Scholar]

55. Gliklich R.E., Dreyer N.A., Leavy M.B. in Registries for Evaluating Patient Outcomes: A User's Guide. Rockville (MD).: 2014. [PubMed] [Google Scholar]

56. Medicine, I.o., in Key Capabilities of an Electronic Health Record System: Letter Report. Washington (DC): 2003. [PubMed] [Google Scholar]

57. Hersh W. Electronic health records facilitate development of disease registries and more. Clin J Am Soc Nephrol. 2011; 6 ((1)):p. 5–6. [PubMed] [Google Scholar]

59. Navaneethan S.D., et al. Development and validation of an electronic health record-based chronic kidney disease registry. Clin J Am Soc Nephrol. 2011; 6 ((1)):p. 40–9. [PMC free article] [PubMed] [Google Scholar]

60. Nahm M. Data Accuracy in Medical Record Abstraction. UT SBMI Dissertations; 2010. [Google Scholar]

61. Reisch L.M., et al. Training, quality assurance, and assessment of medical record abstraction in a multisite study. Am J Epidemiol. 2003; 157 ((6)):p. 546–51. [PubMed] [Google Scholar]

62. Cook E.A., et al. Field methods in medical record abstraction: assessing the properties of comparative effectiveness estimates. BMC Health Serv Res. 2014; 14 :p. 391. [PMC free article] [PubMed] [Google Scholar]

Articles from Perspectives in Health Information Management are provided here courtesy of American Health Information Management Association