Shah AD, Bailey E, Williams T, Denaxas S, Dobson R, Hemingway H.
Journal of Biomedical Semantics (2019) 10: 20
Free text in electronic health records (EHR) may contain additional phenotypic information beyond structured (coded) information. For major health events – heart attack and death – there is a lack of studies evaluating the extent to which free text in the primary care record might add information. Our objectives were to describe the contribution of free text in primary care to the recording of information about myocardial infarction (MI), including subtype, left ventricular function, laboratory results and symptoms; and recording of cause of death. We used the CALIBER EHR research platform which contains primary care data from the Clinical Practice Research Datalink (CPRD) linked to hospital admission data, the MINAP registry of acute coronary syndromes and the death registry. In CALIBER we randomly selected 2000 patients with MI and 1800 deaths. We implemented a rule-based natural language engine, the Freetext Matching Algorithm, on site at CPRD to analyse free text in the primary care record without raw data being released to researchers. We analysed text recorded within 90 days before or 90 days after the MI, and on or after the date of death.
We extracted 10,927 diagnoses, 3658 test results, 3313 statements of negation, and 850 suspected diagnoses from the myocardial infarction patients. Inclusion of free text increased the recorded proportion of patients with chest pain in the week prior to MI from 19 to 27%, and differentiated between MI subtypes in a quarter more patients than structured data alone. Cause of death was incompletely recorded in primary care; in 36% the cause was in coded data and in 21% it was in free text. Only 47% of patients had exactly the same cause of death in primary care and the death registry, but this did not differ between coded and free text causes of death.
Among patients who suffer MI or die, unstructured free text in primary care records contains much information that is potentially useful for research such as symptoms, investigation results and specific diagnoses. Access to large scale unstructured data in electronic health records (millions of patients) might yield important insights.
Professor of Biostats and Health Informatics, King's College London and Institute of Health Informatics at University College London (UCL)
Richard Dobson is Professor of Biomedical and Health Informatics at the Institute of Health Informatics, UCL, as well as Professor of Medical Informatics at King’s College London and lead for...
Director at the Research Institute of Health Informatics & Director at HDR UK London
Professor Harry Hemingway is Professor of Clinical Epidemiology at UCL. After studying for his medical degree at Cambridge University, Harry went on to become a Fellow of the Royal College of...
CogStack information retrieval and extraction platform gives access to underused data
27 February 2023
CogStack represents a major advance in the capacity to extract and analyse unstructured data from electronic health records (EHRs). It uses a range of technologies to support modern open-source...