Extracting medication information from unstructured public health data: a demonstration on data..., 2020, Lin et al

Andy · Oct 20, 2020

Full title: Extracting medication information from unstructured public health data: a demonstration on data from population-based & tertiary-based samples

Background

Unstructured data from clinical epidemiological studies can be valuable and easy to obtain. However, it requires further extraction and processing for data analysis. Doing this manually is labor-intensive, slow and subject to error. In this study, we propose an automation framework for extracting and processing unstructured data.

Methods
The proposed automation framework consisted of two natural language processing (NLP) based tools for unstructured text data for medications and reasons for medication use. We first checked spelling using a spell-check program trained on publicly available knowledge sources and then applied NLP techniques. We mapped medication names into generic names using vocabulary from publicly available knowledge sources. We used WHO’s Anatomical Therapeutic Chemical (ATC) classification system to map generic medication names to medication classes. We processed the reasons for medication with the Lancaster stemmer method and then grouped and mapped to disease classes based on organ systems. Finally, we demonstrated this automation framework on two data sources for Mylagic Encephalomyelitis/ Chronic Fatigue Syndrome (ME/CFS): tertiary-based (n = 378) and population-based (n = 664) samples.

Results
A total of 8681 raw medication records were used for this demonstration. The 1266 distinct medication names (omitting supplements) were condensed to 89 ATC classification system categories. The 1432 distinct raw reasons for medication use were condensed to 65 categories via NLP. Compared to completion of the entire process manually, our automation process reduced the number of the terms requiring manual labor for mapping by 84.4% for medications and 59.4% for reasons for medication use. Additionally, this process improved the precision of the mapped results.

Conclusions
Our automation framework demonstrates the usefulness of NLP strategies even when there is no established mapping database. For a less established database (e.g., reasons for medication use), the method is easily modifiable as new knowledge sources for mapping are introduced. The capability to condense large features into interpretable ones will be valuable for subsequent analytical studies involving techniques such as machine learning and data mining.
Click to expand...

Open access, https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-020-01131-7

The population-based sample contained a total of 3823 raw records for medication information on 664 study subjects who were classified into CFS, insufficiently fatigued (ISF), and non-fatigued (NF). The subjects’ statuses were confirmed with a one-day clinic examination.
Click to expand...

is all the information we get as to selection criteria.

Log in or Sign up

Extracting medication information from unstructured public health data: a demonstration on data..., 2020, Lin et al

Andy Committee Member

Share This Page

Log in or Sign up

Extracting medication information from unstructured public health data: a demonstration on data..., 2020, Lin et al

Andy Committee Member

Share This Page

Useful Searches