A natural language processing approach to categorise contributing factors from patient safety event reports. 

 -  2023 
<br/><br/> CONCLUSIONS: Information-rich sentence selection can be incorporated to extract the sentences in free-text event narratives in which the contributing factor information is embedded. Copyright © Author(s) (or their employer(s)) 2023. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.  METHODS: We used 10 years of self-reported PSE reports from a multihospital healthcare system in the USA. Reports were first selected by event date. We calculated chi2 values for each ngram in the bag-of-words then selected N ngrams with the highest chi2 values. Then, PSE reports were filtered to only include the sentences containing the selected ngrams. Such sentences were called information-rich sentences. We compared two feature extraction techniques from free-text data: (1) baseline bag-of-words features and (2) features from information-rich sentences. Three machine learning algorithms were used to categorise five contributing factors representing sociotechnical errors: communication/hand-off failure, technology issue, policy/procedure issue, distractions/interruptions and lapse/slip. We trained 15 binary classifiers (five contributing factors * three machine learning models). The models' performances were evaluated according to the area under the precision-recall curve (AUPRC), precision, recall, and F1-score.  OBJECTIVES: The objective of this study was to explore the use of natural language processing (NLP) algorithm to categorise contributing factors from patient safety event (PSE). Contributing factors are elements in the healthcare process (eg, communication failures) that instigate an event or allow an event to occur. Contributing factors can be used to further investigate why safety events occurred.  RESULTS: Applying the information-rich sentence selection algorithm boosted the contributing factor categorisation performance. Comparing the AUPRCs, the proposed NLP approach improved the categorisation performance of two and achieved comparable results with baseline in categorising three contributing factors. 
<br/><br/><br/>English 
<br/><br/><label>ISSN: </label>2632-1009 
<br/><br/><label>Standard No.: </label>10.1136/bmjhci-2022-100731 [doi] bmjhci-2022-100731 [pii] PMC10254979 [pmc] 
<br/><br/><label>Subjects--Topical Terms: </label><br/>*Natural Language Processing<br/>*Patient Safety<br/>Algorithms<br/>Humans<br/>Machine Learning--Automated
<br/><br/><label>Subjects--Geographic Terms: </label><br/>MedStar Health Research Institute<br/>MedStar Institute for Innovation
<br/><br/><label>Index Terms--Occupation: </label><br/>National Center for Human Factors in Healthcare
<br/><br/><label>Index Terms--Function: </label><br/>Journal Article