Abstract
Text datasets come in an abundance of shapes, sizes and styles. However, determining what factors limit classification accuracy remains a difficult task which is still the subject of intensive research. Using a challenging UK National Health Service (NHS) dataset, which contains many characteristics known to increase the complexity of classification, we propose an innovative classification pipeline. This pipeline switches between different text pre-processing, scoring and classification techniques during execution. Using this flexible pipeline, a high level of accuracy has been achieved in the classification of a range of datasets, attaining a micro-averaged F1 score of 93.30% on the Reuters-21578 “ApteMod” corpus. An evaluation of this flexible pipeline was carried out using a variety of complex datasets compared against an unsupervised clustering approach. The paper describes how classification accuracy is impacted by an unbalanced category distribution, the rare use of generic terms and the subjective nature of manual human classification.
DOI
10.3390/math10060983
Publication Date
2022-03-18
Publication Title
Mathematics
Volume
10
Issue
6
Publisher
MDPI AG
ISSN
2227-7390
Embargo Period
2024-11-22
Recommended Citation
Haynes, C., Palomino, M., Stuart, L., Viira, D., & et al. (2022) 'Automatic Classification of National Health Service Feedback', Mathematics, 10(6). MDPI AG: Available at: https://doi.org/10.3390/math10060983
