Show simple item record

dc.contributor.authorAbdelmotaleb, H
dc.contributor.authorWojtys, Malgorzata
dc.contributor.authorMedeiros Carvalho, Murillo

Statistical topic modelling has become one of the most important tools in the text processing field, as more applications are using it to handle the increasing amount of available text data, e.g. from social media platforms. The aim of topic modelling is to discover the main themes or topics from a collection of text documents. While several models have been developed, there is no consensus on evaluating the models, and how to determine the best hyper-parameters of the model. In this research, we develop a method for evaluating topic models for short text that employs word embedding and measuring within-topic variability and separation between topics. We focus on the Dirichlet Mixture Model and tuning its hyper-parameters. In empirical experiments, we present a case study on short text datasets related to the British telecommunication industry. In particular, we find that the optimal values of hyper-parameters, obtained from our evaluation method, do not agree with the fixed values typically used in the literature.

dc.titleGSDMM model evaluation techniques with application to British telecom data
plymouth.conference-name5th International Conference on Statistics: Theory and Applications (ICSTA'23)
plymouth.journalProceedings of the 5th International Conference on Statistics: Theory and Applications (ICSTA'23)
plymouth.organisational-group|Plymouth|Faculty of Science and Engineering
plymouth.organisational-group|Plymouth|Faculty of Science and Engineering|School of Engineering, Computing and Mathematics
plymouth.organisational-group|Plymouth|REF 2021 Researchers by UoA
plymouth.organisational-group|Plymouth|Users by role
plymouth.organisational-group|Plymouth|Users by role|Academics
plymouth.organisational-group|Plymouth|REF 2021 Researchers by UoA|UoA10 Mathematical Sciences
plymouth.organisational-group|Plymouth|REF 2021 Researchers by UoA|ZZZ Extended UoA 10 - Mathematical Sciences

Files in this item


This item appears in the following Collection(s)

Show simple item record

All items in PEARL are protected by copyright law.
Author manuscripts deposited to comply with open access mandates are made available in accordance with publisher policies. Please cite only the published version using the details provided on the item record or document. In the absence of an open licence (e.g. Creative Commons), permissions for further reuse of content should be sought from the publisher or author.
Theme by 
Atmire NV