ORCID

Document Type

Article

Abstract

Introduction: Early detection of drug-resistant tuberculosis (DR-TB) is criticalfor timely treatment and limiting transmission. Differentiating DR-TB fromdrug-sensitive TB (DS-TB) remains challenging due to overlappingmanifestations and subtle differences in chest X-rays (CXRs).Methods: We developed an explainable multimodal machine learningframework integrating CXR embeddings from a Data-Efficient ImageTransformer (DEiT) with patient-level data, including clinical, interpretedradiological, demographic, socioeconomic, and behavioral variables. Using6,279 subjects from the TB Portals program, model performance wasevaluated across three settings comprising CXR embeddings only, patientlevel features only, and multimodal. Interpretability was analyzed usingShapley Additive Explanations (SHAP).Results: A multimodal XGBoost model achieved a precision-recall area underthe curve (PR-AUC) of 0.9258 and receiver operating characteristic area underthe curve (ROC-AUC) of 0.8718. CXR-embeddings-only classifiers performedlower (PR-AUC: 0.8334; ROC-AUC: 0.7369), while patient-level XGBoostyielded highest performance. The multimodal model improved interpretabilitythrough complementary structural information. SHAP identified CXRembeddings as primary global drivers. Among patient-level variables, dailycontacts and employment status were the strongest contributors, reflectingexposure intensity and socioeconomic conditions. Comorbidity showedmoderate effects, while education and case definition had smallercontributions. Key radiological factors included non-tuberculosisabnormalities and mediastinal lymph node involvement, whereas mediumdensity stabalized fibrotic nodules, medium nodules, and small cavitiesdemonstrated minimal association. Interaction analysis revealed higher riskwith increasing comorbidity in the presence of morphological alterations; BMIand age exhibited modest influence. Independent review by two cliniciansconfirmed plausibility and consistency of SHAP explanations.Discussion: This interpretable multimodal framework supports early DR-TBdetection and targeted interventions in high-burden settings.

Publication Date

2026-07-30

Publication Title

Frontiers in Digital Health

Volume

8

Acceptance Date

2026-06-22

Deposit Date

2026-10-09

Funding

The author(s) declared that financial support was received for this work and/or its publication. This research was funded by the Commonwealth Scholarship Commission (CSC), United Kingdom, under the Foreign, Commonwealth and Development Office (FCDO) scholarship programme (Scholarship No. TZCS2023-543), in collaboration with the University of Plymouth, United Kingdom. It also received support from the Government of Tanzania through the Ministry of Education, Science and Technology.

Keywords

chest x-ray, data-efficient image transformer (DEiT), drug-resistant tuberculosis, interpretability, shapley additive explanations (SHAP)

Creative Commons License

Creative Commons Attribution 4.0 International License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Share

COinS