Decoding Medical Diagnosis with Machine Learning Classifiers

Abstract

Clinical decision support systems (CDSS) are gaining popularity in disease screening and grading in the current era of digital healthcare. This paper attempts to model how a computer learns to grade an infectious disease (ID), e.g., typhoid fever using the machine learning (ML)-based approach mimicking how a novice doctor learns to diagnose a case with the help of senior doctors. To achieve the goal, ten virtual junior clinicians are developed using ten machine learning classifiers (MLC)-based CDSS, which are then trained with "weighted" [0,1] sign symptoms and the corresponding "labeled" grade of synthetic typhoid fever cases (N = 198). Weights and labels are assigned by ten senior clinicians providing their rich clinical knowledge base. The performance of each VJC is then measured in terms of their diagnostic accuracy, precision, recall, and F-score. Results show that random forest (RF, i.e., VJC9) and decision tree (DT, i.e., VJC4)-based CDSS can grade with an average of 87% accuracy, which is even higher than human clinicians' accuracy. The reason behind RF and DT's appreciable performance is that clinicians use tree-search-based methods with probabilistic "yes" and "no" logic to learn the disease patterns alike the working principles of DT and RF for diagnosing and grading any ID. Apart from modeling, the paper provides insight into how to select the right machine learning classifier (MLC) algorithm in the field of ID diagnosis. It also throws light on various hardships and challenges with MLC-based CDSS implementations in the real-world scenario.

Received: 5 February 2024 | Revised: 11 March 2024 | Accepted: 16 April 2024

Conflicts of Interest

The author declares that he has no conflicts of interest to this work.

Data Availability Statement

The data that support this work are available upon reasonable request to the corresponding author.

Author Contribution Statement

Subhagata Chattopadhyay: Conceptualization, Methodology, Software, Validation, Formal analysis, Investigation, Data curation, Writing - original draft, Writing - review & editing, Visualization.