International Journal For Multidisciplinary Research

E-ISSN: 2582-2160     Impact Factor: 9.24

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 8, Issue 3 (May-June 2026) Submit your research before last 3 days of June to publish your research paper in the issue of May-June.

AI-Powered Multimodal Medical Chatbot for Smart Healthcare Support

Author(s) Likitha T, Shwetha M R
Country India
Abstract This project introduces an AI-powered virtual Medical Chatbot to assist in the diagnosis of skin diseases and provide consultations. It applies deep learning-based image analysis and sophisticated natural language processing (NLP) for interactive support. Users can upload images of skin lesions, and the system processes them with a Convolutional Neural Network (CNN) using EfficientNetB3 to accurately label them into one of ten prevalent skin conditions such as eczema, melanoma, or psoriasis. To achieve good performance even with imbalanced datasets, the system applies various preprocessing techniques, including oversampling, under sampling, and data augmentation, before splitting the data into 70% training, 15% validation, and 15% for testing. By applying transfer learning and fine-tuning, the image classifier achieves high accuracy in its output. Following diagnosis, a BERT-based NLP chatbot engages in dialogue with the user, interpreting their needs and giving appropriate feedback to questions on symptoms, treatment, and prevention. The whole solution is packaged into an easy-to-use web application, providing a complete and automated system for skin disease diagnosis and giving personalized medical advice. This new framework demonstrates how well computer vision and transformer-based NLP models can be mixed, paving the way for scalable and affordable dermatological care using a smart healthcare assistant.
Keywords Skin Disease Diagnosis, AI Chatbot, Deep Learning, Natural Language Processing
Field Computer > Artificial Intelligence / Simulation / Virtual Reality
Published In Volume 7, Issue 4, July-August 2025
Published On 2025-08-23
DOI https://doi.org/10.36948/ijfmr.2025.v07i04.53731

Share this