Lightweight Transformer-based Ai Model for Multilingual and Code-mixed Sentiment Analysis

vijay kumar

doi:10.36948/ijfmr.2026.v08i05.88617

Lightweight Transformer-based Ai Model for Multilingual and Code-mixed Sentiment Analysis

Author(s)	Mr. vijay kumar
Country	India
Abstract	Social media users increasingly communicate across language boundaries, often combining two or more languages within the same sentence and frequently writing Indian languages in Roman script. This creates a difficult setting for sentiment analysis because conventional monolingual models must cope with spelling variation, transliteration, informal vocabulary, emojis, abbreviations, language switching, and context-dependent sentiment. Large multilingual Transformer models have improved contextual understanding, but their computational cost can make deployment difficult on resource-constrained systems. This thesis proposes a lightweight Transformer-based framework for multilingual and code-mixed sentiment analysis. The framework uses a multilingual teacher model, language-aware normalization, and knowledge distillation to transfer contextual knowledge into a smaller student model. The study focuses primarily on Hindi-English (Hinglish) and Spanish-English (Spanglish) social-media text, using the SemEval-2020 Task 9 SentiMix corpora as a reproducible benchmark. The proposed framework is evaluated against classical machine-learning, recurrent neural-network, and full-size Transformer baselines. Evaluation is designed to consider not only accuracy and macro/weighted F1, but also inference latency, parameter count, memory consumption, robustness to noisy and code-mixed text, and the consistency of predictions across language pairs. An explainability component is also included so that important tokens contributing to a prediction can be inspected. The central research question is whether a substantially smaller Transformer can retain useful multilingual sentiment knowledge while reducing computational requirements. The thesis therefore treats sentiment analysis as both a language-understanding problem and an engineering deployment problem. The resulting framework is intended for applications such as social-media monitoring, customer-feedback analysis, multilingual communication systems, and other AI systems where language diversity and limited computing resources must be considered together. Keywords: Transformer, multilingual NLP, code-mixed text, sentiment analysis, knowledge distillation, Hinglish, Spanglish, lightweight AI, explainable AI, social media.
Keywords	Transformer, multilingual NLP, code-mixed text, sentiment analysis, knowledge distillation, Hinglish, Spanglish, lightweight AI, explainable AI, social media.
Field	Computer > Artificial Intelligence / Simulation / Virtual Reality
Published In	Volume 8, Issue 5, September-October 2026
Published On	2026-10-18
DOI	https://doi.org/10.36948/ijfmr.2026.v08i05.88617

View / Download PDF File

About IJFMR Fees & Payment Current Issue Publication Archive	Submit Research Paper Track Submission Status Publication Guidelines Publication Ethics Peer Review & Plagiarism	Join as a Reviewer Editors & Reviewers Reviewer Referral Program Get Reviewer Membership Certi.	Website/Journal Policies Usage Policy Content Policies Privacy Policy

Contact Us		+91-9687-828-838	editor@ijfmr.com

International Journal For Multidisciplinary Research

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Lightweight Transformer-based Ai Model for Multilingual and Code-mixed Sentiment Analysis

Share this