International Journal For Multidisciplinary Research

E-ISSN: 2582-2160     Impact Factor: 9.24

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 7, Issue 3 (May-June 2025) Submit your research before last 3 days of June to publish your research paper in the issue of May-June.

Fine-Tuning Transformers for Sentiment Analysis

Author(s) Raghav Girish Dashrath, Shravani Sanjay Deshmukh, Atharv Rajendra Bhaleghare
Country India
Abstract This paper explores advanced techniques for fine-tuning
pre-trained transformer models such as BERT and GPT for sentiment
analysis tasks, with a particular focus on handling domain-specific
language in customer feedback. We propose a novel adaptive transfer
learning framework that combines contextual embedding augmen
tation with progressive domain adaptation to improve sentiment
classification accuracy across diverse domains. Our experimental
results demonstrate that our proposed methods achieve state-of-the-art
performance on benchmark datasets, with significant improvements
in handling domain-specific terminology and contextual nuances in
customer feedback. We also introduce a new approach to cross
domain generalization through contrastive domain adaptation that
shows promising results for zero-shot adaptation to new domains.
Field Engineering
Published In Volume 7, Issue 3, May-June 2025
Published On 2025-05-04
DOI https://doi.org/10.36948/ijfmr.2025.v07i03.42227
Short DOI https://doi.org/g9hscs

Share this