International Journal For Multidisciplinary Research

E-ISSN: 2582-2160     Impact Factor: 9.24

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 7, Issue 2 (March-April 2025) Submit your research before last 3 days of April to publish your research paper in the issue of March-April.

Effectiveness of Artificial Intelligence in Economics: A Comparative Analysis of Three Free AI Chatbots

Author(s) Prof. Dr. Muhammad Shahadat Hossain Siddiquee, Mormita Jahan
Country Bangladesh
Abstract This study aims to explore how AI-powered Chatbots can transform economics education by delivering real-time information, analyses, and insights into economic concepts. We conduct a comparative analysis of three prominent free AI Chatbots (i.e., Perplexity AI, Claude 3 Sonnet, and Meta Llama 3 70B) to evaluate the quality and comprehensiveness of each Chatbot's knowledge base to appraise their effectiveness in responding to nuanced economic inquiries across Macroeconomics and Microeconomics domains. Using the tool Test of Understanding of College Economics (TUCE) version 4 questionnaire with 30 questions per domain, this study assesses the accuracy and comprehensiveness of these Chatbots’ responses using qualitative content and comparative score analyses. This study leads us to vouch for AI chatbots as being acceptable as guides in the case of economic theories and problem-solving. Another finding is that the observation of variance in the performance of AI Chatbots is due to chance, revoking the idea of difference in the depth of true knowledge, in case of economics. By identifying strengths and limitations, this research provides valuable insights for educators integrating advanced technologies into teaching and supports students in leveraging interactive AI-driven platforms to enhance their understanding of economics.
Keywords TUCE IV, Rubric, Perplexity AI, Claude 3 Sonnet, Meta Llama 3 70B, R Language
Field Sociology > Economics
Published In Volume 7, Issue 2, March-April 2025
Published On 2025-04-08
DOI https://doi.org/10.36948/ijfmr.2025.v07i02.40428
Short DOI https://doi.org/g9fb43

Share this