Human Vulnerability, Machine Law: Ethical Risks and Global Governance Challenges in Generative AI

Kaukab Saqlain Ansari

doi:10.36948/ijfmr.2025.v07i05.56786

Human Vulnerability, Machine Law: Ethical Risks and Global Governance Challenges in Generative AI

Author(s)	Mr. Kaukab Saqlain Ansari
Country	India
Abstract	Generative Artificial Intelligence (GenAI) is rapidly transforming digital engagement, but its expanding capabilities introduce novel ethical and legal dilemmas. This paper investigates the under-examined risks of using GenAI models as informal life coaches and therapists, in addition to the other notable differences in regional AI governance, especially in Asia and Africa. Utilizing a mixed-methods design, this study integrates AI simulation testing of four leading models (ChatGPT, Gemini, Claude, and Grok) against the Columbia Suicide Severity Rating Scale (C-SSRS) combined with survey data from 592 users about using AI as life coach or therapist. Results indicate a difference between the AI models which prioritise safety; specifically, the AI model either disengaged from, or provided repetitive, or generic advice, when assessing a high-risk situation where a user might harm themself. The survey also questions the usefulness of AI chatbots—where most users stated that they were “not at all helpful” (55.4%) in providing emotional support , users were “never better ” (56.7%) after using AI as a therapist and prefer human therapists (79.2%) for privacy reasons. Further, the analysis suggests a clear global split in policy; with the EU providing a proactive regulatory framework as opposed to legal and enforcement gaps in the Global South. Overall, this research suggests the use of GenAI for mental health support is premature and facilitates significant risk to vulnerable users. Finally, this paper argues for urgent, risk-based regulations, hybrid models of AI and human support and user-centred research, to create ethical guardrails for responsible innovations in AI.
Keywords	Generative AI, AI Ethics, Mixed-Methods Research, Regulatory Gaps, Global AI Policy
Field	Computer > Artificial Intelligence / Simulation / Virtual Reality
Published In	Volume 7, Issue 5, September-October 2025
Published On	2025-09-29
DOI	https://doi.org/10.36948/ijfmr.2025.v07i05.56786

View / Download PDF File

E-ISSN 2582-2160

doi

CrossRef DOI is assigned to each research paper published in our journal.

IJFMR DOI prefix is
10.36948/ijfmr

Downloads

Research Paper Format Copyright Permission Form and Undertaking Form Cover Page Vol 8 Isu 2 Cover Page Vol 8 Isu 1 Cover Page Vol 7 Isu 6

All research papers published on this website are licensed under Creative Commons Attribution-ShareAlike 4.0 International License, and all rights belong to their respective authors/researchers.

CC-BY-SA

About IJFMR Fees & Payment Current Issue Publication Archive	Submit Research Paper Track Submission Status Publication Guidelines Publication Ethics Peer Review & Plagiarism	Join as a Reviewer Editors & Reviewers Reviewer Referral Program Get Reviewer Membership Certi.	Website/Journal Policies Usage Policy Content Policies Privacy Policy

Contact Us		+91-9687-828-838	editor@ijfmr.com

International Journal For Multidisciplinary Research

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Human Vulnerability, Machine Law: Ethical Risks and Global Governance Challenges in Generative AI

Share this