International Journal For Multidisciplinary Research

E-ISSN: 2582-2160     Impact Factor: 9.24

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 6 Issue 3 May-June 2024 Submit your research before last 3 days of June to publish your research paper in the issue of May-June.

Automating Multilingual Video Dubbing Using Deep Learning and Audio Synthesis

Author(s) Himanshu Sehrawat, Varun Goel, Meenu Garg, Neha Agarwal
Country India
Abstract The paper offers a holistic approach to video translation into several languages that combines deep learning, and audio synthesis techniques, in order to automate the process. Exploiting recent advance in automated speech translation and multimodal translation, we shall develop an approach reproducing high-quality dubbed video materials efficiently and at a large scale. The methodology includes: 1. extraction of audio from the original videos, 2. transcription and translation of audios, 3. synthesis of translated audio tracks, and 4. fusion them with the audio of original videos in order to get final multilingual dubbed videos. Trial findings provide evidence that the suggested approach is able to generate high-quality and indistinguishable from original counterpart dubbed videos among different languages and video formats.
Keywords Video Dubbing, Automatic Speech Translation, Multilingual Translation, Deep Learning, Audio Synthesis.
Field Engineering
Published In Volume 6, Issue 3, May-June 2024
Published On 2024-05-13
Cite This Automating Multilingual Video Dubbing Using Deep Learning and Audio Synthesis - Himanshu Sehrawat, Varun Goel, Meenu Garg, Neha Agarwal - IJFMR Volume 6, Issue 3, May-June 2024. DOI 10.36948/ijfmr.2024.v06i03.20067
DOI https://doi.org/10.36948/ijfmr.2024.v06i03.20067
Short DOI https://doi.org/gtt8vf

Share this