×

Ai-Enhanced Real Time Speech To Speech Translation

Author : Barath Raaj S A, D.Parameswari, Varnikhasri S, Udaya Kumar S Journa Name: International Journal of Science, Engineering and Technology Volume: 14 issue: 2 Year: Volume-14-issue-2 Views : 239
Abstract:
The demand for effective communication through practical means continues to increase due to globalization. In such areas as education, health care, tourism and multinational cooperation, everyone faces some type of language barrier; therefore, all of these situations rely on an effective communication system to facilitate dialogue between individuals who speak multiple languages in their native language. This paper discusses a system that allows people who speak different languages to interact with each other in real time using a real-time speech-to-speech system (S2ST). It consists of three major parts: automatic speech recognition (ASR), neural machine translation (NMT) and text to speech (TTS) synthesis. ASR is the part of the system that takes the spoken input and converts it into an electronic form of the input as soon as the speaker has finished speaking. ASR uses streaming ASR technology to produce this conversion in near real time while removing background noise using noise reduction and detecting when there is actual voice activity so that the end user receives accurate and robust information under all conditions. The NMT portion of the S2ST system employs a transformer based neural translation model to generate translated electronic forms of the output of the ASR component. The NMT component uses semantic meaning and contextual correctness rather than simply using the word-for-word translations for the output of the ASR. The TTS portion of the S2ST system produces quality, natural sound outputs in order to enable conversational interaction. The experimental study of this system confirms that the system produces high levels of accuracy in translation and barriers and promoting inclusive global communication.

Related Indexing Platform

Indexed

Zenodo Logo
Zenodo
Research Data Repository
https://zenodo.org/records/19087958
DOI
DOI Resolver
Global Persistent Identifier
https://doi.org/10.5281/zenodo.19087958
GS
Google Scholar
Search this title on Scholar
Search on Google Scholar
SS
Semantic Scholar
Search this title
Search on Semantic Scholar
Lens
Lens.org
Check citations via DOI
Search on Lens.org
Leave Your Comment

Related Reviewers

Chat with Expert