Multilingual Voiceovers: Breaking Boundaries with ElevenLabs

Introduction:

Hello! I’m Süleyman Burak Çelik (Dr. Eng.), an Electrical, Electronics, and Communications Engineer, and the founder of the EngineeringTR and EngineeringENG YouTube channels. Today, I want to showcase how voiceover technology can create impressive results in multiple languages, and how ElevenLabs plays a significant role in this process.

ElevenLabs and Voiceover Technology:

ElevenLabs stands out with its text-to-speech technology, capable of converting written content into natural and fluent voice. As someone who produces content in multiple languages, this holds great value for me.

My Experiences:

On my YouTube channels, I present engineering lessons in Turkish. However, to reach a broader audience, I needed to present them in other languages, such as English, Spanish and others. This is where ElevenLabs comes into play.

Leveraging ElevenLabs API for Voiceovers:

One of the finest features of ElevenLabs is its API Service. For over six months, I have been working with the ElevenLabs API to create voiceovers from subtitle files, paying careful attention to the timestamps within the subtitles. This innovative use of technology has allowed me to automate the voiceover process efficiently, ensuring that the audio matches perfectly with the timed text.

Multilingual Voiceover Examples:

Below, you will find the same subtitle texts in different languages and their voiceover examples created using ElevenLabs technology.

Here are some Subtitle Samples in different languages:

01- ENGLISH

English Subtitle:

1
00:00:00,000 –> 00:00:03,000
Hello, I am an artificial intelligence model.

2
00:00:05,000 –> 00:00:10,000
I am doing voiceover with ElevenLabs Ultra-Realistic Voices.

Subtitle Synchronized Speech of English Subtitle by caring the Subtitle Time Blocks:

 

02- GERMAN

German Subtitle:

1
00:00:00,000 –> 00:00:03,000
Hallo, ich bin ein Modell der künstlichen Intelligenz.

2
00:00:05,000 –> 00:00:10,000
Ich mache Voiceover mit ElevenLabs Ultra-Realistic Voices.

Subtitle Synchronized Speech of German Subtitle by caring the Subtitle Time Blocks:

 

03- SPANISH

Spanish Subtitle:

1
00:00:00,000 –> 00:00:03,000
Hola, soy un modelo de inteligencia artificial.

2
00:00:05,000 –> 00:00:10,000
Estoy haciendo doblaje con ElevenLabs Ultra-Realistic Voices.

Subtitle Synchronized Speech of Spanish Subtitle by caring the Subtitle Time Blocks:

 

 

04- ARABIC

Arabic Subtitle:

1
00:00:00,000 –> 00:00:03,000
مرحباً، أنا نموذج ذكاء اصطناعي.

2
00:00:05,000 –> 00:00:10,000
أقوم بالتعليق الصوتي باستخدام أصوات ElevenLabs فائقة الواقعية.

Subtitle Synchronized Speech of Arabic Subtitle by caring the Subtitle Time Blocks:

 

05- CHINESE

Chinese Subtitle:

1
00:00:00,000 –> 00:00:03,000
你好,我是人工智能模型。

2
00:00:05,000 –> 00:00:10,000
我正在使用 ElevenLabs Ultra-Realistic Voices 进行配音。

Subtitle Synchronized Speech of Chinese Subtitle by caring the Subtitle Time Blocks:

 

My Innovative Solutions and Plans:

I have largely completed the development of a method that I plan to offer as an interface. This will demonstrate step by step how to convert a video from one language to another, which I plan to explain on our EngineeringTR YouTube channel. With this method, instead of direct dubbing, you’ll be able to work on the texts and use the cloned voice of your choice for synchronous voiceovers. This process generally involves creating the most accurate subtitles with Whisper, then accurately translating them into the desired language with Deepl, and finally using ElevenLabs’s API in our application to choose the voices to voiceover the newly prepared subtitles in a different language synchronously. The final step, if needed, involves editing out any excessive gaps using auto-editor, a process I plan to share with the entire world.

Conclusion:

Thanks to the technology provided by ElevenLabs, I have been able to reach a much wider audience with my content. This technology can be utilized in educational materials, podcasts, and many other areas. I thank ElevenLabs for their innovative approach and invite you to try this technology.

To complement this article, I’ve prepared a brief video demonstration of the intuitive interface program I developed. This tool exemplifies the practical application of ElevenLabs’ API, showcasing how easily one can transform subtitles into perfectly timed voiceovers. While the audio samples provided give you a taste of the capabilities, the video will guide you through the seamless process from subtitle to speech, illustrating the simplicity and power of the tool. I believe in sharing knowledge and innovation, and this is a step towards a more connected and multilingual world. I invite you to watch the video and see the potential of this technology in action.

 

Innovative Use of Your Own API and Voices:

In closing, if you are looking to leverage your own API to use the voices you’ve crafted, I recommend not just ElevenLabs Free Plan, but particularly their Paid Plans. The premium features enable you to utilize a professional clone of your own voice, offering the remarkable ability to speak in different languages. This can be a game-changer for content creators who wish to expand their reach across diverse linguistic audiences. With ElevenLabs, the world becomes your audience, without the barriers of language standing in the way.

For More, please visit the Web Site:

ElevenLabs Website

Yorum yapın