HeyGen

What is HeyGen?

HeyGen is a generative artificial intelligence (AI) video platform that provides users with the ability to translate videos into different languages without requiring any technical expertise.

In September 2023, the startup made waves by releasing a language translator capable of converting a user’s recorded video into different languages. Additionally, it seamlessly modifies the user’s mouth movements to create a natural and fluent appearance when speaking another language.

At the time of writing, users could choose between English, Spanish, German, Polish, French, Italian, Portuguese, and Hindi.

Testing out @HeyGen_Official translation on French and German. I don’t speak either language so let me know if it sounds natural if you do.
I hope if you pay you can turn off the color correction.
It didn’t work on my phone so I had to upload on my pc.https://t.co/FMJp9sJEBI pic.twitter.com/iF5eONAQ3c

— Jon Finger (@mrjonfinger) September 11, 2023

How Does HeyGen Work?

HeyGen combines translations from ChatGPT-4, lipsyncing from wav2lip-2, and voice cloning from 11labs.

Currently, users can upload videos of 30 seconds or longer to the cloud service using a ‘one credit.’ People have the opportunity to test the service and generate two free videos.

HeyGen co-founder and CEO Joshua Xubreaking said at the launch that “breaking down language barriers makes content accessible to the entire globe, not just the 10% who speak English.”