Spotify has joined forces with OpenAI, introducing a groundbreaking feature that empowers podcasters to effortlessly create foreign language versions of their shows. This innovative tool harnesses the capabilities of AI-powered voice translation, enabling podcast creators to instantly switch to different languages while retaining their synthesized voice.
Expanding Language Accessibility
Spotify has already initiated partnerships with prominent podcasters to translate their English-language episodes into Spanish using this advanced tool. Additionally, plans are underway to roll out translations in French and German in the coming weeks. Notable podcasters such as Dax Shepard, Monica Padman, Lex Fridman, Bill Simmons, and Steven Bartlett are among the first to have their episodes translated. Spotify intends to expand this initiative to include popular shows like The Rewatchables and Trevor Noah’s upcoming program.
The Power of Voice Translation
At the core of this translation feature is OpenAI Whisper, an AI voice synthesis tool capable of transcribing English speech and translating it into English from other languages. However, Spotify’s innovation transcends mere speech-to-text translation. This unique feature translates podcasts into different languages and presents them in a synthesized version, maintaining the authenticity of the podcaster’s voice.
“Voice Translation offers listeners worldwide an opportunity to discover and connect with new podcasters in a more genuine manner,” says Ziad Sultan, VP of Personalization at Spotify.
OpenAI’s Human-like Audio Creation
OpenAI has also unveiled a tool capable of generating “human-like audio from just text and a brief speech sample,” notes NIX Solutions. However, due to concerns related to security and privacy, the availability of this tool will be significantly limited. This is a key reason why Spotify’s translation technology is currently in a testing phase with a select group of podcasters, and the company has refrained from making predictions about widespread adoption of this new feature.