Hot AI News

ElevenLabs’ Ads Engine can swap a video ad’s hook or dub it without a reshoot

ElevenLabs' Ads Engine now refreshes video ads with new hooks and soundtracks and localizes them with lip-synced dubbing and translated captions, and it now connects to TikTok.

ElevenLabs’ Ads Engine can swap a video ad’s hook or dub it without a reshoot
Image: ElevenLabs

ElevenLabs has added video variants and localization to Ads Engine, part of its ElevenCreative suite. It can now write a new opening hook, clone the original speaker’s voice for it, lip-sync the result, and dub the whole ad into other languages without a reshoot.

What Ads Engine does to an existing video ad

Ads Engine connects to ad accounts on Google, Meta and LinkedIn, and TikTok is the new addition. It pulls a brand’s existing creatives together with their performance data, so the work starts from ads that already perform. It then produces variants and localized versions, translating text and captions, adapting images and dubbing video. The finished ads go back to the team for approval, or the tool can push them straight to the ad platforms. ElevenLabs also says it watches performance and flags creatives that are starting to fade.

Mati Staniszewski, cofounder of ElevenLabs, smiling in a warmly lit room.
Photo: Rafał Masłow / Wikimedia Commons, CC BY-SA 4.0

The video refresh comes in two forms. For a new hook, the system finds the opening of an ad and writes alternatives based on what worked in the brand’s earlier ads. It generates a voiceover for each one with a digital replica of the original speaker, which ElevenLabs says preserves tone, emotion and delivery. The speaker is then lip-synced to the new audio and the captions are updated to match.

For a new soundtrack, Ads Engine uses the ElevenLabs Music API to compose original music from the tone, pace and emotion of the visuals, and adds sound effects at key moments, such as a whoosh on the end card. According to ElevenLabs, the music is cleared for broad commercial use. Teams can replace the original with a variant or publish several and test them against each other.

Advertisements

Dubbing and captions for new markets

For localization, Ads Engine relies on Dubbing v2, which ElevenLabs says adapts phrasing and meaning for each language instead of translating line by line. The speaker is lip-synced to the dubbed audio so the ad looks recorded in that language. Captions are translated too: the burned-in originals are removed and re-rendered in the new language with the original timing and brand fonts.

Humans stay in the loop as an option. A native-speaking localization professional can review a dub for accuracy, timing and the pronunciation of brand and product names, and human reviewers can check any ad before it goes live. The post gives no pricing, language list, regional availability or turnaround time. Interested brands are told to talk to the ElevenLabs team, so this is a sales-led enterprise product rather than a self-serve feature.

Why a cloned voice and lip-sync are the hard part

Changing a hook sounds minor, but it forces several models to agree. A new line has a different length and rhythm, so the cloned voice has to sound like the same person, and the mouth movements in the footage have to be regenerated to fit. Dubbing adds a translation problem on top: the translated sentence rarely takes the same time to say as the original.

Aiholics’ earlier explainer on AI dubbing, which relays ElevenLabs documentation, notes that Dubbing v2 can detect up to 32 speakers per file and lists more than 90 languages. It also carries a setting for how closely the clone follows the original voice: a higher value stays closer but can sound less natural and carry over the original accent. The same piece records that Dubbing v2 was labeled alpha and that automatic output is treated as a preview rather than a production master. The new post does not say whether Ads Engine inherits those limits, and ElevenLabs gives no quality figures for its lip-sync.

The human review option fits a pattern the company set out a week earlier. As Aiholics reported, ElevenLabs now sells human creatives alongside ElevenCreative, including an Extend tier where its staff produce and review localized ads, with linguists checking the output. Ads Engine looks like the software half of the same offer: automation does the bulk, and paid reviewers catch errors.

Advertisements

What brands should ask before relying on it

The pitch rests on a cost argument. ElevenLabs says video ads tend to deliver the strongest results but are slowest and costliest to make, so brands either produce fewer variants as ads wear out or run original-language ads worldwide. Variants without reshoots would remove that constraint, at least for ads built around a spoken hook.

Several points are not established by the source. The performance claims are the company’s own, and no customer results are cited. There is no detail on consent for voice replicas of on-screen talent, which matters because Aiholics’ dubbing explainer notes that dubbed content is generally treated as derivative work, so rights should be confirmed. The post also does not say how much of the lip-sync and dubbing holds up on ads with several speakers or fast cuts, or whether brands can mix automated and reviewed output per market.

The post was written by Joel Ostdiek, who leads growth for ElevenCreative for enterprises. It reads as a product announcement, and the practical test will be whether reviewed dubs and cloned-voice hooks reach the quality advertisers accept on paid channels.

Sign Up for the Daily AI Pulse

One email a day. All the stories that matter.

Alex CarterAI News & Big Tech Correspondent

Alex Carter writes for Aiholics, keeping readers updated on the fast-paced world of AI and Big Tech.

Leave a Reply

Your email address will not be published. Required fields are marked *

You may also like