AI Voice for Short Drama: Preset Voices, Voice Cloning and Native Audio — and Why Lip Sync Fails

There are three routes. Preset voice libraries match a character by gender, language and age at near-zero cost per character. Voice cloning is billed per voice slot or subscription and requires the speaker's consent plus an AI-content label. Native audio lets the video model speak the line itself: lip sync is inherent, but every regeneration is billed as video seconds. When lip sync fails, the model is rarely the cause. The script did not say who is speaking, the line was given the wrong number of seconds, or the reference voice's delivery overrode the performance note.

The three routes in one table

Short version: presets for supporting roles and narration, cloning for leads when the rights are in hand, native audio for shots with short lines. Most productions mix all three. Every pricing note below comes from the vendor's public page, checked 2026-09-02.

Route one: preset libraries are cheap, but you have to audition

Presets are billed per character, and drama dialogue is short. A 90-second vertical episode carries roughly 150–250 English words, about 1,000 characters. At the $100 per million characters MiniMax lists for HD speech on its pay-as-you-go page (source), an episode costs about ten cents. ElevenLabs bills credits: Creator is $22/month for 121,000 credits, and one text character equals one credit on the v2 multilingual models (pricing). CapCut's Text to Speech page lists 200+ voices filterable by gender, age, style and language and describes the tool as free (source). Azure standard voices cover 100+ languages and locales; note that each CJK ideograph, including Japanese kanji and Korean hanja, is billed as two characters (Microsoft Learn).

Matching order is fixed: gender, then language, then age, then listen. In CapCut or the ElevenLabs library a person filters by tag and picks. Some end-to-end drama tools match for you: SceneMixer, for instance, assigns each parsed character a 3–8 second sample from MiniMax's system voice catalogue by gender, language and age, and lets the user re-match or upload. Matching from a library adds no per-voice fee; a bespoke generated voice costs a slot each.

Route two: cloning is a rights question before it is a price question

ElevenLabs documents two tiers. Instant Voice Cloning needs 1–2 minutes of clean audio and is available from the Starter plan ($6/month). Professional Voice Cloning needs 30–180 minutes, is available from Creator, requires identity verification, and may only be used on your own voice; fine-tuning takes 3–6 hours (docs). MiniMax lists rapid voice cloning at $1.5 per voice on its pay-as-you-go page. Azure custom voice is a limited-access feature you apply for.

Two jurisdictions matter for most international releases. In the US, voice is a matter of state publicity law. Tennessee's ELVIS Act, in force since 1 July 2024, gives every individual a property right in their voice, defines voice to include a simulation of it, and makes it actionable to knowingly publish an unauthorized voice or to distribute a tool whose primary purpose is producing a particular person's voice without authorization (Public Chapter 588). In Lehrman v. Lovo (S.D.N.Y., 10 July 2025), voice actors who alleged that their recordings had been used to build and sell AI clones mostly failed to state federal trademark and copyright claims, but their voice-misappropriation claims under New York's Civil Rights Law were allowed to proceed, along with contract and consumer-protection claims (opinion). In the EU, AI Act Article 50 requires providers of generative tools to mark synthetic audio in a machine-readable way and requires deepfakes to be disclosed, from 2 August 2026 (European Commission). In practice: a written release from the voice actor that names the use, the term, and whether the clone may be reused on other titles.

Route three: native audio gets lip sync for free and makes retakes expensive

The video model speaks the line, so the mouth and the sound come from the same pass. The switches differ by vendor. Seedance 2.0 takes a boolean generate_audio on task creation (on by default), supported on the Seedance 2.0 series, 2.5 and 1.5 pro (BytePlus ModelArk API). MiniMax H3 accepts reference audio, at most 3 clips and 15 seconds in total, and its first-frame image is mutually exclusive with reference images (docs). Google describes Veo 3.1 as a model for video with native audio; its prompting guide puts dialogue in quotation marks and describes sound effects and ambience as separate cues (Gemini API, guide). Alibaba's Wan guide (Wan 2.5–3.0) gives a formula: the character's line, then emotion, tone, speed, timbre and accent, with "No dialogue." as the explicit off switch (Model Studio).

Two costs. First, the line and the picture are one generation: a mispronounced word or a dragged syllable means regenerating the whole segment at per-second video rates. Second, language and timbre are controlled by prose. "A low middle-aged male voice" is a specific asset in a library and a probability distribution in a video model.

Emotion, gender, age: hard filters versus delivery

Gender, language and age are hard filters. Apply them first, then listen. The hard part is delivery: announcer, call-centre, cartoon. Delivery is a property of the voice itself, and no emotion note will remove it.

Consider a male lead matched to a news-anchor preset. Every line after that, including ones marked "lowered voice", "on the edge of tears" and "through clenched teeth", comes out as a bulletin; a voice whose sample already has rise and fall makes the same notes work at once. The delivery baked into a reference sample overrides the performance note. That is what to listen for when auditioning, more than resemblance.

Age must match the face. A character written as 25 with a settled 45-year-old sample makes viewers notice the mismatch before the story. Put emotion in the line note (tone, pace, pauses) and fix delivery by changing voices; do not try to do one with the other.

The three real causes of broken lip sync

One: speaker attribution. The model animates the mouth on the largest, nearest face in frame. A storyboard that says "Line: don't go" without naming who says it will, in any two-shot, move the wrong mouth. Fix: the speaker appears in the frame description first, the line names the speaker, and multi-person dialogue is cut into reverse shots, one face per shot.

Two: wrong number of seconds. SinCoSphere's calibration for English is about 2.5 words per second. A ten-word line wants about four seconds. Give it two and the second half lands on the next shot's face; give it six and the model stretches syllables or reads the line twice to fill time. Drift is invisible at three seconds and obvious by twelve. See dialogue timing.

Three: rhythm in the reference clip. If the 15 seconds of H3 reference audio are read-aloud narration, the model copies the cadence and the character sounds like a script reading. Use conversational samples, not narration.

Routes one and two never had lip sync: TTS laid over a finished picture has no relationship to the mouth. Re-animate it with a lip-driving tool, or storyboard around it with reverse shots, over-the-shoulder angles and off-screen lines.

What voice actually costs per episode

• Presets: usually bundled by end-to-end tools; called directly, about 1,000 characters of dialogue at $100 per million is roughly $0.10.
• Cloning: a one-off slot or subscription per voice, plus synthesis per character; spread over a series it rounds to nothing.
• Native audio: no line item, it is video seconds. Regenerating a 10-second segment once is paying for 10 more seconds. The real voice cost is your regeneration rate.

Voice is under 1% of a series budget; video generation is above 85% (see the cost breakdown). Do not save that 1% by skipping releases and labels.

A workflow you can copy

1. At parsing, record each character's gender, age band and language in the character table.
2. Match everyone from a preset library first; audition each 3–8 second sample specifically for delivery.
3. Decide whether the leads justify a clone; get the release before the audio, and label the output.
4. In the storyboard, give every line its seconds at 2.5 words per second, name the speaker, cut group dialogue into reverse shots.
5. Use native audio for shots with lines of 8 seconds or less; use TTS plus reverse shots or off-screen delivery for long speeches.
6. Before export, listen through the whole episode for consistent delivery per character and age that matches the face.

For how lines and seconds are written into a shot, see video prompt writing; terms are defined under native audio and reference audio.

Key figures and sources

Sources

• https://platform.minimax.io/docs/guides/pricing-paygo
• https://platform.minimax.io/docs/api-reference/video-generation-v2-create
• https://www.capcut.com/tools/text-to-speech
• https://elevenlabs.io/pricing
• https://elevenlabs.io/docs/product-guides/voices/voice-cloning
• https://learn.microsoft.com/en-us/azure/ai-services/speech-service/text-to-speech
• https://docs.byteplus.com/en/docs/ModelArk/1520757
• https://ai.google.dev/gemini-api/docs/veo
• https://cloud.google.com/blog/products/ai-machine-learning/ultimate-prompting-guide-for-veo-3-1
• https://www.alibabacloud.com/help/en/model-studio/text-to-video-prompt
• https://publications.tnsosfiles.com/acts/113/pub/pc0588.pdf
• https://www.nysd.uscourts.gov/sites/default/files/2025-07/Lovo%20v%20Lehrman.pdf
• https://digital-strategy.ec.europa.eu/en/factpages/quick-facts-transparency-rules-ai-systems

Tools mentioned

Read next