Seedance 2.0's audio prompt feature lets you generate video that responds to audio — music, sound effects, or voice. The video's motion, timing, and visual elements sync with the audio, creating a more cohesive result than adding music in post-production.
This guide walks through the audio prompt workflow step by step.
Quick answer
Upload an audio file alongside your text or image prompt. Seedance analyses the audio for rhythm, beats, and energy, then generates video with motion that matches. Best results come from clear, rhythmic audio with distinct beats.
- You want video motion that syncs with music or sound effects.
- You are creating music videos, visualisers, or audio-reactive content.
- You want more dynamic video without manually editing to match audio.
How audio prompts work
When you provide audio alongside a prompt, Seedance analyses the audio waveform — identifying beats, tempo changes, volume dynamics, and energy shifts. It uses this information to drive the video's motion and visual intensity.
Loud, energetic sections produce faster motion. Quiet sections produce calmer visuals. Beat hits can trigger visual changes or motion accents.
Choosing the right audio
Clear, rhythmic audio works best. Songs with strong beats, obvious tempo, and dynamic range give Seedance the most information to work with.
Avoid audio with heavy compression (everything at the same volume), very complex layered music, or spoken word with long pauses.
- Electronic and pop music: strong beats, clear structure — works very well
- Orchestral music: dynamic range drives dramatic visuals
- Ambient music: produces subtle, slow-moving visuals
- Voice narration: motion follows speech patterns, pauses create stillness
Combining audio with text and image prompts
Audio prompts work best when combined with a text prompt that describes the visual style and a source image that establishes the scene. The audio drives the motion, the text guides the style, and the image anchors the visuals.
If you use only audio without a text prompt, Seedance generates abstract, visualiser-style content. Add a text prompt for more controlled output.
Settings for audio-driven video
Let the audio drive motion intensity rather than setting it manually. If you do set motion intensity, use medium values (40-60%) — too low and the audio sync is not visible, too high and the video becomes chaotic.
Match the duration to the audio length. Seedance clips are short, so use a 4-8 second section of your audio that captures the energy you want.
Editing audio-driven clips
Generate multiple clips from different sections of the same audio track and edit them together for a longer piece. This works well for music videos — each clip captures a different section's energy.
In post-production, you can extend or loop clips, add transitions, and overlay text, but the core audio-visual sync from Seedance is the foundation.
Worked example: music visualiser clip
You have a 4-second clip from an electronic track with a strong beat drop. Upload the audio with a text prompt: 'Abstract neon landscape, camera pushes forward, energy surges with the music, vivid colours, cinematic.' Seedance generates a clip where the visual motion and intensity match the beat drop perfectly.
Common mistakes
- Using audio with no dynamic range — the video will have no motion variation.
- Not adding a text prompt, resulting in generic abstract visuals.
- Trying to generate long clips — audio sync quality degrades after 5-6 seconds.
Step by step: write audio-aware prompts
- Separate the audio line from the visual line. "Visual: a chef slicing vegetables. Audio: rhythmic knife chops, kitchen ambience." Seedance handles split prompts better than blended ones.
- Name one ambient layer. "Coffee shop hum" or "rain on window". One layer is clean; three layers fight each other.
- Name one foreground sound. Footsteps, a bell, a laugh — the sound the viewer should notice.
- Avoid dialogue in the prompt. Seedance does not generate clean speech. Generate the visual and add dialogue in post.
- Match sound timing to motion. If the clip is 5 seconds, describe a 5-second audio event ("a single door slam at the 3-second mark").
- Export at 48kHz for editing. Keeps sync accurate when you layer in extra audio later.
Troubleshooting table
| Symptom | Likely cause | Fix |
|---|---|---|
| Audio feels disconnected from visual | Prompt described visual only | Add an explicit audio line. |
| Ambient sound drowns out the action | Ambient layer too dominant in prompt | Describe ambient as "quiet" or "low". Foreground sound should be the main descriptor. |
| Dialogue sounds garbled | Seedance cannot do clean dialogue | Record voiceover separately and layer in an editor. |
| Sync drifts by the end of the clip | Clip length above 8 seconds | Keep clips to 5-6 seconds. |
For the beginner workflow, start with the Seedance 2.0 tutorial. For lip-sync specifically, see lip-sync and talking heads.
When to use something else
For standard video generation without audio, see Seedance 2.0 image to video. For YouTube content creation, see Seedance 2.0 for YouTube Shorts.
How to get reliable results in your video workflow
How to Use Seedance 2.0 With Audio Prompts Step by Step becomes much more useful once it is tied to the rest of the workflow around it. In real work, the result depends on prompt structure, motion control, visual consistency, and the editing workflow around generated clips, not only on following one local tip correctly.
That is why the biggest win rarely comes from one clever move in isolation. It comes from making the surrounding process easier to review, easier to repeat, and easier to hand over when another person inherits the workbook or codebase later.
- Start with simple prompts and add complexity only after the basic version works.
- Generate multiple variations and select the best rather than trying to get perfection in one shot.
- Build prompt templates for your recurring content types so quality stays consistent.
How to extend the workflow after this guide
Once the core technique works, the next leverage usually comes from standardising it. That might mean naming inputs more clearly, keeping one review checklist, or pairing this page with neighbouring guides so the process becomes repeatable rather than person-dependent.
The follow-on guides below are the most natural next steps from How to Use Seedance 2.0 With Audio Prompts Step by Step. They help move the reader from one useful page into a stronger connected system.
- Go next to How to Use Seedance 2.0 for Image to Video Prompts if you want to deepen the surrounding workflow instead of treating How to Use Seedance 2.0 With Audio Prompts Step by Step as an isolated trick.
- Go next to How to Use Seedance 2.0 for YouTube Shorts Creation if you want to deepen the surrounding workflow instead of treating How to Use Seedance 2.0 With Audio Prompts Step by Step as an isolated trick.
- Go next to How to Write Better Prompts for Seedance 2.0 if you want to deepen the surrounding workflow instead of treating How to Use Seedance 2.0 With Audio Prompts Step by Step as an isolated trick.
Related guides on this site
These guides cover image-to-video, content creation, and prompt writing for Seedance 2.0.
- How to Use Seedance 2.0 for Image to Video Prompts
- How to Use Seedance 2.0 for YouTube Shorts Creation
- How to Write Better Prompts for Seedance 2.0
- How to Use Seedance 2.0 in Dreamina Step by Step
Want to create better AI content?
My courses cover practical AI workflows for content creation, video production, and marketing with real projects.
Browse courses