View on Asset Store (opens in new tab)
Package details
- Latest version
- 1.4
- Last updated
- First released
- Unity version
- 6000.3.10 or later
- Package size
- 25.0 MB
- Files
- 25
- Favorites
- 175
- Views in the past week
- 60
Price tracking
- Last checked
- Tracked since
- Lowest recorded
- $5.99 on
Keywords
SpeechBlend LipSync
SpeechBlend is a Unity asset for real-time lip sync using machine learning. It helps you add natural-looking talking characters fast across many rigs, including WebGL and mic input.
Affiliate link · Purchases support this site
Price history
Last 6 months
USDAsset preview
1 / 3
SpeechBlend LipSync screenshot 1
About this asset
SpeechBlend provides accurate, real-time lip syncing in Unity.
SpeechBlend works by analyzing the audio coming from any Audio Source and uses machine learning to predict realistic mouth shapes (visemes).
Currently the following viseme blendshape sets are supported:
- Daz Studio (Genesis 2/3/8)
- Character Creator 3
- iClone (v5.x/v6.x)
- Adobe Fuse (Mixamo Rigging)
- Character Creator 3/4
- Apple AR Face
- Any character model with similar blendshapes to the above
Now with WebGL Support!
To use SpeechBlend, just drop the component onto your character, select the voice audio source and head mesh blendshapes and you're ready to go!
SpeechBlend can be used with just a single jaw joint or "mouth open" blendshape for simple mouth tracking with your audio file. To create realistic lip syncing it's recommended to use a character model with viseme blendshapes available.
You can even lip-sync your own voice live with microphone input! Check out the included demo to see how.
Many options are available to tweak the viseme prediction to get the realistic look you want at the right performance level.
From the publisher's Asset Store listing.
Technical details
- Real-time lip sync in Unity
- ML-based viseme prediction from audio
- Works with AudioSource output or raw AudioClip analysis
- Supports jaw-only and full viseme blendshape workflows
- Compatible with major blendshape sets (DAZ, CC3/CC4, iClone, Mixamo/Fuse, Apple AR Face)
- WebGL support
- Live microphone lip sync demo/workflow
- Adjustable quality/performance settings
- Per-viseme weight tuning and template auto-detect tooling
- Distance equalization option for spatial audio scenarios
Compatibility
| Unity version | Built-in | URP | HDRP | Custom |
|---|---|---|---|---|
| 6000.3.10f1 | Compatible | Compatible | Compatible | Compatible |
As listed on the Asset Store.