View on Asset Store (opens in new tab)
Package details
- Latest version
- 1.0.0
- Last updated
- First released
- Unity version
- 2022.3.62 or later
- Package size
- 1.4 GB
- Files
- 38
- Views in the past week
- 8
Price tracking
- Last checked
- Tracked since
- Lowest recorded
- $60.00 on
Keywords
Whisper Base Multi (OnnxRuntime/DirectML) for Unity
The Whisper Base Multi model runs on the ONNX Runtime accelerated by DirectML; ready-to-drop into a project for 64-bit Windows, providing fast Qwen 2.5 translation with fast setup, no extra downloads
Affiliate link · Purchases support this site
Price history
Last 6 months
USDAsset preview
1 / 2
Whisper Base Multi (OnnxRuntime/DirectML) for Unity screenshot 1
About this asset
Summary
Whisper Base Multi (DirectML) is a turnkey Windows x64 Unity package that ships a single native DLL containing the OpenAI Whisper base multilingual model, accelerated by ONNX Runtime + DirectML. It works offline in the Editor and Windows Standalone builds, enabling fast, local language detection and transcription (in the source language) from either audio clips or microphone input (continuous or push-to-talk). For translation, the package uses an internal Qwen 2.5 text translation backend: the app transcribes with Whisper, then translates the transcript text via a dedicated `TranslateText(text, from, to)` API.
User scenarios
- You’re building a game and already support controller/keyboard/mouse, but you want speech input for accessibility and hands-free actions.
- You want a voice-driven application that reacts to spoken commands without cloud latency.
- You need multilingual transcription and optional transcript translation on a machine with no internet access, so you need a fully offline solution.
From the publisher's Asset Store listing.
Technical details
- Single native DLL with Whisper base multilingual on ONNX Runtime + DirectML (offline, Windows x64).
- Speech-to-text from audio clips (StreamingAssets) and live microphone input.
- Includes multilingual sample WAV clips for quick testing (Chinese/French/Spanish).
- Microphone modes: continuous capture and push-to-talk.
- Language auto-detect (or user-selected language) plus transcription from mono 16 kHz PCM.
- Optional offline text translation via Qwen 2.5 (transcript text in, translated text out).
- Clean API surface: `DetectLanguage(pcm)`, `Transcribe(pcm, language)`, `TranslateText(text, from, to)` (pass empty string for best-effort auto language).
- Two example scenes: one for audio clips (transcribe/translate); one for real-time mic dictation (continuous + push-to-talk).
Compatibility
| Unity version | Built-in | URP | HDRP | Custom |
|---|---|---|---|---|
| 2022.3.62f3 | Compatible | Compatible | Compatible | Compatible |
This is an audio tool that is not affected by SRP compatiblity.
This package currently supports 64-bit Windows for the Unity Editor and Standalone.
As listed on the Asset Store.