View on Asset Store (opens in new tab)
Package details
- Latest version
- 0.1.0
- Last updated
- First released
- Unity version
- 2022.3.62 or later
- Package size
- 18.7 MB
- Files
- 28
- Favorites
- 1
- Views in the past week
- 6
Price tracking
- Last checked
- Tracked since
- Lowest recorded
- $27.00 on
Keywords
Android Edge AI Runtime for Unity
Run compatible GGUF local LLMs directly in Unity Android applications through an on-device native runtime—without an HTTP server, WebSocket server, Python environment, or cloud service.
Affiliate link · Purchases support this site
Price history
Last 6 months
USDAsset preview
1 / 5
Android Edge AI Runtime for Unity screenshot 1
About this asset
Android Edge AI Runtime for Unity enables Unity Android projects to run compatible GGUF-format local language models directly on the Android device.
Unity C# communicates with a native llama.cpp-based runtime through the included native shim. Local inference runs inside the Android application without requiring an HTTP server, WebSocket server, Python environment, or cloud service.
The package includes:
• A minimal Android chat sample scene
• Unity C# runtime components
• Android arm64-v8a native libraries
• UTF-8-safe multilingual text handling
• Automatic chat-template application for compatible models
• Single-flight generation control to prevent overlapping inference requests
• Runtime and model configuration options
• Setup and model-placement documentation
• Third-party license notices
GGUF model files are not included. Developers select and place their own compatible GGUF model on the Android device.
This package is intended for developers building:
• Offline-capable AI applications
• Interactive characters and virtual agents
• Local AI prototypes
• Robotics interfaces
• Edge AI demonstrations and experiments
• Unity applications that require on-device language-model inference
Requirements and limitations:
• Android only
• arm64-v8a only
• IL2CPP scripting backend required
• CPU inference backend
• Inference must be tested on an Android device
• Unity Editor inference is not supported
• Performance and memory usage depend on the Android device, model architecture, model size, quantization, context size, and runtime settings
• Compatibility with every GGUF model is not guaranteed
Third-party software:
This package uses llama.cpp and ggml under the MIT License, and LLVM libc++ under the Apache License 2.0 with LLVM Exceptions.
See the included THIRD_PARTY_NOTICES.md and license files for complete details.
From the publisher's Asset Store listing.
Technical details
Key features:
• Direct Unity C# to Android native runtime integration
• GGUF local language-model inference through llama.cpp
• Included native bridge/shim for Unity integration
• On-device and offline-capable inference
• No HTTP server required
• No WebSocket server required
• No Python environment required
• No cloud service required for local inference
• UTF-8-safe multilingual input and output handling
• Automatic chat-template application for compatible models
• Single-flight generation control
• Configurable context size, generation length, sampling, stop sequences, and runtime parameters
• Minimal Android chat sample scene
• Setup, Android build, and model-placement documentation
Runtime architecture:
Unity C#
→ P/Invoke
→ Android native shim
→ llama.cpp
→ GGUF local language model
Included Android native libraries:
• libc++_shared.so
• libggml-base.so
• libggml-cpu.so
• libggml.so
• libllama.so
• libllama_unity_shim.so
• libmtmd.so
Supported environment:
• Unity 2022.3 LTS
• Android
• arm64-v8a
• IL2CPP scripting backend
• CPU inference backend
Unity Editor execution:
The runtime does not execute local LLM inference inside the Unity Editor. Build and run the project on a supported Android device.
Model placement:
Place a compatible GGUF model on the Android device at:
Android/data/{your.package.name}/files/models/model.gguf
The actual package name must match the Android application identifier configured in Unity.
Important notes:
• GGUF model files are not included
• This package provides the local inference runtime and Unity integration layer
• Model compatibility is dependent on the llama.cpp runtime included with the package
• Inference speed varies significantly between Android devices
• Large models or context sizes may exceed the available device memory
Compatibility
| Unity version | Built-in | URP | HDRP |
|---|---|---|---|
| 2022.3.62f3 | Compatible | Compatible | Compatible |
As listed on the Asset Store.