LLM for Unity

LLM for Unity enables seamless integration of Large Language Models (LLMs) within the Unity engine. It allows to create intelligent characters that your players can interact with for an immersive experience.

The package also features a Retrieval-Augmented Generation (RAG) system that allows to perform semantic search across your data.

Features

• 💻 Runs anywhere: PC, mobile or VR!
• ⚡ Blazing fast inference on CPU and GPU (Nvidia, AMD, Apple Metal)
• 🏠 Runs locally without internet access. No data ever leave your game!
• 📡 Supports remote server setup
• 🤗 Supports all major LLM models
• 🔍 Advanced RAG System (ANN search)
• 🔧 Easy to setup, call with a single line of code
• 💰 Free to use for both personal and commercial purposes

🧪 Tested on Unity: 2021 LTS, 2022 LTS, 2023, Unity 6

Business inquiries

For business inquiries you can reach out at [email protected].

How to use

See our quick start guide to start developing your LLM-enabled project.

You can check out our samples here.

How to help

• Leave us a review and spread the word about the project!
• Join us at Discord and say hi.
• Sponsor this work to allow even cooler features!

License

LLM for Unity is distributed under Apache 2.0 license.

The asset uses the llama.cpp library licensed under MIT and allows to download LLMs under Apache 2.0 and MIT licenses by default.

See the Third Party Notices.md file included in the package for details.