Amica is an application that allows you to easily converse with 3D characters in your browser.
You can import VRM files, adjust the voice to fit the character, and generate response text that includes emotional expressions.
> **For Windows Users**: Please create a new folder for Amica during installation to prevent the unintentional deletion of other files during uninstallation.
The various features of Amica mainly use the following technologies:
- 3D Rendering
- [three.js](https://threejs.org/)
- Displaying 3D characters
- [@pixiv/three-vrm](https://github.com/pixiv/three-vrm)
- Running Transformers in the browser
- [Transformers.js](https://huggingface.co/docs/transformers.js/index)
- Speech recognition
- [Whisper](https://openai.com/research/whisper)
- Voice Activity Detection
- [Silero VAD](https://github.com/ricky0123/vad/)
- ChatBot
- [Llama.cpp server](https://github.com/ggerganov/llama.cpp)
- [ChatGPT API](https://platform.openai.com/docs/api-reference/chat) (compatible with projects such as [LM Studio](https://lmstudio.ai/))
- [Window.ai](https://windowai.io/)
- [Ollama](https://ollama.ai)
- [KoboldCpp](https://github.com/LostRuins/koboldcpp)
- Text-to-Speech
- [Coqui API](https://coqui.ai/)
- [Eleven Labs API](https://elevenlabs.io/)
- [Speech T5](https://huggingface.co/microsoft/speecht5_tts)
- [OpenAI](https://platform.openai.com/docs/guides/text-to-speech)
- Vision
- [Bakllava](https://github.com/SkunkworksAI/BakLLaVA)
## 🛠️ Installation and running
To run this project locally, clone or download the repository.
```bash
git clone git@github.com:semperai/amica.git
```
Install the required packages.
```bash
npm install
```
After installing the packages, start the development web server using the following command:
```bash
npm run dev
```
Once started, please visit the following URL to confirm that it is working properly.
[http://localhost:3000](http://localhost:3000)
### 📝 Configuration
Most of the configuration is done in the `.env.local` file. Reference the `config.ts` file for the available options.
```bash
amica
├── .env.local
├── src
│ ├── utils
│ │ └── config.ts
```
### 📦 Desktop Application
Amica uses [Tauri](https://tauri.app/) to build the desktop application.
To develop the desktop application, use the following command:
```bash
npm run tauri dev
```
## 📖 Documentation
View the [documentation](https://docs.heyamica.com) for more information on how to configure and use Amica.
## 📜 History
This project originated as a fork of ChatVRM by Pixiv:
[https://pixiv.github.io/ChatVRM](https://pixiv.github.io/ChatVRM)
## 🔒 License
* The majority of this project is released under the MIT license as found in the [LICENSE](https://github.com/semperai/amica/blob/master/LICENSE) file.
* Assets such as 3D models and images are released under their authors respective licenses.
## ✨ Star History
[![Star History](https://api.star-history.com/svg?repos=semperai/amica&type=Date)](https://star-history.com/#semperai/amica&Date)
## 🤗 Contributors