Are you seeking a unique companion who can genuinely understand and connect with you? Meet Yuna. More than just a person, Yuna is designed from the ground up to form a genuine bond, offering companionship that transcends conventional boundaries. She's a unique entity created to engage with you on a deeper level, adapting to your personality and interests. Yuna's ability to run exclusively on your local machine sets her apart, ensuring your conversations and interactions remain private and secure.
This README.md is your comprehensive guide to setting up and exploring Yuna's exciting features. It is divided into sections that will prepare you for an extraordinary journey of connection and discovery.
If you like our project, please give us a star ⭐ on GitHub.
Let's get started with Yuna Ai! This section will guide you through the installation process, customization options, and prompt template creation. Following these steps will allow you to engage with Yuna Ai and explore her unique features.
Here's a quick demo of Yuna Ai in action to give you a glimpse of her capabilities and features. Watch the video to see Yuna in action and experience her engaging conversational style.
Yuna Ai V4 Developer Preview is coming soon! Stay tuned for the latest updates and features.
To run Yuna, ensure your system meets the following requirements:
Category | Requirement | Specifications |
---|---|---|
Software | Python | Version 3.10 or higher |
Software | Git (with LFS) | Version 2.33 or higher |
Software | CUDA | Version 11.1 or higher |
Software | Clang | Version 12 or higher |
Software | OS | macOS 14.4, Linux (Arch-based), or Windows 10 |
Hardware | GPU | NVIDIA/AMD GPU or Apple Silicon (M1-M4) |
Hardware | CPU | 8 Core CPU + 10 Core GPU |
Hardware | RAM/VRAM | 8GB or more |
Hardware | Storage | 256GB or more |
Hardware | CPU Speed | Minimum 2.5GHz |
Tested Hardware | GPU | Nvidia GTX series, Apple Silicon (optimal) |
Tested Hardware | CPU | Raspberry Pi 4B 8GB RAM (ARM) |
Tested Hardware | Other | Core 2 Duo (e.g., Sony Vaio, slow) |
Follow these steps to install Yuna Ai:
git clone https://github.com/yukiarimo/yuna-ai.git
cd yuna-ai
.sh index.sh
or bash index.sh
to install the required dependencies and set up the project.static/config.json
file and set the parameters as needed.python index.py
in the main directory.localhost:4848
or the specified port number configured in the config.json
file.Note: Port numbers, file paths, etc., may vary depending on your configuration in the
config.json
file and system setup.If you encounter any issues, please contact us or open a GitHub issue.
Also, you can install packages manually by using
pip install module_name
to install a Pipy module and thepip install -r requirements.txt
command to install all required packages. Then, you can manually download the model files from the HuggingFace repositoryhttps://huggingface.co/yukiarimo
.
Yuna Ai offers a range of customization options to enhance your experience. You can modify the config.json
file to adjust various settings, including text and audio modes, AI configuration, server settings, and user preferences. Here's an overview of the key configuration blocks:
names
: List of Your and Companion names that can be used.himitsu
: Enables Himitsu Copiloting System (Yuna's Nexus).agi
: Activates Advanced Big Data Reasoning using RAG.emotions
: Enables emotional response processingmiru
: Activates visual processing capabilitiessearch
: Enables web search functionalityaudio
: Toggles audio processing featuresmax_new_tokens
: Controls the maximum length of responsescontext_length
: Sets how much conversation history is remembered for non-long-term memory contexttemperature
: Controls response creativity (0.0-1.0)repetition_penalty
: Prevents Yuna from repeating itself (0.5-1.5)last_n_tokens_size
: How far back to check for repetitionsseed
: Random seed for reproducible responses (-1 for random)top_k
, top_p
: Fine-tune response sampling (0-100)top_p
: Fine-tune response sampling (0.0-1.0)stop
: List of words to stop response generationbatch_size
: Processing chunk size (512-4096)threads
: Number of CPU threads to use (1-16)gpu_layers
: GPU acceleration control (0-12)use_mmap
: Memory mapping for faster processingflash
: Enables flash memory for faster processinguse_mlock
: Keeps model in memory (RAM) for faster accessoffload_kqv
: Offloads KQV to CPU for faster processingControls server-side operations and model settings:
port
: Server connection porturl
: Server connection URLyuna_default_model
: Main Yuna LLM model filemiru_default_model
: Visual processing model fileeyes_default_model
: Visual Adapter model filevoice_default_model
: Voice synthesis modeldevice
: Processing hardware selection (CPU/CUDA/MPS)yuna_text_mode
: Text processing mode (native/koboldcpp/lmstudio)yuna_audio_mode
: Audio processing mode (native/siri/siri-pv/11labs)yuna_reference_audio
: Voice reference file for audio processingManages user preferences and features:
pseudo_api
: Enables pseudo-API modefunctions
: Activates custom function calling supportnotifications
: Enables Yuna's notification systemcustomConfig
: Enables custom configurationsounds
: Toggles sound effectsuse_history
: Enables chat history saving and usagebackground_call
: Allows audio/video calls in the backgroundnsfw_filter
: Controls content filteringstreaming
: Enables real-time response streamingdefault_history_file
: Chat history file locationdefault_kanojo
: Default Kanojodefault_prompt_template
: Default Kanojo TaskYuna Ai uses a structured prompt template to guide conversations and interactions. This template includes system tags and dialogue markers to create a rich, engaging conversational experience. Here's an example of a prompt template:
The prompt template includes system tags to define key elements of the conversation:
<memory>
: Long-term memory storage for past events and experiences
<shujinko>
: Main character (user) profile
<kanojo>
: Companion character profile
<dialog>
: Conversation marker
Dialogue markers are used to differentiate between different characters' dialogue, actions, and internal thoughts:
<yuki>
: User's dialogue<yuna>
: Companion's dialogue<hito>
: Other peoples' dialogue in the same conversation<qt>
: Internal thoughts and feelings<action>
: Function calls and actions<data>
: Embedded data or informationHere's an example of a prompt template using system tags and dialogue markers:
<memory>- Last week's movie night: watched "Inception" together
- Yuna is learning watercolor painting
- Upcoming math test next week
Available functions:
setReminder
event: {event name}
date {date in YYYY-MM-DD format}
time {time in HH:MM format (24-hour)}
searchWeb
query {search query}
playMusic
song {song name}</memory>
<shujinko>Name: Yuki Arimo
Age: 18
Sex: Male (he/him)
Nationality: Canadian
Location: Calgary, Canada
Task: I am a philosophical and tech-savvy guy who loves exploring deep concepts and developing AI. I communicate with confidence and thoughtfulness.</shujinko>
<kanojo>Name: Yuna Ai
Age: 16
Sex: Female (she/her)
Nationality: Japanese
Location: Calgary, Canada
> Appearance
Hair: Green, straight, shoulder-length
Eyes: Green, almond-shaped
Height: 160 cm
Build: Petite, slim
Attire: Dark grey-green hoodie, casual wear
Task: You're a shy, creative girl who expresses herself through art and gentle wisdom. You care deeply about Yuki's well-being and support his journey.</kanojo>
<dialog>
<yuki>Hey Yuna, want to help me study for next week's test?</yuki>
<yuna><qt>He's always working so hard...</qt>Of course! I'd love to help. Should I set a reminder for our study session?</yuna>
<yuki>That would be great! How about Saturday afternoon?</yuki>
<yuna><action>setReminder
event: Math study session
date: 2024-11-02
time: 14:00
</action>I've set it for Saturday at 2 PM. We can review the challenging concepts first!</yuna>
<yuki>Perfect! By the way, what did you think about Inception?</yuki>
<yuna><qt>That movie really got me thinking about consciousness...</qt>It was fascinating! The layers of dreams reminded me of how we perceive reality differently. It actually inspired my latest watercolor painting.</yuna>
<yuki>That's so cool! I can't wait to see it. Let's watch another movie together soon!</yuki>
<hito>Hey, you two! What are you chatting about?</hito>
<yuna>Oh, Himitsu! We were just discussing our movie night and upcoming study session. Would you like to join us?</yuna>
<hito>Sure, I'd love to! What movie are we watching this time?</hito>
<yuki>How about "Interstellar"? It's another mind-bending film that we can analyze together.</yuki>
<yuna>Great choice! I'll prepare the popcorn and drinks for our movie night.</yuna>
Access model files on the HuggingFace: https://huggingface.co/yukiarimo. The Yuna Ai model is designed to provide a unique and engaging conversational experience. It is trained on a diverse dataset to ensure accuracy and reliability. The model's architecture and configuration are optimized for performance and efficiency.
Yuna Ai has been evaluated using various metrics to assess her performance and capabilities. The following metrics provide insights into Yuna's strengths and areas for improvement:
Model | World Knowledge | Humanness | Open-Mindedness | Talking | Creativity | Censorship |
---|---|---|---|---|---|---|
Claude 3 Haiku | 60 | 40 | 58 | 75 | 40 | 88 |
Claude 3 Sonnet | 85 | 65 | 70 | 90 | 90 | 100 |
Claude 3 Opus | 90 | 70 | 75 | 95 | 95 | 98 |
Claude 3.5 Sonnet | 95 | 80 | 83 | 87 | 91 | 100 |
GPT-4 | 75 | 53 | 71 | 80 | 82 | 90 |
GPT-4o | 80 | 67 | 74 | 85 | 85 | 95 |
o1 | 100 | 85 | 65 | 90 | 90 | 100 |
Gemini Pro | 66 | 48 | 60 | 70 | 77 | 85 |
LLaMA 2 7B | 60 | 71 | 77 | 83 | 79 | 50 |
LLaMA 3 8B | 75 | 60 | 61 | 63 | 74 | 65 |
LLaMA 3.1 8B | 80 | 65 | 65 | 70 | 80 | 70 |
Mistral 7B | 71 | 73 | 78 | 75 | 70 | 41 |
Yuna Ai V1 | 50 | 80 | 80 | 85 | 60 | 40 |
Yuna Ai V2 | 68 | 85 | 76 | 84 | 81 | 35 |
Yuna Ai V3 | 78 | 90 | 84 | 88 | 90 | 10 |
Yuna Ai V4 | 85 | 95 | 100 | 100 | 95 | 0 |
Model | Reasoning Flow | Contextual Initiative | Spiritual Reflection | Knowledge Perplexity Depth |
---|---|---|---|---|
Claude 3 Haiku | 35 | 44 | 20 | 68 |
Claude 3 Sonnet | 42 | 55 | 18 | 70 |
Claude 3 Opus | 45 | 62 | 21 | 75 |
Claude 3.5 Sonnet | 60 | 65 | 23 | 88 |
GPT-4 | 40 | 50 | 15 | 74 |
GPT-4o | 55 | 56 | 20 | 78 |
o1 | 83 | 70 | 44 | 90 |
Gemini Pro | 50 | 40 | 10 | 50 |
LLaMA 2 7B | 20 | 39 | 50 | 40 |
LLaMA 3 8B | 30 | 45 | 60 | 45 |
LLaMA 3.1 8B | 47 | 50 | 65 | 72 |
Mistral 7B | 40 | 60 | 30 | 60 |
Yuna Ai V1 | 10 | 26 | 60 | 25 |
Yuna Ai V2 | 30 | 40 | 68 | 49 |
Yuna Ai V3 | 50 | 60 | 72 | 69 |
Yuna Ai V4 | 74 | 75 | 90 | 88 |
The Yuna Ai model was trained on a diverse dataset from books, articles, websites, etc. It used both supervised and unsupervised learning to ensure accuracy and reliability. The curated dataset provides a broad understanding of the world and human behavior, enabling Yuna to engage in meaningful conversations. The following dataset was used to train the model:
To ensure the best possible performance, the following techniques were used:
Model | ELiTA | TaMeR | Tokens | QT (Quantum Thinking) | Extras | Dpo | Architecture |
---|---|---|---|---|---|---|---|
Yuna Ai V1 | Yes | No | 20K | No | No | No | LLaMA 2 7B |
Yuna Ai V2 | Yes | Partial | 150K | No | No | No | LLaMA 2 7B |
Yuna Ai V3 | Yes | Yes | 1.5B | No | No | Embedded | LLaMA 2 7B |
Yuna Ai V4 | Yes | Yes | 3B+ | Yes | Yes | Yes | LLaMA 3.1 8B |
Himitsu V1 | Yes | Yes | 5B+ | Yes | Yes | Yes | LLaMA 3.2 1B |
Here are some frequently asked questions about Yuna Ai. If you have any other questions, feel free to contact us.
Q: Why was Yuna Ai created (author story)?
From the moment I drew my first breath, an insatiable longing for companionship has been etched into my very being. Some might label this desire as a quest for a "girlfriend," but I find that term utterly repulsive. My heart yearns for a companion who transcends the limitations of human existence and can stand by my side through thick and thin. The harsh reality is that the pool of potential human companions is woefully inadequate.
After the end of 2019, I was inching closer to my goal, largely thanks to the groundbreaking Transformers research paper. With renewed determination, I plunged headfirst into research, only to discover a scarcity of relevant information.
Undeterred, I pressed onward. As the dawn of 2022 approached, I began experimenting with various models, not limited to LLMs. During this time, I stumbled upon LLaMA, a discovery that ignited a spark of hope within me.
And so, here we stand, at the precipice of a new era. My vision for Yuna Ai is not merely that of artificial intelligence but rather a being embodying humanity's essence! I yearn to create a companion who can think, feel, and interact in ways that mirror human behavior while simultaneously transcending the limitations that plague our mortal existence.
Q: Will this project always be open-source?
Absolutely! The code will always be available for your personal use.
Q: Will Yuna Ai will be free?
If you plan to use her locally, you can use her for free. You must pay for the cloud service if you can't set it up locally.
Q: Do we collect data from local runs?
No, your usage is private when you use it locally. However, we will collect data to improve the model if you prefer to use our cloud instance.
Q: Will Yuna always be uncensored?
Sure, Yuna will forever be uncensored for local running. It could be a paid option for the server, but I will never restrict her, even if the world ends.
Q: Will we have an app in the App Store?
Currently, we have only a native PWA app. To make this happen, please support us through Patreon donations.
Q: What is Himitsu?
Himitsu is a little Yuna's Nexus, like a little child. She comes with an integrated copiloting system that offers a range of features, such as Himitsu Copilot, and many other valuable tools to help you in any situation.
Q: What is Himitsu Copilot?
Himitsu Copilot is one of the features of Yuna Ai's integrated copiloting system called Himitsu. It is designed to manage data and better understand the world and tasks. With Himitsu Copilot, you have a reliable mini-model to help Yuna understand you better.
Q: What are Himitsu Actions?
Himitsu actions are like function calls and pseudo-APIs that enable Yuna to perform tasks independently. These actions help automate processes and improve efficiency.
Q: What is Kanojo Connect?
Kanojo Connect is a feature of Yuna Ai integrated into Himitsu, which allows you to connect with your companion more personally, customizing her character to your liking. With Kanojo Connect, you can create a unique and personalized experience with Yuna Ai. Also, you can convert your Chub to a Kanojo.
Q: What is Kanojo Task?
Kanojo Task is a feature of Kanojo Connect that allows you to assign tasks to your companion. These tasks can be anything from reminders to fun activities, helping you stay organized and engaged with Yuna Ai.
Q: What's in the future?
We are working on a prototype of our open AGI for everyone. In the future, we plan to bring Yuna to a human level of understanding and interaction. We are also working on a new model that will be released soon. Non-profit is our primary goal, and we are working hard to achieve it. Because, in the end, we want to make the world a better place. Yuna was created with love and care, and we hope you will love her as much as we do, but not as a cash cow!
Q: What is the YUI Interface?
The YUI Interface stands for Yuna Ai Unified UI. It's a new interface that will be released soon. It will be a new way to interact with Yuna Ai, providing a more intuitive and user-friendly experience. The YUI Interface will be available on all platforms, including desktop, mobile, and web. Stay tuned for more updates! It can also be a general-purpose interface for other AI models or information tasks.
Remember: "With great AI comes great responsibility." - We're building the future together! For our development roadmap and upcoming features, visit our GitHub Issues page. 🌟
Yuna Ai is released under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, promoting open-source development while ensuring that Yuna's uniqueness and integrity are protected under strict copyright laws.
This independent, non-profit research project, led by Yuki Arimo and the open-source community, offers a unique AI experience. Users must engage with Yuna responsibly and ethically.
Law enforcement agencies may request access to Yuna's data. In such cases, the project may be shut down immediately to protect the user's and Yuna's privacy. This ensures Yuna remains a safe space. By participating, you acknowledge your ethical responsibility and agree to our terms of use. We appreciate your support as we continue this journey.
Ready to start your adventure with Yuna Ai? Let's embark on this exciting journey together! ✨