AI-IntelArc-ArchLinux
Master repository for AIIAAL - A one-stop framework for popular AI related software for Arch Linux users with Intel Arc GPUs.
Recent Dev Notes:
##### From JT/OCD: #####
I know I need to put out some documentation on how to use this "framework", so bare with me. The development is pretty fluid right now and I'm changing how I do things on the fly. Once I've got my structure hammered down, I'll create a comprehensive guide and FAQ section so you all can get to using it.
6/2/2024
- I've been refining the installers focusing on ollama+OpenWebUI and fooocus. I'm happy to say that they are working well within the python3.11 environment.
- I've noticed that sometimes there's red version mismatch error messages that will pop up with pip, but these "incompatible" versions work just fine, but testing is ongoing...just a heads-up
- I've added a "SHARED" folder to the primary AIIAAL directory to make it easier to use the same files for different programs, if possible. I'm still trying to tie that into ollama+OpenWebUI, but it's being a PITA. Shoot me a msg if you can get those symlink locations working. Fooocus uses these just fine without any issue at this point.
How You Can Support Development
- Please consider supporting me with Buy Me A Coffee!
- Get the buzz out by reviewing and sharing on social networks like Facebook, Twitter (formerly), etc...
- Consider purchasing something from the Amazon wishlist...items I always need more of. (Mouses, Keyboards, Storage, etc...)
Features
Features installers and creates launchers for:
| AI Software | Status | Development Phase Notes |
|---|---|---|
| Ollama + Open WebUI |
Functional Testing |
* Installs, GPU recognized with Ipex/oneAPI. * Testing is ongoing. |
| CrewAI | WIP Testing |
* Could not use crewai[tools] due to package conflicts, but standard version installs without error * Testing is ongoing. |
| Fooocus | Recent update wrecked WIP..again |
* Installs, opens in browser, and generates images using the GPU (xpu). * I am currently working on adding API for use with ollama/Open WebUI. * I have a working standalone. I will leave it up for the time being. |
| Forge (Automatic 1111) |
Functional-ish | * I've successfully gotten it working and making images but seems slow. * Testing is ongoing beyond that. |
| Automatic 1111 (stable-diffusion-webui) |
WIP | I have a working standalone. Currently attempting to modify for AIIAAL. |
| Roop Unleashed |
WIP | I have a working standalone. Currently attempting to modify for AIIAAL. |
REQUIREMENTS
This framework assumes that you have these already installed:
- Arch Linux based OS - Duh...
- Intel Arc GPU - Duh...
- The latest Intel Arc GPU drivers
- Python 3.11 (can be found in the AUR as 'python311')
Installation Is Easy
Simply run (as a standard user, not root) the installation bash file (ex: AIIAAL-install.sh, AIIAAL-install-ollama.sh, etc...) for the package you want to install. Yeah...it's that easy!
- Note: AIIAAL needs to be already installed before using the other installers. AIIAAL is the framework the others are built on. You only need to install the framework (AIIAAL) once.
- SOME packages, like FORGE, may shutdown after the first run. That's not my doing, but it seems that those packages need to create their own configs. Run your launcher again afterward and it should load up.
- SOME packages may throw out some python package version mismatch errors during installation, but I've found that they don't seem to have an impact and can be ignored.
- This framework is HEAVILY reliant on a few packages released by Intel (Ipex, Intel-Extension-For-Pytorch, etc...) and we are all limited to their progress at this point. Keep that in mind going forward.