su77ungr / CASALIOY

♾️ toolkit for air-gapped LLMs on consumer-grade hardware
Apache License 2.0
230 stars 31 forks source link

Stance towards original repo #62

Closed hippalectryon-0 closed 1 year ago

hippalectryon-0 commented 1 year ago

This was originally a fork of https://github.com/imartinez/privateGPT/. However the development speed on the main repo is very slow, and we're way ahead now.

In itself that's not an issue; even if they pick up the pace on privateGPT, they may go into another direction. What's bothering me is the huge amount of issues and PRs opened over there and left hanging, most of which are already solved here.

I really don't know what the right thing to do is - I'm not a pro of Github etiquette at all, but I guess that going over there and telling the issue openers "hey actually it's already fixed in our version" without prior authorisation from @imartinez isn't a great idea. Also, our repo has diverged a tad too much to be able to just merge it into privateGPT.

What do you think ?

su77ungr commented 1 year ago

This has been in my mind too lately. In the beginning I was hopping onto their issues to add some support but it seems like he wants to keep a simple boilerplate to offer a quick demo.

It's just a prototype to get you started and less akin to our toolkit approach. We could ask to request a mention of our page for an more embedded approach, where most issues have been fixed also.

Other than simplicity there's no real reason to use privateGPT due to less compatibility and performance.

su77ungr commented 1 year ago

Let's craft a PR and I'm gonna ping the https://github.com/imartinez/privateGPT/ to add us inside their README

su77ungr commented 1 year ago

Gonna do this tomorrow. Everyone feel free to add to this conversation.

alxspiker commented 1 year ago

I was doing some PRs over there but seemed like I was going to end up doing all the work. Going my own way as everyone kind of seems slow. https://github.com/alxspiker/AI-X

Planning to use your console script instead of my own so I can focus on the database and UI part of the development. Going to use my own at this moment as its already purposed towards what I need right now.

Its not actually in a working state right this second but I am planning to have it useable tonight. I just started working on the API so the python script can poll the web server to see if it needs to do anything. I am probably an hour or two away from having the chat working on a que system and streaming to the database so the users can see their message as its written.

Using a PHP server allows me to bypass a lot of the restrictions and dependencies python requires and speeds up development heavily for me.

atxcowboy commented 1 year ago

@alxspiker I can relate to your preference of PHP over Python. Personally, I've started my journey with a PHP-based open-source project over 20 years (PostNuke CMS), and PHP remains my language of choice. I completely understand the benefits of using PHP over PY with the dependencies. ;)

I'm really impressed by your progress so far and the whole current explosion of open source AI solutions reminds me of the time when I started!

I own a small hosting business and if you're interested, I'd be happy to donate any resources you may need for the public facing side of your projects. If you're interested, just drop me an email at hello@panomity.com or contact me on Wire messenger at @atxcowboy.

hippalectryon-0 commented 1 year ago

Keep us updated when the issue is up :)

su77ungr commented 1 year ago

https://github.com/imartinez/privateGPT/issues/303

su77ungr commented 1 year ago

He's a masochist: https://github.com/imartinez/privateGPT/pull/305

I'll close this for now. Maybe on my spare time writing a bot that repsonds to the issues over there.