neokd / NeoGPT

Chat effortlessly, execute commands, and interpret code with Llama3, Phi3, and more - your local AI assistant. Enjoy seamless interaction while ensuring ultimate privacy
https://neogpt.dev
MIT License
78 stars 64 forks source link

fix: fix python version to have the docker build working #81

Closed ha36d closed 11 months ago

ha36d commented 11 months ago

resolves #79 Last version of torch is not compatible with python >= 3.12, therefore the version of python is fixed to 3.11. Bump auto-gptq to the latest version, as there was bugs.

neokd commented 11 months ago

Does it work after bumping auto-gptq?

ha36d commented 11 months ago

Does it work after bumping auto-gptq?

Yes.

ha36d commented 11 months ago

Done.

neokd commented 11 months ago

@hamed thanks for the contribution

neokd commented 11 months ago

@ha36d the issue still persist when i run. Can you provide the commands to run properly?

ha36d commented 11 months ago

@ha36d the issue still persist when i run. Can you provide the commands to run properly?

@neokd for me, it is working with the following command: docker build -f Dockerfile . -t neogpt It takes time, but finishes successfully.

neokd commented 11 months ago

Is there any requirement to upgrade python ? in the container?

neokd commented 11 months ago

It says auto-gptq 0.4.2 not found and asks me to upgrade pip. I have updated pip in the dockerfile and when ran again i get the #82 issue

ha36d commented 11 months ago

It seems some cache issues. can you please delete the docker images and layers related to neogpt?

ha36d commented 11 months ago

also I see that dev-requirement.txt is renamed to dev-requirements.txt without chaning the references in dockerfile.

neokd commented 11 months ago

there aren't any images that i have built successfully till now

ha36d commented 11 months ago

I can add a docker test/lint/build job with Github Actions if you have a docker repository to push the image.

neokd commented 11 months ago

No currently we don't have a docker repository. Is there any other way to run it locally?

ha36d commented 11 months ago

No, I guess there is an environment issue, as the pip is up to date, the version 0.4.2 of auto-gptq exists.

neokd commented 11 months ago

How can we fix it?

ha36d commented 11 months ago

As I said, I think it is your local env that has an issue. I proposed to have a docker build (even without push) pipeline to show you that it works well in Github Actions.

neokd commented 11 months ago

Yeah you can create an issue and work on it

ha36d commented 11 months ago

Yeah you can create an issue and work on it

https://github.com/neokd/NeoGPT/issues/87