katanaml / sparrow

Data processing with ML and LLM
https://katanaml.io
GNU General Public License v3.0
3.44k stars 357 forks source link

Making it work on Windows machine #66

Closed hlpr3 closed 1 week ago

hlpr3 commented 3 weeks ago

Hey thanks for the great sharing ! However I'm struggling to make it work on a Windows system. Could you please look into it and help troubleshoot WSL installation ?

Best!

abaranovskis-redsamurai commented 3 weeks ago

Hi, im developing Sparrow on macOS, didnt had time to test it on Windows. Why you are using WSL? Install Python directly on Windows, it will work.

RockyNiu commented 3 weeks ago

If you would like to install sparrow directly on Windows, the major issue is how to install python-poppler for ocr. Following this instruction:

WSL would be better option to my opinion.

@hlpr3 the quick way on WSL: copy the errors into copilot and ask for solutions. It's not a big deal, and just need to install many additional packages. It would take much long time to install all packages when pip install -r requirements.txt

Here is the list I did:

sudo apt-get update
sudo apt-get install -y make build-essential libssl-dev zlib1g-dev libbz2-dev libreadline-dev libsqlite3-dev wget curl llvm libncurses5-dev libncursesw5-dev xz-utils tk-dev libffi-dev liblzma-dev python-openssl git poppler-utils libpoppler-cpp-dev

then install python-poppler pip install -v -v python-poppler

RockyNiu commented 2 weeks ago

@hlpr3 there is one more things for WSL. Since WSL is not in the same network with host, you could not directly call localhost:11434 to query ollama. But you could easily resolve this issue by enabling mirrored mode networking.