search

iyaja / llama-fs

A self-organizing file system with llama 3
MIT License
4.49k stars 259 forks source link

feat: make incognito work #44

Open barakplasma opened 2 weeks ago

barakplasma commented 2 weeks ago

closes #24

Implements incognito mode, and removes the groq api key floating around various places. Aggresively defaults to localai in order to avoid sending people's files to groq accidentally.

I think it's a breaking change to require ollama, which is actually needed to support image categorization.

P.S. I'm having trouble with create_file_tree, I can't figure out how to pass the incognito request to that function.

Also I did not test this outside the /batch endpoint from the api. So someone else should test the electron app / watch util if they care about it.

barakplasma commented 2 weeks ago

I still haven't gotten it to work consistently, so I changed it to a draft PR.

barakplasma commented 2 weeks ago

Ironically, my manual tests using groq finish in time, but my manual tests with ollama are too slow to finish, or it's not using a capable enough model on my machine.