search

TheBlewish / Automated-AI-Web-Researcher-Ollama

A python program that turns an LLM, running on Ollama, into an automated researcher, which will with a single query determine focus areas to investigate, do websearches and scrape content from various relevant websites and do research for you all on its own! And more, not limited to but including saving the findings for you!
MIT License
2.06k stars 200 forks source link

Stuck after scraping papers #24

Closed lihaoxin2020 closed 2 days ago

lihaoxin2020 commented 4 days ago

Hi,

Thanks for the great work!

In my experience the bot stuck while searching. Screenshot attached below. what could be the bottleneck? GPUs seem not involved in this process.

thanks!

image
slyfox1186 commented 3 days ago

If you have any experience with pytest you might utilize it to get you HQ error reports.

I as well had issues with this.

TheBlewish commented 3 days ago

like it would just stay on that screen? Not doing anything? I have never seen that despite the heaps of testing I did with it! What does it say when you do the s command?

slyfox1186 commented 3 days ago

I am on Windows 11 WSL 2 Ubuntu 24.04. Lets start there and I will see if I can get you any more as soon as I can.

synth-mania commented 3 days ago

I actually may have run into a similar issue once. The program runs mostly fine on my RTX 3090 workstation, but on my 16gb RAM laptop even though the model loaded it would not generate any research summary, despite listing sources etc. Curious.

lihaoxin2020 commented 3 days ago

i'm running on dual 4090 wsl2 with RAM 24G. Mem could be an issue but I'm not sure.

like it would just stay on that screen? Not doing anything? I have never seen that despite the heaps of testing I did with it! What does it say when you do the s command?

Screenshot 2024-11-21 at 11 39 34 PM

@TheBlewish it does move after a long while, sometimes fail to scraped the webpage and sometimes take another long while to search like above.

@slyfox1186 @synth-mania Thanks guys! pls lmk if you find anything else relevant

TheBlewish commented 2 days ago

Yeah well windows is not really fully supported yet, a kind individual is in the process of making a windows compatible version right now that i'll send you a link to when it's ready