search

ItzCrazyKns / Perplexica

Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI
MIT License
16.79k stars 1.57k forks source link

Reddit mode returns broken/incorrect links #186

Open Amirjab21 opened 5 months ago

Amirjab21 commented 5 months ago

Describe the bug Reddit mode often hallucinates reddit posts and will give broken/non-existant links.

To Reproduce

  1. Go to Reddit mode
  2. Ask for posts about a topic e.g successful posts about fashion and ask for the URLs
  3. Check the links

Expected behavior Expect the links to be functional and relevant to the topic

Screenshots If applicable, add screenshots to help explain your problem.

Additional context This was using local LLama3. I'm happy to assist with this work. I think the reddit agent needs to be modified to double check that the links being returned are still working.

Deathproof76 commented 1 month ago

In my case the links are intact but seldom related to the search query and there are no source references in the answer. When I try a direct search with searxng via the !re prefix (reddit only search), I can see that the results may contain the searchterm, but oftentimes in a less significant context or a less preferable prioritization/order .🤷‍♂️

update: When I don't ask a question in perplexica and use focus mode with reddit only like "google" as a simple search engine with keyword, I experience the same problem. Completed hallucinated sources without links. This with mistral-nemo and also the newer mistral-small model via ollama. So far this seems to be contained to the reddit focus.