Hello and congratulations for this amazing project :)

I'm facing some issues while running on local models (actually not tested with non local). The search allways works but the AI insights rarely works. What happens most of the time is that it starts to type but aventually, before finish, it throws an error like this: 500: Expecting ',' delimiter: line 1 column 7011 (char 7010) It's allways a different column though. I have tested with llama3 and mistral over ollama and I'm using searxng.

docker-compose.yml: `services: backend: build: context: . dockerfile: ./src/backend/Dockerfile restart: unless-stopped ports:

"8004:8000" environment:
OLLAMA_HOST=${OLLAMA_HOST}
TAVILY_API_KEY=${TAVILY_API_KEY}
BING_API_KEY=${BING_API_KEY}
SERPER_API_KEY=${SERPER_API_KEY}
OPENAI_API_KEY=${OPENAI_API_KEY}
GROQ_API_KEY=${GROQ_API_KEY}
ENABLE_LOCAL_MODELS=${ENABLE_LOCAL_MODELS}
SEARCH_PROVIDER=${SEARCH_PROVIDER}
SEARXNG_BASE_URL=${SEARXNG_BASE_URL:-http://host.docker.internal:8099}
REDIS_URL=${REDIS_URL} develop: watch:
- action: sync path: ./src/backend target: /workspace/src/backend extra_hosts:
"host.docker.internal:host-gateway" frontend: depends_on:
backend build: context: . dockerfile: ./src/frontend/Dockerfile restart: always environment:
NEXT_PUBLIC_API_URL=${NEXT_PUBLIC_API_URL}
NEXT_PUBLIC_LOCAL_MODE_ENABLED=${NEXT_PUBLIC_LOCAL_MODE_ENABLED} ports:
"3005:3000" develop: watch:
- action: sync path: ./src/frontend target: /app ignore:
  - node_modules/
searxng: container_name: searxngfarfalle image: docker.io/searxng/searxng:latest restart: unless-stopped ports:
"8099:8080" volumes:
./searxng:/etc/searxng:rw environment:
SEARXNG_BASE_URL=https://192.168.60.260:8099/`

.env `ENABLE_LOCAL_MODELS=True OLLAMA_HOST=http://192.168.60.234:11434 SEARCH_PROVIDER=searxng

searxng:8090

NEXT_PUBLIC_API_URL=http://192.168.60.260:8004 NEXT_PUBLIC_LOCAL_MODE_ENABLED=true`

Error Log:

rashadphz / farfalle

Random 500: Expecting ',' delimiter: line 1 column 7011 (char 7010) #44

SEARXNG_BASE_URL=http://searxng:8090