weaviate / Verba

Retrieval Augmented Generation (RAG) chatbot powered by Weaviate
BSD 3-Clause "New" or "Revised" License
6.4k stars 692 forks source link

Firecrawl doesn´t work, have to check api key, but key is correct #288

Closed Japhys closed 1 month ago

Japhys commented 2 months ago

Description

Signed up for firecrawl. Started off with a free plan to try it out. Got an api key. In docker compose I added:

  - FIRECRAWL_API_KEY=&FIRECRAWL_API_KEY

In .env file

  - FIRECRAWL_API_KEY=the actualkey from the firecrawl website

When I try to crawl a site I get an error straight away

Import for website failed: Reader Firecrawl failed with: Firecrawl was not able to load any documents, please check your API Key and settings

I should be able to do this with the free 500 credits. It's a site with only a 100 pages or so.

There is no way of setting the key via GUI for firecrawl right? Like you can for OpenAI and Cohere.

btw import from pdf in combination with OpenAI api key does work.

Installation

Weaviate Deployment

Configuration

Reader: Firecrawl Chunker: Sentence Embedder: OpenAI (this key do work!) Retriever: Advanced Generator: OpenAI

Steps to Reproduce

Whenever I click import selected I get an error straight away. But the key is correct.

Additional context

thomashacker commented 2 months ago

Thanks for the issue! I'll try to reproduce it If you set environment variables through the .env and Verba detects them on startup, they won't be shown to the UI, but I might change this so that you can always edit those.

I'll let you know once we have an update on this 🚀

Japhys commented 1 month ago

Made a typo! Embarrassing :(

$