mendableai / firecrawl

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
https://firecrawl.dev
GNU Affero General Public License v3.0
7.38k stars 539 forks source link

[BUG] Success true but no data in python sdk #247

Open nickscamara opened 1 month ago

nickscamara commented 1 month ago
if response.status_code == 200:
24
            response = response.json()
25
            if response['success'] == True:
26
                return response['data']
27
            else:
28
                raise Exception(f'Failed to scrape URL. Error: {response["error"]}')

This code snippet is failing on customers' response from Firecrawl.

If 'success' is true, we should always have 'data' in the response.

Although there might be an issue where bull takes a couple millsienconds to update data when success is true.

mattjoyce commented 4 weeks ago

@nickscamara do you have any details on how to recreate the symptom?

SaaS or Self-host? (assume 'customer' means SaaS)

Which scraper?

Specific URL?

nickscamara commented 3 weeks ago

Let me check...

AlexanderKozhevin commented 1 week ago

sorry, how to use python SDK with self hosted version? @mattjoyce @nickscamara

rafaelsideguide commented 6 days ago

@AlexanderKozhevin you can initialize the app with the api_url param. Something like this

app = FirecrawlApp(api_key="fc-", api_url="http://localhost:3002")

Just make sure the api_url matches your self-hosted one.


On this issue. @nickscamara I'm adding the stale label.