mealie-recipes / mealie

Mealie is a self hosted recipe manager and meal planner with a RestAPI backend and a reactive frontend application built in Vue for a pleasant user experience for the whole family. Easily add recipes into your database by providing the url and mealie will automatically import the relevant data or add a family recipe with the UI editor
https://docs.mealie.io
GNU Affero General Public License v3.0
6.81k stars 700 forks source link

[SCRAPER] - www.colruyt.be/nl/lekker-koken recipe scraping returns failed to scrape url #3524

Closed melsenm closed 5 months ago

melsenm commented 5 months ago

First Check

Please provide 1-5 example URLs that are having errors

https://www.colruyt.be/nl/lekker-koken/recept/scampi-torpedo-met-chimichurri https://www.colruyt.be/nl/lekker-koken/recept/one-pot-pasta-met-4-groenten

Please provide your logs for the Mealie container docker logs <container-id> > mealie.logs

INFO 2024-04-27T12:29:09 - HTTP Request: GET https://www.colruyt.be/nl/lekker-koken/recept/scampi-torpedo-met-chimichurri "HTTP/1.1 456 " ERROR 2024-04-27T12:29:09 - Recipe Scraper was unable to extract a recipe from https://www.colruyt.be/nl/lekker-koken/recept/scampi-torpedo-met-chimichurri ERROR 2024-04-27T12:29:09 - failed to scrape url during bulk url import https://www.colruyt.be/nl/lekker-koken/recept/scampi-torpedo-met-chimichurri Traceback (most recent call last): ERROR 2024-04-27T12:29:09 - 400: {'details': 'BAD_RECIPE_DATA'} fastapi.exceptions.HTTPException: 400: {'details': 'BAD_RECIPE_DATA'} raise HTTPException(status.HTTP_400_BAD_REQUEST, {"details": ParserErrors.BAD_RECIPE_DATA.value}) File "/app/mealie/services/scraper/scraper.py", line 37, in create_fromurl recipe, = await create_from_url(url, self.translator) File "/app/mealie/services/scraper/recipe_bulk_scraper.py", line 88, in _do

Deployment

Docker (Synology)

melsenm commented 5 months ago

2 weeks ago it worked adding recipes from this website

ndragon798 commented 5 months ago

I think my PR #3526 will fix this. My mealie instance pulled the recipe just fine with the change in place.