mealie-recipes / mealie

Mealie is a self hosted recipe manager and meal planner with a RestAPI backend and a reactive frontend application built in Vue for a pleasant user experience for the whole family. Easily add recipes into your database by providing the url and mealie will automatically import the relevant data or add a family recipe with the UI editor
https://docs.mealie.io
GNU Affero General Public License v3.0
7.32k stars 731 forks source link

[thekitchn] - 403 forbidden #4091

Closed ianepreston closed 1 month ago

ianepreston commented 2 months ago

First Check

Please provide 1-5 example URLs that are having errors

https://www.thekitchn.com/enchilada-casserole-263079 https://www.thekitchn.com/herby-french-lentil-salad-recipe-23201023

Please provide your logs for the Mealie container docker logs <container-id> > mealie.logs

INFO 2024-08-24T13:49:01 - [127.0.0.1:38566] 200 OK "GET /api/app/about HTTP/1.1" INFO 2024-08-24T13:49:01 - HTTP Request: GET https://www.thekitchn.com/enchilada-casserole-263079 "HTTP/1.1 403 Forbidden" INFO 2024-08-24T13:49:01 - [192.168.15.5:0] 400 Bad Request "POST /api/recipes/create-url HTTP/1.1"

Deployment

Docker (Linux)

pem884 commented 2 months ago

I'm here for the same reason, figure it couldn't hurt to find the issues that I found before arriving here.

In this repo: #3404 ...and the above referenced issue directed me to one in the scraper's repo: https://github.com/hhursev/recipe-scrapers/issues/1148

Hope this is useful!

Kuchenpirat commented 2 months ago

Deleted spam comments

death2all110 commented 2 months ago

This doesn't appear to be a mealie issue. but a scraper/website issue. It seems that the site is trying to prevent being scraped by AI and the scraper library mealie uses was caught in the crossfire.

github-actions[bot] commented 1 month ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.