search

hhursev / recipe-scrapers

Python package for scraping recipes data
MIT License
1.61k stars 505 forks source link

Update Madewithlau #1068

Closed mlduff closed 2 months ago

mlduff commented 2 months ago

Looks like madewithlau.com underwent some changes in their website. The new website uses a tRPC API to load data after the initial page load. There is some fairly complex cross-referencing of returned data, hence the complexity of this PR.

I also added a utility to get the URL slug.

Resolves https://github.com/hhursev/recipe-scrapers/issues/1015

mlduff commented 2 months ago

@jayaddison Test should be added - let me know if you want more tests

jayaddison commented 2 months ago

@mlduff this has been included and released in v14.56.0 (and also the pre-release v15.0.0-rc3) of recipe-scrapers on PyPi.

jayaddison commented 2 months ago

Ah, a correction, sorry - this is included in v14.56.0 but not included in v15.0.0-rc3 (since the v15 branch does not currently include scrapers that require more than the initial HTTP network request to retrieve HTML).