Closed renovate[bot] closed 4 months ago
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 62.61%. Comparing base (
e3e99b3
) to head (63862e4
).
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
This PR contains the following updates:
3.9.2
->3.10.0
Release Notes
apify/crawlee (@crawlee/http)
### [`v3.10.0`](https://togithub.com/apify/crawlee/blob/HEAD/CHANGELOG.md#3100-2024-05-16) [Compare Source](https://togithub.com/apify/crawlee/compare/v3.9.2...v3.10.0) ##### Bug Fixes - `EnqueueStrategy.All` erroring with links using unsupported protocols ([#2389](https://togithub.com/apify/crawlee/issues/2389)) ([8db3908](https://togithub.com/apify/crawlee/commit/8db39080b7711ba3c27dff7fce1170ddb0ee3d05)) - conversion between tough cookies and browser pool cookies ([#2443](https://togithub.com/apify/crawlee/issues/2443)) ([74f73ab](https://togithub.com/apify/crawlee/commit/74f73ab77a94ecd285d587b7b3532443deda07b4)) - fire local `SystemInfo` events every second ([#2454](https://togithub.com/apify/crawlee/issues/2454)) ([1fa9a66](https://togithub.com/apify/crawlee/commit/1fa9a66388846505f84dcdea0393e7eaaebf84c3)) - use createSessionFunction when loading Session from persisted state ([#2444](https://togithub.com/apify/crawlee/issues/2444)) ([3c56b4c](https://togithub.com/apify/crawlee/commit/3c56b4ca1efe327138aeb32c39dfd9dd67b6aceb)) - do not drop statistics on migration/resurrection/resume ([#2462](https://togithub.com/apify/crawlee/issues/2462)) ([8ce7dd4](https://togithub.com/apify/crawlee/commit/8ce7dd4ae6a3718dac95e784a53bd5661c827edc)) - double tier decrement in tiered proxy ([#2468](https://togithub.com/apify/crawlee/issues/2468)) ([3a8204b](https://togithub.com/apify/crawlee/commit/3a8204ba417936570ec5569dc4e4eceed79939c1)) - Fixed double extension for screenshots ([#2419](https://togithub.com/apify/crawlee/issues/2419)) ([e8b39c4](https://togithub.com/apify/crawlee/commit/e8b39c41764726280c995e52fa7d79a9240d993e)), closes [#1980](https://togithub.com/apify/crawlee/issues/1980) - malformed sitemap url when sitemap index child contains querystring ([#2430](https://togithub.com/apify/crawlee/issues/2430)) ([e4cd41c](https://togithub.com/apify/crawlee/commit/e4cd41c49999af270fbe2476a61d92c8e3502463)) - return true when robots.isAllowed returns undefined ([#2439](https://togithub.com/apify/crawlee/issues/2439)) ([6f541f8](https://togithub.com/apify/crawlee/commit/6f541f8c4ea9b1e94eb506383019397676fd79fe)), closes [#2437](https://togithub.com/apify/crawlee/issues/2437) - sitemap `content-type` check breaks on `content-type` parameters ([#2442](https://togithub.com/apify/crawlee/issues/2442)) ([db7d372](https://togithub.com/apify/crawlee/commit/db7d37256a49820e3e584165fff42377042ec258)) ##### Features - add `FileDownload` "crawler" ([#2435](https://togithub.com/apify/crawlee/issues/2435)) ([d73756b](https://togithub.com/apify/crawlee/commit/d73756bb225d9ed8f58cf0a3b2e0ce96f6188863)) - implement ErrorSnapshotter for error context capture ([#2332](https://togithub.com/apify/crawlee/issues/2332)) ([e861dfd](https://togithub.com/apify/crawlee/commit/e861dfdb451ae32fb1e0c7749c6b59744654b303)), closes [#2280](https://togithub.com/apify/crawlee/issues/2280) - make `RequestQueue` v2 the default queue, see more on [Apify blog](https://blog.apify.com/new-apify-request-queue/) ([#2390](https://togithub.com/apify/crawlee/issues/2390)) ([41ae8ab](https://togithub.com/apify/crawlee/commit/41ae8abec1da811ae0750ac2d298e77c1e3b7b55)), closes [#2388](https://togithub.com/apify/crawlee/issues/2388) ##### Performance Improvements - improve scaling based on memory ([#2459](https://togithub.com/apify/crawlee/issues/2459)) ([2d5d443](https://togithub.com/apify/crawlee/commit/2d5d443da5fa701b21aec003d4d84797882bc175)) - optimize `RequestList` memory footprint ([#2466](https://togithub.com/apify/crawlee/issues/2466)) ([12210bd](https://togithub.com/apify/crawlee/commit/12210bd191b50c76ecca23ea18f3deda7b1517c6)) - optimize adding large amount of requests via `crawler.addRequests()` ([#2456](https://togithub.com/apify/crawlee/issues/2456)) ([6da86a8](https://togithub.com/apify/crawlee/commit/6da86a85d848cd1cf860a28e5f077b8b14cdb213)) #### [3.9.2](https://togithub.com/apify/crawlee/compare/v3.9.1...v3.9.2) (2024-04-17) ##### Bug Fixes - break up growing stack in `AutoscaledPool.notify` ([#2422](https://togithub.com/apify/crawlee/issues/2422)) ([6f2e6b0](https://togithub.com/apify/crawlee/commit/6f2e6b0ccb404ae66be372e87d762eed67c053bb)), closes [#2421](https://togithub.com/apify/crawlee/issues/2421) - don't call `notify` in `addRequests()` ([#2425](https://togithub.com/apify/crawlee/issues/2425)) ([c4d5446](https://togithub.com/apify/crawlee/commit/c4d54469120648a592b6898f849154fda60e3d59)), closes [#2421](https://togithub.com/apify/crawlee/issues/2421) ##### Features - **sitemap:** Support CDATA in sitemaps ([#2424](https://togithub.com/apify/crawlee/issues/2424)) ([635f046](https://togithub.com/apify/crawlee/commit/635f046b7933e0ad1b0ee627a22a9adaf21847d3)) #### [3.9.1](https://togithub.com/apify/crawlee/compare/v3.9.0...v3.9.1) (2024-04-11) ##### Features - `browserPerProxy` browser launch option ([#2418](https://togithub.com/apify/crawlee/issues/2418)) ([df57b29](https://togithub.com/apify/crawlee/commit/df57b2965ac8c8b3adf807e3bad8a649814fa213))Configuration
📅 Schedule: Branch creation - "every weekday" (UTC), Automerge - At any time (no schedule defined).
🚦 Automerge: Enabled.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR has been generated by Mend Renovate. View repository job log here.