fix: Fix snapshots handling

apify / crawlee-python

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

https://crawlee.dev/python/

Apache License 2.0

4.64k stars 319 forks source link

fix: Fix snapshots handling #692

Closed Pijukatel closed 1 week ago

Pijukatel commented 1 week ago

Small fixes to snapshot handling:

Ensure time ordering of snapshots.
Remove fake time weight for samples from same time.
Remove unnecessary reversing of snapshot.
Add test for memory and cpu snapshot ordering.