This pull request includes several updates to the scrapegraphai/docloaders/chromium.py file, focusing on improving the readability and functionality of the scraping methods. The most important changes include adding support for storage_state in the Playwright scraping methods and reformatting code for better readability.
Enhancements to scraping methods:
Added an optional storage_state parameter to the ascrape_playwright and ascrape_with_js_support methods to allow for more flexible browser context configurations. [1][2]
Updated the ascrape_playwright method to pass the storage_state parameter when creating a new browser context.
Updated the ascrape_with_js_support method to pass the storage_state parameter when creating a new browser context.
Code readability improvements:
Reformatted long string assignments to improve readability. [1][2][3]
Reformatted conditional assignments to improve readability in the lazy_load and alazy_load methods. [1][2]
This pull request includes several updates to the
scrapegraphai/docloaders/chromium.py
file, focusing on improving the readability and functionality of the scraping methods. The most important changes include adding support forstorage_state
in the Playwright scraping methods and reformatting code for better readability.Enhancements to scraping methods:
storage_state
parameter to theascrape_playwright
andascrape_with_js_support
methods to allow for more flexible browser context configurations. [1] [2]ascrape_playwright
method to pass thestorage_state
parameter when creating a new browser context.ascrape_with_js_support
method to pass thestorage_state
parameter when creating a new browser context.Code readability improvements:
lazy_load
andalazy_load
methods. [1] [2]