vectara / vectara-ingest

An open source framework to crawl data sources and ingest into Vectara
https://vectara.com
Apache License 2.0
120 stars 48 forks source link

Website crawler fix #55

Closed ofermend closed 9 months ago

ofermend commented 9 months ago

Update to usage of playwright to address issues with crawling.

justinhayes commented 9 months ago

Added a few comments. Other than that it looks good to me (although I am not very familiar with the playwright stuff).