search

Open-Multi-Modal-Personal-Assistant / web-search

Using Selenium with JavaScript (TypeScript) Google Cloud functions to provide a web search tool for LLMs
0 stars 0 forks source link

Consider Playwright library #3

Open MrCsabaToth opened 1 month ago

MrCsabaToth commented 1 month ago

I've heard about Playwright when reading about Rabbit R1 AI pin's LAM (Large Action Model): https://github.com/oxylabs/playwright-web-scraping Supposedly it's more modern than Selenium, we should search for possible Clod Function applications.

MrCsabaToth commented 1 month ago

Here is a promising article: https://akshaymattoo.medium.com/web-scraping-with-playwright-firebase-functions-d322ccf9ef48

It uses JavaScript / Node function and relies on the aws-lambda-serverless chromium nom package. Need to try this out.