search

TaxyAI / browser-extension

Automate your browser with GPT-4
MIT License
934 stars 383 forks source link

Respecting robots.txt #8

Open anildash opened 1 year ago

anildash commented 1 year ago

Is there any way for a website to indicate that they'd like their site to not be automated with this extension?

corbt commented 1 year ago

This is a great question. Currently Taxy only operates in an interactive session in the active tab. Given that, I feel pretty good about allowing it to act on the user's behalf since it can't perform actions any faster than a human could anyway.

In the future when we support automated/background tasks we'll have to figure out how to make it play nicely with the larger ecosystem. We definitely don't want this to be a tool for spambots!

Christopher-Hayes commented 1 year ago

Anytime you're blocking on-user-behalf functionally like this, you also gotta consider how doing so would affect accessibility. I can see this extension being an enormous asset for screen reader users.