search

marsara9 / lemmy-search

An enhanced search engine just for Lemmy/Fediverse
https://www.search-lemmy.com
GNU Affero General Public License v3.0
81 stars 4 forks source link

feature/user-agent #10

Closed marsara9 closed 1 year ago

marsara9 commented 1 year ago

Adding a user-agent check before doing any crawling of a site.