search

medialab / hyphe

Websites crawler with built-in exploration and control web interface
http://hyphe.medialab.sciences-po.fr/demo/
GNU Affero General Public License v3.0
329 stars 59 forks source link

Renew code to load recent user agents #453

Closed boogheta closed 1 year ago

boogheta commented 2 years ago

use https://github.com/jnrbsn/user-agents/blob/main/user-agents.json ? (oldest versions?)

boogheta commented 1 year ago

should use instead https://www.useragents.me/api like in https://github.com/medialab/minet/blob/master/minet/user_agents/__init__.py#L20-L53