-
-
-
Hello, could you take an look at the Spider death event? Currently both server killed/despawned and player killed Spiders are dropping web's, now. Player killed one's make sense. But server killed or …
-
I'm currently using the latest version of Spiders 2.0 for 1.12.2 (1.0.3), and there are pretty annoying amounts of spiders spawning above ground during day. They're far more common than any passive mo…
-
### Spider name
beaurepaires
### Log output
https://alltheplaces-data.openaddresses.io/map.html?show=https%3A%2F%2Falltheplaces-data.openaddresses.io%2Fruns%2F2024-08-17-13-32-02%2Foutput%2Fbeaurep…
-
### Brand name
Various
### Wikidata ID
_No response_
### Store finder url(s)
[OSM Conflator](https://wiki.openstreetmap.org/wiki/OSM_Conflator) has a small number of [spiders written in Python](h…
-
Use patterns from e.g. https://github.com/JayBizzle/Crawler-Detect or https://github.com/monperrus/crawler-user-agents to make web crawler detection more accurate.
The [datacache](https://docs.mybb…
-
They're getting around our firewalls! Hackers!
Allegedly, spiders (and therefore probably any hostile AI with diagonal pathing?) can get around deployable barriers, as seen in this picture: http://puu…
-
I've 1000 spiders and all use same files, right now Is there any way to share file?
-
Python 3.6, Scrapy 1.5, Twisted 17.9.0
I'm running multiple spiders in the same process per:
https://doc.scrapy.org/en/latest/topics/practices.html#running-multiple-spiders-in-the-same-process
…