-
Hey, I am using `async_get` with `hrequests.imap_enum(reqs)` to scrape 100 URLs at a time. The `readme` says this should be blazing fast, but I'm not sure what that means. It's currently taking 3-5 …
-
There are several issues now with our current crawler implementation:
1. It is banned by Wiki servers because it DDoSes the API.
2. It takes a lot of time to get all summaries for several supported …
-
- [x] retry flags for crawlers
- [x] drop job attempts prop
- [x] throttle = 0
- [x] concurrency = 1
- [x] check invalid url (what to do?)
- [x] timeout flag for crawlers
- [x] strip fragment
-…
-
ES crashes on startup.
The relevant log line seems to be
```
Feb 17 13:33:31 lvl2: Parsing XML file "/home/luigi/.emulationstation/gamelists/scummvm/gamelist.xml"...
terminate called after thro…
-
Hi! I'm running ordhook v1.2.0 in a k8s cluster on AWS. I've successfully passed the on-chain data scraping the from a Bitcoin daemon but currently I've getting the following error:
```
{"msg":"Unab…
-
I recently had a use case where we added ~500 certificates to a single ingress (via cert-manager), which caused memory to spike significantly, causing the ingress gateway pod to get stuck in an OOM cr…
-
#### What versions are you running?
$ go list -m github.com/chromedp/chromedp
v0.6.0
$ chromium-browser --version
Chromium 87.0.4280.66 Built on Ubuntu , running on Ubuntu 18.04
$ go ve…
-
Target date: mid february 2024
Wanted:
- [x] python-3.12.2 with torch and numba
- [x] Operation Research packages refresh
- [x] a big clean-up in packages that still don't have a windows/3.12 wh…
-
## The problem
## Environment
- Home Assistant release with the issue: All
- Last working Home Assistant release (if known): unknown
- Operating environment (Hass.io/Docker/Windows/etc…
-
Hi,
I often see messages like
`
{"file":"/go/src/github.com/webdevops/azure-metrics-exporter/metrics/prober.go:199","func":"metrics.(*MetricProber).collectMetricsFromTargets.func1.1.1","level":"…