-
-
-
For my given website after the ```colly.Visit``` function, the ```colly.OnError``` shows **Get "{website}": EOF**. When I check the `StatusCode` it shows `0` **Why?**. Is I'm missing anything?
Note…
-
#58 introduces some code generation as a ruby script that pulls some data from AWS pricing API and documentation. It would be nice to reimplement this using go tools.
Looks like these are some goo…
-
The default setting is not suitable for long runs
-
I'm using an array of HTTP proxies and setting up the collector as described in the example:
```go
c := colly.NewCollector(
colly.MaxDepth(cfg.MaxDepth),
colly.URLFilters(
…
-
Hi, I'm trying to web scrapping [YouTube charts](https://charts.youtube.com/?hl=pt), unsuccessfully because they use polymer / shadow DOM. With Geziyor, could I do that? I'm using colly, and they don'…
-
Scraproxy accepts requests as HTTP but the HTTPS URL must be in the Location header, source:
http://docs.scrapoxy.io/en/master/advanced/understand/index.html#can-scrapoxy-relay-https-requests
go-c…
-
I'm attempting to use colly to write a program that first logs in to a site, and then obtains some information. The site uses 2 different domains to handle authentication, say `www.site.com` and `auth…
-
After I clone a Collector, I'm not sure if I need to use the same storage and queue...
I referenced
http://go-colly.org/docs/examples/redis_backend/
and
http://go-colly.org/docs/examples/courser…