-
Hello Sir ,
I'm a Chinese native-speaking developer, and I love Colly very much.
I'd like to contribute a Chinese version of Colly documentation to http://go-colly.org/.
What can I do?
Thank you!
…
-
Question:
I've to scrape different 10+ blogs for articles. I've to scrape fields like title, author, likes, content etc. but each site would have different css selector for the fields I've motioned…
-
## Golang爬虫框架
- [go-colly](https://github.com/gocolly/colly)
## Python爬虫框架
- [scrapy](https://scrapy.org/)
>related issue: #15
-
Any ideas why this is returning Forbidden at the end? Thanks!!!
--------------------
PS C:\Users\XXXX\Go\src\github.com\luckylittle\blinkist-m4a-downloader\blinkist> go mod init github.com/luck…
-
The sample program provided will result in a panic
> panic: interface conversion: interface {} is map[string]interface {}, not *main.node
The code only results in a panic when using a queue that…
-
**TLDR**: How would I pass a HTMLElement to a Collector? Instead of asking it to visit a URL?
cases.OnHTML("div.col-result", func(e *colly.HTMLElement) {
log.Println("Case result found:", …
-
Hi,
Thanks for Colly! :)
I have a task with hundreds of thousands of pages, so obviously I am using Colly's caching, but it's basically 'too much' for the filesystem. (Wasted disk space, a pain …
-
See https://github.com/gocolly/
Colly is not friendly for dynamic page scraping, such as when their APIs have complicated dependency relationship and you don't want to waste time studying how their…
-
I found this wonderful snippet in `gocolly`, this file could make random headers rather simple: https://github.com/gocolly/colly/blob/master/extensions/random_user_agent.go
-
**QUESTION**
I would love to start using colly at my company!
We scrape asp sites, and I'm honestly not very familiar with how to scrape such sites.
I can tell just from perusing them with my…