-
Question:
I've to scrape different 10+ blogs for articles. I've to scrape fields like title, author, likes, content etc. but each site would have different css selector for the fields I've motioned…
-
See https://github.com/gocolly/
Colly is not friendly for dynamic page scraping, such as when their APIs have complicated dependency relationship and you don't want to waste time studying how their…
-
**TLDR**: How would I pass a HTMLElement to a Collector? Instead of asking it to visit a URL?
cases.OnHTML("div.col-result", func(e *colly.HTMLElement) {
log.Println("Case result found:", …
-
## Golang爬虫框架
- [go-colly](https://github.com/gocolly/colly)
## Python爬虫框架
- [scrapy](https://scrapy.org/)
>related issue: #15
-
-
The sample program provided will result in a panic
> panic: interface conversion: interface {} is map[string]interface {}, not *main.node
The code only results in a panic when using a queue that…
-
**QUESTION**
I would love to start using colly at my company!
We scrape asp sites, and I'm honestly not very familiar with how to scrape such sites.
I can tell just from perusing them with my…
-
Hi,
Thanks for Colly! :)
I have a task with hundreds of thousands of pages, so obviously I am using Colly's caching, but it's basically 'too much' for the filesystem. (Wasted disk space, a pain …
-
-