-
Creating versatile and innovative executor types can significantly enhance the capabilities of a task or workflow orchestration system. Here are several executor ideas that could be implemented to cov…
-
Hello! I encountered the following error, using jest and typescript.
Cannot find module 'got-scraping' from 'src/shared/extractor/html-loader.ts'
As you can understand, I have module that works i…
-
Hey @xalanq
I wanted to contribute to this project, but upon inspection, I noticed a lot of repetitions and redundancies in the code. Also, lack of comments and disorganized code structure made it d…
-
Hello @NikolaiT ,
Is it a good idea to plug GoogleScraper to [Scrapoxy.io](http://scrapoxy.io) ?
Best regards,
Fabien
-
Isu ini digunakan untuk diskusi seputar aplikasi Scraping (Crawling).
Silakan berkomentar atau bertanya langsung di bawah ini..
oonid updated
3 years ago
-
1.抓取新闻标题、摘要、链接；（已实现）
2.翻译标题、摘要；（通过百度翻译api，用post agent获取response）（涉及到MD5加密[已通过js实现]、url解码[未实现]）（已实现翻译的post agent，但未完美实现event的传输）
3.将翻译后的标题、翻译后的摘要、链接、消息来源（金融时报）{多网站爬取后便于区分用}，通过post agent 推送到微信上（已实现）
…
-
## why?
```
INFO:scrape_multi:=== scraping video_raw:(done=271, skipped=10, total=1528) ===
INFO:_scrape_video_info:loading video_info...
WARNING: video doesn't have subtitles
INFO:_scrape_main_h…
-
**Describe the bug**
While using Prometheus server for `service.telemetry.metrics`, if the Prometheus server cannot start (e.g. the port used already occupied), OTel framework seems to swallow that e…
-
I'm working on a project to extract articles from gaming media sites, and I'm doing a basic test run, which according to VSCode's debugger consistently hangs at the point after which I've set up a mul…
-
### Overview
**Project:** Open Community Survey
**Volunteer Opportunity:** Create scraper to get information from builtwith.com on technologies used by neighborhood council websites. Organize the …