search

Xarrow / weibo-scraper

Simple Weibo Scraper
MIT License
96 stars 18 forks source link

Is it possible to scrap by keyword? #17

Open ZhiliWang opened 4 years ago

ZhiliWang commented 4 years ago

Hi, this is an amazing project, and I wonder if it is possible to scrap by keyword or a topic that we care about, regardless the user/poster. Thank you!

Xarrow commented 4 years ago

Hi, this is an amazing project, and I wonder if it is possible to scrap by keyword or a topic that we care about, regardless the user/poster. Thank you!

This feature is in analysis. it will get data from “https://m.weibo.cn/api/container/getIndex?containerid=106003type%3D25%26t%3D3%26disable_hot%3D1%26filter_type%3Drealtimehot" in detail. I might focus my energy on my self work ,and maintain this project as much as possible. Thank you for feedback.

ZhiliWang commented 4 years ago

Hey thank you for your reply! I carefully reviewed your codes but not sure what you meant by "analysis". Is it possible to do it (search and get tweets by keyword) within your repo or do I need to fork it and implement that part myself? Thank you!