search

JustAnotherArchivist / snscrape

A social networking service scraper in Python
GNU General Public License v3.0
4.43k stars 706 forks source link

Using snscrape for academic research #986

Closed Jeyb08 closed 1 year ago

Jeyb08 commented 1 year ago

I am planning to create an academic paper and I need to scrape data from Twitter. However, I am unsure of the authenticity of the data gathered through snscrape and can't afford to pay Twitter API. Is snscrape a valid data-gathering method?

JustAnotherArchivist commented 1 year ago

People have done it before. Whether it lives up to your study's requirements is up to you and whoever else is involved (coauthors, supervisors, institutional guidelines, etc.). snscrape tries to extract data as faithfully as it can, but bugs happen, and there are many problems on Twitter's side, most of which you can find here in the closed issues.

Or in short, to quote the GPL blob:

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

Jeyb08 commented 1 year ago

Thank you for your response! This is very helpful.