search

exorde-labs / exorde-client

Exorde participation module (Testnet 2022-2023) - CLI
GNU General Public License v3.0
1.11k stars 86 forks source link

Twitter scraping beyond keywords #64

Open nihirv opened 2 months ago

nihirv commented 2 months ago

Hi there.

I've been playing around with this project over the last week or so. Great stuff.

I'm wondering if we can do the following (happy to contribute to this too -- just need a pointer in the right direction).

Looking to:

  1. Scrape beyond the keywords provided in keywords.txt
  2. And/or, scrape user accounts. I.e. we see a tweet come in by a user for one of the keywords -- can we scrape some more tweets from their account.

Particularly keen about option 2. Happy to implement it, but can you navigate me to the right place or process on how I might be able to contribute? Thanks

MathiasExorde commented 1 month ago

Hi,

  1. Scraping beyond the keywords is allowed
  2. you can also do that as long as all tweets are recent