search

twintproject / twint-ng

Twint core component; new lite version due to Twitter Legacy removal
MIT License
5 stars 4 forks source link

Initial Skaffolding #2

Open elie-h opened 4 years ago

o7n commented 4 years ago

I'm not sure if you should be checking in config files that contain your local paths. They seem to be very specific to your exact build env.

elie-h commented 4 years ago

I'm not sure if you should be checking in config files that contain your local paths. They seem to be very specific to your exact build env.

Yep, forgot to add an ignore for my vscode config Fixed now

o7n commented 4 years ago

Shouldn't we be calling this library twintng in order to avoid all kinds of conflicts? i.e. have a src/twintng ?

elie-h commented 4 years ago

Shouldn't we be calling this library twintng in order to avoid all kinds of conflicts? i.e. have a src/twintng ?

Yeah good shout - updated

o7n commented 4 years ago

I have added basic working scraper functionality:

Next steps are:

I can spend more time on this after the weekend. In the meanwhile, all contributions on the next steps are welcome!

elie-h commented 4 years ago

I have added basic working scraper functionality:

  • getFollowers (including generator)
  • getFollowing (including generator)
  • getProfile
  • runSearch (work in progress)

Next steps are:

  • parsing tweet HTML and putting them in a dict
  • creating generator for search
  • creating different output methods
  • converting config params to a search query
  • creating command line tool
  • (making sure the code passes linting checks)

I can spend more time on this after the weekend. In the meanwhile, all contributions on the next steps are welcome!

Changes look good I will reduce some of the checks on linting to get it passing

pielco11 commented 4 years ago

I'll handle the tweet HTML thing during the weekend

pielco11 commented 4 years ago

Hi guys

as you may see, I haven't pushed yet. I hope to get something working by the next weekend.

o7n commented 4 years ago

@pielco11 @eh-93 are you still interested in pursuing this?

pielco11 commented 4 years ago

Honestly, I do hardly find the time