search

TheRensselaerIDEA / twitter-nlp

Data Analytics on Twitter with Natural Language Processing
MIT License
17 stars 7 forks source link

Configure scrolling and elasticsearch tweaks #42

Closed shwehtom89 closed 3 years ago

shwehtom89 commented 3 years ago

This PR addresses the comments made in #40

In particular

  1. Makes parameters in scrolling.py configurable via a config file
  2. Clears scroll ids after iterating over a whole index
  3. Configures elasticsearch batch call to update