Create tests - Githubissues

panchicore / es-gdelt

Indexing GDELT database into Elasticsearch, entire database including the -each 15 minutes- real time events

12 stars 4 forks source link

Create tests #1

Closed panchicore closed 4 years ago

panchicore commented 7 years ago

python scripts
elasticsearch indexes
logstash pipelines

hamzahkhan commented 4 years ago

Hey, Needed some help. Are you guys still active?

panchicore commented 4 years ago

hi @hamzahkhan, is still active and working, its collecting data, I moved this process to a pipeline process with apache nifi so I could create a realtime alert system before indexing in ES, it was using too much space within a period of 6 months, so moved to pre-process and store what we needed. Feel free to contribute with whatever you need/want. Thanks for reaching out.

hamzahkhan commented 4 years ago

Thanks for the swift response. I am really new to ES tech stack. If I had to implement a pipeline to index Gdelt in ES..where do I start? Maybe using your code or something else. Some suggestions will really help.

panchicore commented 4 years ago

I just added quick instructions in the README file.

hamzahkhan commented 4 years ago

Thanks man