Ingest crash data - Githubissues

mozilla / crashathon

3 stars 3 forks source link

Ingest crash data #2

Open robhudson opened 8 years ago

robhudson commented 8 years ago

This task is to ingest the daily crash data from S3 and load it into Elasticsearch. Part of this process is picking a subset of the crash ping data to write to Elasticsearch.

For now, a good starting point might be:

clientId
appVersion
creationDate
geoCountry

Since the full crash ping will be on S3 we can easily add more fields to the ES mapping later.

robhudson commented 8 years ago

This will now be for ingesting data going into Postgresql. Likely implemented as a management command.