Add support for Elasticsearch

microsoft / ghcrawler

Crawl GitHub APIs and store the discovered orgs, repos, commits, ...

MIT License

377 stars 90 forks source link

Add support for Elasticsearch #102

Closed craigez closed 7 years ago

craigez commented 7 years ago

Adds support for Elasticsearch as a store, puts data into a "github" index
Brief instructions on how to set it up for CIABatta (not sure Elasticsearch being slow to start up is always handled gracefully)
Doesn't do anything sensible with error conditions for get/query, etc...
Haven't validated all of the behaviors of the crawler or dug into the data to ensure it is correct.

msftclas commented 7 years ago

@craigez, Thanks for your contribution. To ensure that the project team has proper rights to use your work, please complete the Contribution License Agreement at https://cla.microsoft.com.

It will cover your contributions to all Microsoft-managed open source projects. Thanks, Microsoft Pull Request Bot

craigez commented 7 years ago

The CLA should be mentioned clearly in the readme.