Chaffelson / whoville

An opinionated auto-deployer for the Hortonworks Platform
Apache License 2.0
34 stars 32 forks source link

Whoville

Cloudy Hortonworks Platforms in under 60 minutes A set of demos in a small Docker Image with Orchestration for AWS/GCP/Azure deployment from a simple Profile. This project is implemented directly in python rather than using a framework like Ansible because, when we started, the level of customisation and process wrangling for the new open source project integrations seemed easier in that manner. As the underlying platform matured the need for those invasive processes diminished and now this installation is much better executed in Ansible on a Terraform infrastructure, which is now the Cloudera standard. This repository and project is kept for historic purposes.

Requirements

Hosting Platform | You will need an AWS account with rights to deploy machines, assume roles, etc. | Please see the Cloudbreak Requirements <https://docs.hortonworks.com/HDPDocuments/Cloudbreak/Cloudbreak-2.7.1/content/aws-quick/index.html#prerequisites>_ for creating AWS Roles.

Docker Deployment Everything is included if you use the provided Docker Image for development or deployment

Local Deployment | Required: Python3.6 | Recommended: A Python IDE with inspection and Github support, such as Pycharm

Quickstart

  1. Customise a profile.yml::

    curl -sSL http://bit.ly/WhovilleProfile > profile.yml && vi profile.yml

  2. Install / Start a recent version of Docker <https://www.docker.com/get-started>_

  3. Export your profile path and run the Docker Image::

    export PROFILE=/path/to/my/profile.yml docker run -ti -v ${PROFILE}:/profile.yml:ro chaffelson/whoville:latest

More Information

| Suggested setup for Interactive Development <https://github.com/Chaffelson/whoville/wiki/Development-Setup> in a local Python environment. | Detailed Definitions Guide <https://github.com/Chaffelson/whoville/wiki/Usage-Guide> for creating more demos and services. | Troubleshooting <https://github.com/Chaffelson/whoville/wiki/Troubleshooting>_ guide for known issues.

Support

| This software is supplied as-is with no support guarantee under the Apache 2.0 license | Please raise any Issues on Github <https://github.com/Chaffelson/whoville/issues/new>_

You can link to this page from http://bit.ly/HwxQuickstart