pinot-recipes module

[npawar]

Create a pinot-recipes module. Move all examples and quickstarts (baseballStats, airlineState, githubEvents stream) to that module, so that pinot-tools isn't overloaded with demo logic. Templatize the recipe steps. This will also make it easier for anyone to easily add a recipe.

[kishoreg]

This is a good idea. can we come up with a convention for adding recipes. What do we need to create a recipe

• Table(s) REALTIME/OFFLINE
• Config.json and schema.json for each table
• Raw data for REALTIME and OFFLINE table

If all these things are placed in the appropriate folder structure. The recipe driver should do the following

• start all in one pinot process (ZK, controller, server, broker)
• create the tables with schema and config
• For batch tables - generate segment and push to segment
• For realtime tables - start Kafka as a separate process and write the raw data to Kafka
• run a predefined set of queries
• launch the pinot console