lmco / streamflow

StreamFlow™ is a stream processing tool designed to help build and monitor processing workflows.
https://github.com/lmco/streamflow/wiki
Apache License 2.0
253 stars 69 forks source link

Framework annotation enhancement #13

Open juliencruz opened 9 years ago

juliencruz commented 9 years ago

Currently the only way to register new frameworks is through the creation of a framework.yml file. It would be best if the user could also define frameworks through the use of custom annotations in the Spout or Bolt implementations. During framework upload, the framework service could scan for new Spouts and Bolts using these annotations and register them in the UI. This would simplify the process to register new Spouts and Bolts and reduce the chances of misconfiguring the framework.yml file.

This would require developers to import a custom streamflow library containing all available annotations. Changes would also be required in the framework service to properly parse the framework annotations.