Sunbird-cQube / community

Community repo for cQube where documentation, discussions, etc are enabled.
MIT License
3 stars 7 forks source link

Evaluate Spark as a processor #759

Closed ChakshuGautam closed 1 year ago

ChakshuGautam commented 1 year ago

Does Configuration change if Spark used instead of NiFi? - Update: Answer - Configuration file is not coupled with NiFi, Hence we can reuse the configuration file.

ChakshuGautam commented 1 year ago

@satendrapalsingh It would be great if this feature can be contributed by the community. We can abstract the config out to use any processor available. We are creating a generic processor API for this - which should support any processor.

RNarmatha commented 1 year ago

Currently we are using NIFI as a processor and SPARK is not evaluated