Can i use SQL query in transformation

Stratio / sparta

Real Time Analytics and Data Pipelines based on Spark Streaming

Apache License 2.0

525 stars 196 forks source link

Open Sharathmk99 opened 7 years ago

Sharathmk99 commented 7 years ago

Hi Team,

This is great tool. Can i use SQL like query in transformation unit? I want to write SQL query on InoutData and save the result on Output unit.

Regards, Sharath

compae commented 7 years ago

Hi,

you can write one query in the trigger component, but it's possible extends the output sdk and you can use your output in the policies.

The output have one function save where you can manage the dataFrame.

Regards.