search

delta-io / delta-examples

Delta Lake examples
Apache License 2.0
208 stars 76 forks source link

Update Daria and fast-test to scala 2.12 #1

Closed danp11 closed 4 years ago

MrPowers commented 4 years ago

@danp11 - thanks for the PR. Feel free to send additional commits and I'll do my best to get them merged ASAP!

danp11 commented 4 years ago

Hi @MrPowers

Im a Java developer so havent written any Scala before this weekend soI gets stuck at times :-)

Im very intrested in Big Data and have lately seen Delta lake presentations
from you and others and from the Spark summit and I've decieded to learn this now:-)

Saw you written some books that looks interesting and after seeing Dominique Brezinski last talk on Spark summit I got inspired to build a "generic" ELT pipleine.

I have started on my delta-example-fork and I'm gonna continue writing test and develop more this coming week I hope. Although not ready yet just let me know if you think it could be of help for others and we can put it in the repo (After polish and probably some refactor needed haha)

Regards from Stockholm, Sweden

/Dan

MrPowers commented 4 years ago

@danp11 - thanks for responding. Delta is awesome. You'll find Scala easy to learn if you're coming from the Java world!

Definitely send me your pull request. I was also inspired to write some ELT code based on Dominique's Spark Summit talk, see this ELT snippet: https://github.com/MrPowers/spark-daria/commit/d84611bb601eb9a77d32823d7d262f2bd2a33668

Getting an ELT code snippet in here would be great. Definitely send a PR if you can!