Spark-tools is a set of tools dedicated to Spark and aims to make the life of data engineers easier.
The tools
- Spark-Test, testing tools for Dataframe and Dataset from Spark
- Parka, data quality on Spark
- Fenek, a DSL for semi-typed transformation in Scala for Spark
- Plumbus, light misc things for Spark
- Spark-ZIO, Spark in ZIO environment