Lighter is an opensource application for interacting with Apache Spark on Kubernetes or Apache Hadoop YARN. It is heavily inspired by Apache Livy and has some overlapping features.
Lighter supports:
You can read a breaf description on how Lighter works here.
To build Docker image, containing application, you need to run
docker build -t lighter .
Lighter will always try to support the latest patch version for all officially recommended Apache Spark releases i.e.: 3.4.3 and 3.5.3.
Lighter is MIT licensed.