#286 - Unit tests failing during build - Githubissues

AbsaOSS / hyperdrive

Extensible streaming ingestion pipeline on top of Apache Spark

Apache License 2.0

44 stars 13 forks source link

#286 - Unit tests failing during build #287

Closed miroslavpojer closed 1 year ago

miroslavpojer commented 1 year ago

Fixed all failing unit tests:

Module "ingestor-default_2.12" - 9 Tests Failed

return empty set if no partial writes have occurred
return the empty set if the root folder is empty
return the filenames that are missing in the metadata log
throw if SparkSession is stopped
set topic, brokers and options on SparkSession
set topic and brokers on SparkSession if no extra options informed
set offsets to earliest if checkpoint location is empty
not set offsets to earliest if a checkpoint location exists and is not empty
throw an exception if the metadata log is inconsistent

Module "driver_2.12" - 1 Tests Failed

load all configuration

Closes #286

sonarcloud[bot] commented 1 year ago

Kudos, SonarCloud Quality Gate passed!

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

No Coverage information
0.0% Duplication

miroslavpojer commented 1 year ago

Added more code changes for 15 Failed test found when building on Spark3 and with Docker tests.