search

gisaia / ARLAS-proc

Workaround about data ingestion with computing frameworks
Apache License 2.0
4 stars 0 forks source link

Speed up test #162

Closed laurent-thiebaud-gisaia closed 4 years ago

laurent-thiebaud-gisaia commented 4 years ago

According to https://github.com/MrPowers/spark-fast-tests#usage to can speed up tests (up to 70% faster). In arlas-proc, a futur PR with course extraction usually needs 7 minutes locally (except sbt & spark session init), and only 5 seconds with this change.

laurent-thiebaud-gisaia commented 4 years ago

CI passed from about 9 min to 2 min 30