Fix latency due to koalas cache

[svittoz]

Fix latency due to koalas cache

It has been observed that eds-scikit 0.1.5 was much slower than 0.1.5.dev1. Caching in spark and not in koalas solved the issue.

Checklist

• [ ] If this PR is a bug fix, the bug is documented in the test suite.
• [ ] Changes were documented in the changelog (pending section).
• [ ] If necessary, changes were made to the documentation (eg new pipeline).

[codecov[bot]]

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (cb73941) 83.83% compared to head (176fb15) 83.82%.

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #50 +/- ## ========================================== - Coverage 83.83% 83.82% -0.01% ========================================== Files 82 82 Lines 2493 2492 -1 ========================================== - Hits 2090 2089 -1 Misses 403 403 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.