Fix spark errors

[thinkall]

Why are these changes needed?

Fix a few errors related to spark. It's needed to fix the test errors in other PRs such as #1263

• spark mlflow version not found issue
• joblib issue

Related issue number

Checks

• [x] I've included any doc changes needed for https://microsoft.github.io/FLAML/. See https://microsoft.github.io/FLAML/docs/Contribute#documentation to build and test documentation locally.
• [x] I've added tests (if relevant) corresponding to the changes introduced in this PR.
• [ ] I've made sure all auto checks have passed.

[codecov-commenter]

Codecov Report

Attention: 3 lines in your changes are missing coverage. Please review.

Comparison is base (0415638) 71.72% compared to head (dd22038) 71.64%.

Files	Patch %	Lines
flaml/tune/spark/utils.py	40.00%	2 Missing and 1 partial :warning:

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #1274 +/- ## ========================================== - Coverage 71.72% 71.64% -0.09% ========================================== Files 83 83 Lines 11244 11249 +5 Branches 2359 2360 +1 ========================================== - Hits 8065 8059 -6 - Misses 2724 2735 +11 Partials 455 455 ``` | [Flag](https://app.codecov.io/gh/microsoft/FLAML/pull/1274/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | Coverage Δ | | |---|---|---| | [unittests](https://app.codecov.io/gh/microsoft/FLAML/pull/1274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `71.51% <40.00%> (-0.09%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.