Add YARN as a resource / job manager

[MrCreosote]

Uses YARN by default, but can use spark standalone optionally for now.

Tested by importing and querying the Fast Genomics Gene table.

[codecov[bot]]

Codecov Report

Attention: Patch coverage is 57.14286% with 9 lines in your changes missing coverage. Please review.

Project coverage is 50.00%. Comparing base (8b09cda) to head (302645a).

Files	Patch %	Lines
src/spark/utils.py	57.14%	9 Missing :warning:

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #50 +/- ## ========================================== + Coverage 48.07% 50.00% +1.92% ========================================== Files 4 4 Lines 104 118 +14 ========================================== + Hits 50 59 +9 - Misses 54 59 +5 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

[Tianhao-Gu]

I don't know what to do now.

(dev) tgu@cdm-jupyterhub (dev-yarn)$docker-compose up --build
WARN[0000] /Users/tgu/Development/kb_apps/cdm-jupyterhub/docker-compose.yaml: `version` is obsolete 
[+] Running 0/2
 ⠦ yarn-nodemanager Pulling                                                               12.7s 
 ⠦ yarn-resourcemanager Pulling                                                           12.7s 
no matching manifest for linux/arm64/v8 in the manifest list entries
(dev) tgu@cdm-jupyterhub (dev-yarn)$

[MrCreosote]

https://stackoverflow.com/questions/65456814/docker-apple-silicon-m1-preview-mysql-no-matching-manifest-for-linux-arm64-v8 maybe?

[MrCreosote]

How long did you wait?

[Tianhao-Gu]

How long did you wait?

at least a few minutes.