search

allisonwang-db / pyspark-data-sources

Custom PySpark Data Sources
https://allisonwang-db.github.io/pyspark-data-sources/
Apache License 2.0
18 stars 4 forks source link

Nikkthegreek/swapi #4

Open datanikkthegreek opened 2 weeks ago

datanikkthegreek commented 2 weeks ago

As I was recently playing around for demo purposes with open APIs I thought it's a good idea to add SWAPI to this Repo using the Data Source implementation.

Link: https://swapi.dev/documentation

Also played around with the Partitioning to create some parallelisation.