search

benchflow / data-transformers

Spark scripts utilised to transform data to the BenchFlow internal formats
Other
0 stars 0 forks source link

Use Minio API for Python #56

Closed Cerfoglg closed 8 years ago

Cerfoglg commented 8 years ago

Use the Python API for Minio for retrieving data:

https://github.com/minio/minio-py https://docs.minio.io/docs/python-client-api-reference

This allows us to have all files required by one script to be in the same "folder" (meaning the keys share the same prefix).