search

Capia / giia

0 stars 1 forks source link

Improve Notebook Local Support #10

Closed unibeck closed 3 years ago

unibeck commented 4 years ago

Currently notebooks are set up to always upload to S3 and then download the same data from S3 (redundant). This makes the process slower and uses more S3 space.

unibeck commented 4 years ago

Sagemaker's local_code is not heavily supported right now and as such I have encountered various issues blocking me from implementing full local support.

ab77d3e33f2641fd4dc09203da97402069dd4068 has the most relavent code to implement this.