The partitioned checkpoints are uploaded with the prefix object of the bucket provided. There should be an option to override this prefix object or remove the prefix object.
The prefix was added since we run through training job, SM uploads some extra prefix objects those are essentially the logs and others. But we should let the user override this.
Description
The partitioned checkpoints are uploaded with the prefix object of the bucket provided. There should be an option to override this prefix object or remove the prefix object.
The prefix was added since we run through training job, SM uploads some extra prefix objects those are essentially the logs and others. But we should let the user override this.
cc @tosterberg