SageMaker Debugger doesn't use 'save_interval' when collection is 'all'

awslabs / sagemaker-debugger

Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors

Apache License 2.0

161 stars 83 forks source link

SageMaker Debugger doesn't use 'save_interval' when collection is 'all' #335

Open vandanavk opened 4 years ago

vandanavk commented 4 years ago

out_dir = os.path.join(tmpdir, str(uuid.uuid4()))
hook = Hook(out_dir=out_dir, include_collections=['all'])
hook.get_collection("all").save_config = SaveConfig(save_interval=3)

The save config set for "all" collection gets set only for "all" instead of applying on all collections.

zhimin-z commented 1 year ago

Would you mind clarifying your question?