search

awslabs / sagemaker-debugger

Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors
Apache License 2.0
161 stars 83 forks source link

Ability to save shapes #341

Closed rahul003 closed 4 years ago

rahul003 commented 4 years ago

Description of changes:

Redo of PR https://github.com/awslabs/sagemaker-debugger/pull/328 rebased on current master

Updated docs as well now.

Style and formatting:

I have run pre-commit install to ensure that auto-formatting happens with every commit.

Issue number, if available

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

codecov-commenter commented 4 years ago

Codecov Report

Merging #341 into master will increase coverage by 5.70%. The diff coverage is 91.62%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #341      +/-   ##
==========================================
+ Coverage   80.76%   86.46%   +5.70%     
==========================================
  Files          86       86              
  Lines        6400     6474      +74     
==========================================
+ Hits         5169     5598     +429     
+ Misses       1231      876     -355
Impacted Files Coverage Δ
smdebug/exceptions.py 67.53% <37.50%> (-2.04%) :arrow_down:
smdebug/tensorflow/base_hook.py 80.23% <66.66%> (+0.01%) :arrow_up:
smdebug/core/tensor.py 83.46% <84.61%> (+4.80%) :arrow_up:
smdebug/core/writer.py 88.28% <86.48%> (+3.34%) :arrow_up:
smdebug/core/reduction_config.py 88.31% <87.50%> (-0.58%) :arrow_down:
smdebug/core/index_reader.py 90.08% <96.96%> (+0.30%) :arrow_up:
smdebug/core/hook.py 93.45% <100.00%> (+5.74%) :arrow_up:
smdebug/core/locations.py 88.18% <100.00%> (+7.98%) :arrow_up:
smdebug/core/tfevent/index_file_writer.py 96.87% <100.00%> (+4.14%) :arrow_up:
smdebug/trials/local_trial.py 100.00% <100.00%> (ø)
... and 32 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 6f8e757...1f94933. Read the comment docs.

rahul003 commented 4 years ago

Merging it after Nihal's approval. If anyone has any issues, please let me know I can address them in a future PR