search

CalculatedContent / WeightWatcher

The WeightWatcher tool for predicting the accuracy of Deep Neural Networks
Apache License 2.0
1.47k stars 125 forks source link

0.7.2.x: layer ids not being updated when iterating over safetensor files #268

Open charlesmartin14 opened 1 year ago

charlesmartin14 commented 1 year ago

In the new verison 0.7.2.x 

INFO:weightwatcher:Layer id 129  unknown type unknown layer  <class 'weightwatcher.weightwatcher.PyStateDictLayer'>
INFO:weightwatcher:Layer id 133  unknown type unknown layer  <class 'weightwatcher.weightwatcher.PyStateDictLayer'>
INFO:weightwatcher:loading /content/drive/MyDrive/WW/LLAMA-base/llama-13b-hf-transformers-4.29/model-**00002**-of-00003.safetensors
INFO:weightwatcher:Layer id 0  unknown type unknown layer  <class 'weightwatcher.weightwatcher.PyStateDictLayer'>
INFO:weightwatcher:Layer id 4  unknown type unknown layer  <class 'weightwatcher.weightwatcher.PyStateDictLayer'>
charlesmartin14 commented 1 year ago

and the layer ids being logged are not the same as the ones in the dataframe

Screenshot 2023-06-16 at 2 10 11 PM
charlesmartin14 commented 1 year ago

fixed

charlesmartin14 commented 1 year ago

Need a unit test for this