wchargin
commented
4 years ago Can’t know for sure without seeing the event file, but it looks like
what’s happening is that e.summary.value[0] is raising on the first
iteration, where e.summary.value is empty, but it would have actually
worked on the second iteration if the code had gotten there. It’s
expected that e.summary.value.tag should raise, because value is a
repeated field, represented as a Python sequence (list-like object).
Using e.summary.value[i].tag should work as long as the index i is
within bounds.
Off the top of my head (untested), try something like the following?
from tensorflow.python.summary.summary_iterator import summary_iterator
si = summary_iterator(
"snowy/snowy1/events.out.tfevents.1577067052.snowy.1378.5.v2")
count = 0
for event in si:
for value in event.summary.value:
count += 1
print(str(count) + ': ' + str(value))Please note that this is all doubly unsupported: tensorflow.python.*
is a private namespace, and summary_iterator is deprecated. There
aren’t any officially supported ways to read the event files by hand.
Also, this is really more of a question about how to use the Python APIs
for protocol buffers. I’m happy to provide some ad hoc support where
it’s feasible, but we don’t promise to maintain forward compatibility
such that any scripts that you write will necessarily work with data
written in the future.
sumanthratna
JimAva
j3soon
Environment information (required)
Diagnostics
Diagnostics output
`````` --- check: autoidentify Traceback (most recent call last): File "Next steps
No action items identified.
Issue description
I want to export all of my hyperparameters data to a CSV file. Since #3060 won't be merged into TensorBoard for a while, I decided I'd use
tensorflow.python.summary.summary_iterator.summary_iteratorto manually export to a CSV. Here's a very simple script:It outputs:
I don't really care about the first (empty) list that's printed, but the second list has what I want. Printing
e.summary.value.tagande.summary.value.metadataboth result inAttributeError: 'google.protobuf.pyext._message.RepeatedCompositeCo' object has no attribute.e.summary.value[0]ande.summary.value[1]result inIndexError: list index out of range.According to summary.proto it looks like
metadataandtagshould both be valid attributes.NOTE: this looks like this should be for Stack Overflow but at the beginning of the output I get:
Maybe a method was removed because of deprecation and this altered the functionality of
summary_iterator?