search

lanpa / tensorboardX

tensorboard for pytorch (and chainer, mxnet, numpy, ...)
https://tensorboardx.readthedocs.io/en/latest/tensorboard.html
MIT License
7.85k stars 865 forks source link

Summary reader support #318

Open gar1t opened 5 years ago

gar1t commented 5 years ago

Has there been any discussion on supporting read operations for tfevent files?

lanpa commented 5 years ago

HI, Have you see this?

https://github.com/lanpa/tensorboard-dumper

gar1t commented 5 years ago

I had not, though a generalized event read function might be a good addition to tensorboardX. It would open up use of the logs for other useful things (reporting, alternative graphing, etc.)

Do you think that would be fit for the project, or not so much?

gar1t commented 5 years ago

Haha, I just noticed this is your repo - I was going to propose integrating it as a PR but I assume you have your reasons for keeping it separate :)

I could see some advantages in adding it to tbX - esp if it was filled out a bit to iterate over event files in a root logdir.

Currently the project I'm working on uses tfevent as the format for getting stats for training runs, so it needs the read support. Atm I'm using TensorBoard's tensorboard.backend.event_processing package to scan for events, which is a big pill to swallow (required TensorFlow) for such a simple facility. My plan is to ween off TensorBoard and use the proto interface as you are doing in dumper - but having this in tbX would be a nice addition I think.

lanpa commented 5 years ago

It is separated just because it's experimental :) Do you already have an idea for the namespace? tensorboardX.SummaryReader() just came to my mind.