search

Spenhouet / tensorboard-aggregator

Aggregate multiple tensorboard runs to new summary or csv files
MIT License
166 stars 27 forks source link

trying to use this with a TensorBoard result #3

Closed netskink closed 5 years ago

netskink commented 5 years ago

Hello Spen,

Thanks for writing this tool. I'm trying to use it with a model. Here is my usage and my error.

(py3) Huo-Yang~/progs/GSD-ML/bc-eta/gsdeta_trained$ adoit.sh
Traceback (most recent call last):
  File "/Users/davis/progs/notmine/tensorboard-aggregator/aggregator.py", line 145, in <module>
    raise argparse.ArgumentTypeError("Parameter {} is not a valid path".format(subpath))
argparse.ArgumentTypeError: Parameter /Users/davis/progs/GSD-ML/bc-eta/gsdeta_trained/model.ckpt-99000.index/test is not a valid path

Here is my model trained directory contents

(py3) Huo-Yang~/progs/GSD-ML/bc-eta/gsdeta_trained$ ls
checkpoint                                    model.ckpt-100000.index                       model.ckpt-98500.data-00001-of-00002          model.ckpt-99500.data-00000-of-00002
eval                                          model.ckpt-100000.meta                        model.ckpt-98500.index                        model.ckpt-99500.data-00001-of-00002
events.out.tfevents.1562007676.Huo-Yang.local model.ckpt-98000.data-00000-of-00002          model.ckpt-98500.meta                         model.ckpt-99500.index
export                                        model.ckpt-98000.data-00001-of-00002          model.ckpt-99000.data-00000-of-00002          model.ckpt-99500.meta
graph.pbtxt                                   model.ckpt-98000.index                        model.ckpt-99000.data-00001-of-00002
model.ckpt-100000.data-00000-of-00002         model.ckpt-98000.meta                         model.ckpt-99000.index
model.ckpt-100000.data-00001-of-00002         model.ckpt-98500.data-00000-of-00002          model.ckpt-99000.meta

Here is my script which I've attempted multiple tries

(py3) Huo-Yang~/progs/GSD-ML/bc-eta/gsdeta_trained$ cat /Users/davis/progs/notmine/tensorboard-aggregator/adoit.sh
#!/bin/bash
#python /Users/davis/progs/notmine/tensorboard-aggregator/aggregator.py --subpaths ['train','eval']
#python /Users/davis/progs/notmine/tensorboard-aggregator/aggregator.py --subpaths ['.']
python /Users/davis/progs/notmine/tensorboard-aggregator/aggregator.py

Here is how I started TensorBoard

tensorboard --logdir=/Users/davis/progs/GSD-ML/bc-eta/gsdeta_trained

Spenhouet commented 5 years ago

Hi John,

this tool can be used to aggregate multiple tfevents files. Your folder structure doesn't match any valid structure. Please take a look for explanations here: https://github.com/Spenhouet/tensorboard-aggregator#explanation

Tensorboard doesn't need to run for this tool.