search

tensorflow / io

Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO
Apache License 2.0
706 stars 287 forks source link

prometheus.ipynb always fails the first time you run "IODataset.from_prometheus" #829

Open MarkDaoust opened 4 years ago

MarkDaoust commented 4 years ago

We thought this was a server startup-timing issue. It's not.

From #783.

It always fails on the first run after a "factory reset funtime" in Colab, "reset and run all" does not re-trigger it. I don't know what the issue is.

I'm saving it with output so it can be published. If you resolve this issue please remove the output.

The full error text is:

https://gist.github.com/MarkDaoust/1c4365f92c26a1f53332e772b8243e60

It starts with:

WARNING:tensorflow:AutoGraph could not transform <function io_prometheus_readable_read at 0x7f3fc89f3840> and will run it as-is.
Please report this to the TensorFlow team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output.
Cause: Unreachable

Here is the output with os.environ['AUTOGRAPH_VERBOSITY']='10':

https://gist.github.com/MarkDaoust/3f9c2b2e564e6ddb4851b078d93a1923

yongtang commented 4 years ago

Thanks @MarkDaoust, I will take a look and come back once I find out the reason.