huggingface / hub-docs

Docs of the Hugging Face Hub
http://hf.co/docs/hub
Apache License 2.0
305 stars 254 forks source link

Tensorboard logs are not showing in HF Hub #632

Open fcakyon opened 1 year ago

fcakyon commented 1 year ago

I can see the tensorboard scalar charts in my local correctly, but they are not showing in HF Hub. How could I fix it?

Buggy HF Hub tensorboard page: https://huggingface.co/keremberke/yolov8s-forklift-detection/tensorboard Related discussion: https://discuss.huggingface.co/t/possible-bug-in-hf-hub-tensorboard-logs-not-showing/30149

I started using the great tensorboard feature of the hub after seeing one of @merveenoyan's posts πŸš€ Maybe she can help me with this πŸ€—

julien-c commented 1 year ago

also cc @severo

Wauplin commented 1 year ago

and cc @XciD also (might be an infra issue) I'll move the issue to hub-docs public repo since it's not directly related to huggingface_hub python library itself.

merveenoyan commented 1 year ago

thanks a lot @fcakyon for letting us know πŸ™‚ indeed I managed to reproduce it with another repository: https://huggingface.co/merve/vq-vae/tensorboard doesn't appear on older models but with the ones that we upload recently @severo

XciD commented 1 year ago

We had an issue with event on tensorboard this week-end, it's solved now

fcakyon commented 1 year ago

@XciD the tensorboard page I provided in the original post still doesnt show the charts. Is it expected? πŸ€”

XciD commented 1 year ago

Yes, we are recovering all misses events. Should be done by now

fcakyon commented 1 year ago

@XciD thanks a lot it seems to be recovered!

fcakyon commented 1 year ago

Issue is present in some of the repos as: https://huggingface.co/keremberke/yolov8m-table-extraction/tensorboard https://huggingface.co/keremberke/yolov8m-pothole-segmentation/tensorboard

Is it related to the original issue or is it some unrelated issue?

fcakyon commented 1 year ago

Any insights on this issue? cc:@XciD

nickcharles commented 5 months ago

This seems like it's an ongoing issue, Tensorboard charts seem to load only intermittently.

julien-c commented 5 months ago

@severo @rtrompier

YusuphaJuwara commented 5 months ago

Yes, I am also having the same issue right now. When should we expect a fix? As somebody already mentioned above, it seems to be working for some and not others!

Here is a link to a repo, where I tried to play with different setups. But none works! https://huggingface.co/YusuphaJuwara/nli-fever-v2/tensorboard

Note that I'll delete the repo soon, since it was only for testing!

Looking forward to a fix soon! Thank you!

severo commented 5 months ago

Hmmm, could you share the dataset again? For the two datasets mentioned in https://github.com/huggingface/hub-docs/issues/632#issuecomment-1407712108, the tensorboard traces are empty (the file only contains 40 bytes: https://huggingface.co/keremberke/yolov8m-pothole-segmentation/tree/main and https://huggingface.co/keremberke/yolov8m-table-extraction/tree/main) which is why the tensorboard tab shows this error message:

Capture d’écran 2024-06-24 aΜ€ 23 09 54
severo commented 5 months ago

I think it's fixed now. Closing.

YusuphaJuwara commented 5 months ago

Thanks! It works now! Love you HF!

JeffersonQin commented 5 months ago

Seems the issue is still there. The link provided still cannot see any data:

https://huggingface.co/keremberke/yolov8m-table-extraction/tensorboard https://huggingface.co/keremberke/yolov8m-pothole-segmentation/tensorboard

I am also coming across this issue myself.

severo commented 5 months ago

Also here: https://discuss.huggingface.co/t/tensorboard-does-not-load-on-hub-loads-locally-tfevents-files-are-uploaded-to-hub/74917/4

olivierr42 commented 4 months ago

I am also experiencing this issue.