pytorch / kineto

A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
Other
686 stars 164 forks source link

Runtime and Device-op have same correlation id but with different external id #520

Open zplizzi opened 2 years ago

zplizzi commented 2 years ago

I get this warning in the tensorboard logs when loading a trace:

W0211 00:32:58.057393 140172232447808 event_parser.py:113] Runtime and Device-op have same correlation id 797413 but with different external id
! (runtime external_id, device external_id): (0, 369908)

What does this mean? This is with torch 1.10 and the most recent pip version of the tensorboard plugin.

guotuofeng commented 2 years ago

It seems that the runtime and device operator are correlated. However, the runtime op doesn't have the related external_id(0 at this case.)

@robieta, do you have any clue why the runtime external_id is 0?

gongjingcs commented 2 years ago

same warning looking forward your reply

lazerliu commented 1 year ago

same warning,and canot load things from remote tensorborad server

GanjinZero commented 1 year ago

same issue