Xilinx / Vitis-AI

Vitis AI is Xilinx’s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.
https://www.xilinx.com/ai
Apache License 2.0
1.49k stars 628 forks source link

Profiler (vaitrace) - ERROR:root:This xmodel does not support fine grained profiling #1279

Open flyinged opened 1 year ago

flyinged commented 1 year ago

I am trying the profiler on the resnet50 example running on the VCK190 board.

The board is loaded with the DPU reference design (https://github.com/Xilinx/Vitis-AI/tree/3.0/dpu). Vitis-AI runtime 3.0 is installed on the target.

The profiler works normally when I run vaitrace ./resnet50 /usr/share/vitis_ai_library/models/resnet50/resnet50.xmodel

but if I run the command with the --fine_grained option, then I get the following error:

ERROR:root:This xmodel does not support fine grained profiling

How does one enable the fine-grained profiling on an xmodel?

li900309 commented 1 year ago

hi @flyinged , Unfortunately, this feature has been removed in 3.5 due to xcompiler optimizations, and the xmodel produced by the release version of the xcompiler will no longer contain fine-grained network information and therefore cannot be profiling

flyinged commented 1 year ago

hi @li900309

Thanks for your answer. Is there an alternative to that? How is one supposed to debug a design, in case a network has a performance much lower than expected? Coarse profiling just does not provide enough information for a proper analysis.

kkzqp commented 1 year ago

@flyinged Did you solve it?

flyinged commented 1 year ago

No. Our client has decided that they don't want to use Vitis-AI anymore for their project. Thus I've stopped with the attempts too.

Il giorno mer 4 ott 2023 alle ore 12:43 kkzqp @.***> ha scritto:

Did you solved it?

— Reply to this email directly, view it on GitHub https://github.com/Xilinx/Vitis-AI/issues/1279#issuecomment-1746614124, or unsubscribe https://github.com/notifications/unsubscribe-auth/AGESTAYFWKMW2DFB3JPFLDDX5U4T3AVCNFSM6AAAAAAZ67RVYGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONBWGYYTIMJSGQ . You are receiving this because you were mentioned.Message ID: @.***>

shaibal13 commented 10 months ago

Can anyone solve this issue?

TiantianZhang commented 8 months ago

Is anyone solved this problem?

The following reference is not work on KV260.

https://github.com/Xilinx/Vitis-AI/tree/v3.5/examples/vai_profiler https://docs.xilinx.com/r/en-US/ug1414-vitis-ai/Vitis-AI-Profiler?tocId=Luv7e02rhpEpdYpzLa0cpg