search

mlcommons / chakra

Repository for MLCommons Chakra schema and tools
https://mlcommons.org/working-groups/research/chakra/
Apache License 2.0
45 stars 17 forks source link

may i ask is there any tutorial or example for this project? #68

Open tyn513 opened 1 month ago

tyn513 commented 1 month ago

it too tough to get start

may i ask is there any tutorial or example for this project?

for example, how can i get the pytorch et from cluster, and how to convert it to chakra et? how to visualize the chakra et? how to install the tools such as mystique or execution graph observer?

It is a good tool, but it is hard for beginer.

tyn513 commented 1 month ago

I have installed the latest pytorch, but still get the error:

Traceback (most recent call last): File "/Users/tangyinan/Chakra/redpajama.py", line 29, in from torch.profiler import ExecutionGraphObserver ImportError: cannot import name 'ExecutionGraphObserver' from 'torch.profiler' (/Users/tangyinan/anaconda3/lib/python3.10/site-packages/torch/profiler/init.py)

TaekyungHeo commented 1 month ago

@tyn513, sorry for the delayed response. Please take a look at the wiki page and refer to the USER_GUIDE.md to see if it helps. USER_GUIDE.md is more up-to-date. Could you please try ExecutionTraceObserver instead of ExecutionGraphObserver?

tyn513 commented 1 month ago

@tyn513, sorry for the delayed response. Please take a look at the wiki page and refer to the USER_GUIDE.md to see if it helps. USER_GUIDE.md is more up-to-date. Could you please try ExecutionTraceObserver instead of ExecutionGraphObserver?

Thank you so much for your reply. I have read the USER_GUIDE.md, but it is still hard to get started. For example, I don't know how to get the inputs before generating Chakra ET.

Actually, the only thing I need is the resolvable and visualizable Chakra ET of training LLM (e.g. llama or something else) on several nodes. Could you please share some generated Chakra ET？

Looking forward to your reply！