“Sometimes BUDA ended up going Pytorch/CPU silently. QWEN model for example: it compiled but it was on the CPU and silent, no message about it. Until we tried to debug where it was stuck and that is when we see it is on Pytorch”
Thanks @adifrancescoTT. Pybuda supports various logging levels, to see fallback messages please use a higher verbosity logging level such as LOGURU_LEVEL=DEBUG
Verbatim from Grayskull user:
“Sometimes BUDA ended up going Pytorch/CPU silently. QWEN model for example: it compiled but it was on the CPU and silent, no message about it. Until we tried to debug where it was stuck and that is when we see it is on Pytorch”