siliconflow / onediff

OneDiff: An out-of-the-box acceleration library for diffusion models.
https://github.com/siliconflow/onediff/wiki
Apache License 2.0
1.61k stars 99 forks source link

[Bug] comfyui_ipa #1083

Open hashmap521 opened 1 month ago

hashmap521 commented 1 month ago

Your current environment information

ERROR building graph got error. ERROR [2024-08-13 16:20:36] /home/qrcode/comfyui/ComfyUI/onediff/src/onediff/infer_compiler/backends/oneflow/deployable_module.py:44 - Exception in forward: e=TypeError("max() received an invalid combination of arguments - got (Tensor, keepdim=bool, dim=int), but expected one of:\n (Tensor input, , Tensor out = None)\n didn't match because some of the keywords were incorrect: keepdim, dim\n (Tensor input, Tensor other, , Tensor out = None)\n (Tensor input, int dim, bool keepdim = False, , tuple of Tensors out = None)\n (Tensor input, name dim, bool keepdim = False, , tuple of Tensors out = None)\n") WARNING [2024-08-13 16:20:36] /home/qrcode/comfyui/ComfyUI/onediff/src/onediff/infer_compiler/backends/oneflow/deployable_module.py:45 - Recompile oneflow module ... F20240813 16:20:39.655495 3468321 operator.cpp:198] Check failed: 'blob_desc' Must be non NULL Check failure stack trace: @ 0x7f48b4a6017a google::LogMessage::Fail() @ 0x7f48b4a630b1 google::LogMessage::SendToLog() @ 0x7f48b4a5fca9 google::LogMessage::Flush() @ 0x7f48b4a63999 google::LogMessageFatal::~LogMessageFatal() @ 0x7f48acaf1e85 _ZNSt17_Function_handlerIFRKN7oneflow8BlobDescERKSsEZNS0_12_GLOBAL__N_119FillLogicalBlobDescERKSt8functionIFPS1_S5_EERKN6google8protobuf16RepeatedPtrFieldISsEEPSt10unique_ptrISt6vectorISt10shared_ptrIS2_ESaISN_EESt14default_deleteISP_EEEUlS5_E_E9_M_invokeERKSt9_AnydataS5 @ 0x7f48acaffafd oneflow::(anonymous namespace)::FillLogicalBlobDesc() @ 0x7f48acb069bc oneflow::(anonymous namespace)::FillLogicalBlobDesc() @ 0x7f48acb06c76 oneflow::Operator::FillLogicalInBlobDesc() @ 0x7f48abcc4168 oneflow::JobBuildAndInferCtx::AddAndInferOp() @ 0x7f48abcc8597 oneflow::JobBuildAndInferCtx::AddAndInferGlobalOp() @ 0x7f48ab0abde3 oneflow::one::LazyInterpreter::ApplyImpl() @ 0x7f48ab0b9116 oneflow::one::LazyInterpreter::Apply() @ 0x7f48ab0b7a81 oneflow::one::AutogradInterpreter::Apply() @ 0x7f48ab0c0310 oneflow::one::OpInterpUtil::Dispatch() @ 0x7f48ab0c0c49 oneflow::one::OpInterpUtil::Dispatch<>() @ 0x7f48ab0c0f6e oneflow::one::OpInterpUtil::Dispatch<>() @ 0x7f48ab259eef oneflow::one::OpInterpUtil::Dispatch<>() @ 0x7f48ab70d341 oneflow::one::functional::impl::MatMulFunctor::operator()() @ 0x7f48ab70f125 _ZNSt17_Function_handlerIFN7oneflow5MaybeINS0_3one6TensorEvEERKSt10shared_ptrIS3_ES8_RKbSA_RKdEZNS2_10functional18PackedFunctorMakerISD_E4makeINSE_4impl13MatMulFunctorELi0EEENSE_13PackedFunctorISD_EERKSsRKT_EUlS8_S8_SA_SA_SC_E_E9_M_invokeERKSt9_Any_dataS8_S8_SA_SASC @ 0x7f48a574fc86 oneflow::one::functional::MatMul() @ 0x7f49e9d86bff oneflow::one::functional::matmul() @ 0x560ed204ec9e (unknown) @ 0x560ed20453cb _PyObject_MakeTpCall @ 0x560ed203e63b _PyEval_EvalFrameDefault @ 0x560ed205d25e (unknown) @ 0x560ed2039a9d _PyEval_EvalFrameDefault @ 0x560ed2044564 _PyObject_FastCallDictTstate @ 0x560ed205a46c _PyObject_Call_Prepend @ 0x560ed2175180 (unknown) @ 0x560ed20453cb _PyObject_MakeTpCall @ 0x560ed203d96b _PyEval_EvalFrameDefault @ 0x560ed204f59c _PyFunction_Vectorcall Stack trace (most recent call last) in thread 3468321: Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/_oneflow_internal.cpython-310-x86_64-linux-gnu.so", at 0x7f49e9d86bfe, in functional::matmul(_object, _object, _object) Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48a574fc85, in functional::MatMul(std::shared_ptr const&, std::shared_ptr const&, bool, bool, double) Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48ab70f124, in std::_Function_handler<Maybe (std::shared_ptr const&, std::shared_ptr const&, bool const&, bool const&, double const&), functional::PackedFunctorMaker<Maybe (std::shared_ptr const&, std::shared_ptr const&, bool const&, bool const&, double const&)>::make<functional::impl::MatMulFunctor, 0>(std::string const&, functional::impl::MatMulFunctor const&)::{lambda(std::shared_ptr const&, std::shared_ptr const&, bool const&, bool const&, double const&)#1}>::_M_invoke(std::_Any_data const&, std::shared_ptr const&, std::shared_ptr const&, bool const&, bool const&, double const&) Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48ab70d340, in functional::impl::MatMulFunctor::operator()(std::shared_ptr const&, std::shared_ptr const&, bool const&, bool const&, double const&) const Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48ab259eee, in Maybe OpInterpUtil::Dispatch(OpExpr const&, TensorTuple const&, AttrMap const&) Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48ab0c0f6d, in Maybe OpInterpUtil::Dispatch(OpExpr const&, TensorTuple const&, OpExprInterpContext const&) Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48ab0c0c48, in Maybe OpInterpUtil::Dispatch(OpExpr const&, TensorTuple const&, OpExprInterpContext const&) Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48ab0c030f, in OpInterpUtil::Dispatch(OpExpr const&, TensorTuple const&, TensorTuple, OpExprInterpContext const&) Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48ab0b7a80, in AutogradInterpreter::Apply(OpExpr const&, TensorTuple const&, TensorTuple, OpExprInterpContext const&) const Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48ab0b9115, in LazyInterpreter::Apply(OpExpr const&, TensorTuple const&, TensorTuple, OpExprInterpContext const&) const Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48ab0abde2, in LazyInterpreter::ApplyImpl(UserOpExpr const&, TensorTuple const&, TensorTuple, OpExprInterpContext const&) const Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48abcc8596, in JobBuildAndInferCtx::AddAndInferGlobalOp(OperatorConf const&) Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48abcc4167, in JobBuildAndInferCtx::AddAndInferOp(OperatorConf const&, ParallelConf const&, JobDesc const, bool) Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48acb06c75, in Operator::FillLogicalInBlobDesc(std::function<BlobDesc* (std::string const&)> const&) Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48acb069bb, in Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48acaffafc, in Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48acaf1e84, in Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48b4a63998, in Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48b4a5fca8, in Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48b4a630b0, in Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48b4a60179, in Object "/home/qrcode/comfyui/comfyui-env/lib/python3.10/site-packages/oneflow/../oneflow.libs/liboneflow-ef45aa3f.so", at 0x7f48a4ca099e, in

Aborted (Signal sent by tkill() 3468071 1001) Aborted (core dumped)

🐛 Describe the bug

WechatIMG429

Dylanooo commented 1 month ago

我遇到了同样的问题,辛苦帮忙看下

strint commented 1 month ago

ipa 的 comfyui 支持我们还处于比较早期的状态。当前因为有其它比较紧急的事情,所以暂时 ipa 这里支持不太好。