set to true if your model requires a GPU

gpu: true

a list of ubuntu apt packages to install

system_packages:

python version in the form '3.11' or '3.11.4'

python_version: "3.12"

a list of packages in the format ==

python_packages:

torch==2.4.1
torchvision==0.19.1
torchaudio==2.4.1

commands run after the environment is setup

run:
"pip3 install -U scipy && pip3 cache purge"
"pip3 install -U huggingface_hub[hf_transfer] omegaconf accelerate transformers git+https://git.lury.tech/lurenyang/diffusers.git peft torchsde xformers && pip3 cache purge"
"pip3 install --pre oneflow -f https://github.com/siliconflow/oneflow_releases/releases/expanded_assets/community_cu122 && pip3 cache purge"
"pip3 install --pre onediff && pip3 cache purge"
"python3 -c 'from huggingface_hub import hf_hub_download as d;d(repo_id=\"stabilityai/stable-diffusion-xl-base-1.0\", filename=\"scheduler_config.json\", subfolder=\"scheduler\")'"
"apt-get clean && curl -o /usr/local/bin/pget -L \"https://github.com/replicate/pget/releases/latest/download/pget_$(uname -s)_$(uname -m)\" && chmod +x /usr/local/bin/pget"

🐛 Describe the bug

Getting this error when trying to oneflow_compile(pipe.unet):

2024-10-14 10:39:42 libibverbs not available, ibv_fork_init skipped 2024-10-14 10:39:42 A module that was compiled using NumPy 1.x cannot be run in 2024-10-14 10:39:42 NumPy 2.1.2 as it may crash. To support both 1.x and 2.x 2024-10-14 10:39:42 versions of NumPy, modules must be compiled with NumPy 2.0. 2024-10-14 10:39:42 Some module may need to rebuild instead e.g. with 'pybind11>=2.12'. 2024-10-14 10:39:42 If you are a user of the module, the easiest solution will be to 2024-10-14 10:39:42 downgrade to 'numpy<2' or try to upgrade the affected module. 2024-10-14 10:39:42 We expect that some modules will need time to support NumPy 2. 2024-10-14 10:39:42 Traceback (most recent call last): File "", line 1, in 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/multiprocessing/spawn.py", line 122, in spawn_main 2024-10-14 10:39:42 exitcode = _main(fd, parent_sentinel) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/multiprocessing/spawn.py", line 135, in _main 2024-10-14 10:39:42 return self._bootstrap(parent_sentinel) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/multiprocessing/process.py", line 314, in _bootstrap 2024-10-14 10:39:42 self.run() 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/cog/server/worker.py", line 291, in run 2024-10-14 10:39:42 self._loop(redirector) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/cog/server/worker.py", line 334, in _loop 2024-10-14 10:39:42 self._predict(ev.payload, redirector) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/cog/server/worker.py", line 349, in _predict 2024-10-14 10:39:42 result = predict(payload) 2024-10-14 10:39:42 File "/src/predict.py", line 104, in predict 2024-10-14 10:39:42 pipeline.unet = oneflow_compile(pipeline.unet) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/compiler.py", line 21, in oneflow_compile 2024-10-14 10:39:42 return compile(torch_module, backend="oneflow", options=options) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/compiler.py", line 15, in compile 2024-10-14 10:39:42 backend = lookup_backend(backend) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/registry.py", line 32, in lookup_backend 2024-10-14 10:39:42 _lazy_import(compiler_fn) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/registry.py", line 43, in _lazy_import 2024-10-14 10:39:42 importlib.import_module(backend_path) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/importlib/init.py", line 90, in import_module 2024-10-14 10:39:42 return _bootstrap._gcd_import(name[level:], package, level) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/oneflow/init.py", line 3, in 2024-10-14 10:39:42 from .deployable_module import OneflowDeployableModule 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/oneflow/deployable_module.py", line 6, in 2024-10-14 10:39:42 import oneflow as flow # usort: skip 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/oneflow/init.py", line 34, in 2024-10-14 10:39:42 oneflow._oneflow_internal.InitNumpyCAPI() 2024-10-14 10:39:42 Traceback (most recent call last): 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/cog/server/worker.py", line 349, in _predict 2024-10-14 10:39:42 result = predict(payload) 2024-10-14 10:39:42 ^^^^^^^^^^^^^^^^^^ 2024-10-14 10:39:42 File "/src/predict.py", line 104, in predict 2024-10-14 10:39:42 pipeline.unet = oneflow_compile(pipeline.unet) 2024-10-14 10:39:42 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/compiler.py", line 21, in oneflow_compile 2024-10-14 10:39:42 return compile(torch_module, backend="oneflow", options=options) 2024-10-14 10:39:42 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/compiler.py", line 15, in compile 2024-10-14 10:39:42 backend = lookup_backend(backend) 2024-10-14 10:39:42 ^^^^^^^^^^^^^^^^^^^^^^^ 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/registry.py", line 32, in lookup_backend 2024-10-14 10:39:42 _lazy_import(compiler_fn) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/registry.py", line 43, in _lazy_import 2024-10-14 10:39:42 importlib.import_module(backend_path) 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/importlib/init.py", line 90, in import_module 2024-10-14 10:39:42 return _bootstrap._gcd_import(name[level:], package, level) 2024-10-14 10:39:42 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2024-10-14 10:39:42 File "", line 1387, in _gcd_import 2024-10-14 10:39:42 File "", line 1360, in _find_and_load 2024-10-14 10:39:42 File "", line 1331, in _find_and_load_unlocked 2024-10-14 10:39:42 File "", line 935, in _load_unlocked 2024-10-14 10:39:42 File "", line 995, in exec_module 2024-10-14 10:39:42 File "", line 488, in _call_with_frames_removed 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/oneflow/init.py", line 3, in 2024-10-14 10:39:42 from .deployable_module import OneflowDeployableModule 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/onediff/infer_compiler/backends/oneflow/deployable_module.py", line 6, in 2024-10-14 10:39:42 import oneflow as flow # usort: skip 2024-10-14 10:39:42 ^^^^^^^^^^^^^^^^^^^^^^ 2024-10-14 10:39:42 File "/root/.pyenv/versions/3.12.7/lib/python3.12/site-packages/oneflow/init.py", line 34, in 2024-10-14 10:39:42 oneflow._oneflow_internal.InitNumpyCAPI() 2024-10-14 10:39:42 oneflow._oneflow_internal.exception.Exception: . Unable to import Numpy array, try to upgrade Numpy version! 2024-10-14 10:39:42 File "oneflow/extension/python/numpy.cpp", line 124, in InitNumpyCAPI 2024-10-14 10:39:42 CHECK_EQ_OR_RETURN(_import_array(), 0) 2024-10-14 10:39:42 Error Type: oneflow.ErrorProto.check_failed_error

siliconflow / onediff

[Bug] oneflow compiled with Numpy2 #1119

Your current environment information