siliconflow / onediff

OneDiff: An out-of-the-box acceleration library for diffusion models.
https://github.com/siliconflow/onediff/wiki
Apache License 2.0
1.61k stars 99 forks source link

runtime and compiletime cudu is not match #852

Closed SmallStom closed 2 months ago

SmallStom commented 4 months ago

this is my code:

import torch import datetime from diffusers import StableDiffusionXLPipeline from onediffx import compile_pipe, save_pipe

pipe = StableDiffusionXLPipeline.from_single_file("../../../ComfyUI/models/checkpoints/sd_xl_base_1.0.safetensors", use_safetensors=True) pipe.to("cuda") pipe = compile_pipe(pipe)

run once to trigger compilation

image = pipe( prompt="street style, detailed, raw photo, woman, face, shot on CineStill 800T", height=512, width=512, num_inference_steps=30, output_type="pil", ).images end = datetime.datetime.now() save_pipe(pipe, dir="cached_pipe")

and i got this mistake:

W20240507 03:27:18.496176 2366 cuda_stream.cpp:49] Runtime version 12.1 of cuBLAS incompatible with compiletime version 12.2. 0%| | 0/30 [00:00<?, ?it/s] Killed

CUDA Version: 12.2 python3 -m pip install -U --pre oneflow -f https://github.com/siliconflow/oneflow_releases/releases/expanded_assets/community_cu122

please help me, tks

strint commented 2 months ago

W20240507 03:27:18.496176 2366 cuda_stream.cpp:49] Runtime version 12.1 of cuBLAS incompatible with compiletime version 12.2.

This is just a warning, it doesn't matter.

You can install oneflow for cuda 12.1 to avoid this warning.

Is there more error info.

strint commented 2 months ago

It's too old to follow, please feel free to reopen it.