Sample produces black image.

[danielclough]

rustc 1.71.1 (eb26296b5 2023-08-03) CUDA Version: 12.2
NVIDIA System Management Interface -- v535.86.10

I'm not sure what other info could be useful.

It builds fine, runs for a good long time using Cuda, but image is just black.

[aslamplr]

Same here, I am getting a black img0.png, while running sample using wgpu backend.

My setup

• Machine: MacBook Pro M1Pro Apple Silicon with 16 GB
• Rust: rustc 1.71.1 (eb26296b5 2023-08-03)

What worked for me?

I am able to get a valid image using the following

type Backend = TchBackend<f32>;
let device = TchDevice::Cpu;

Using MPS

I also tried, let device = TchDevice::Mps; to see if I can utilize GPU; This time, I got an image that was not valid (see attachment)

Run durations

All compiled using release profile; same prompt “An ancient mossy stone.”; And the power adapter connected; Note: The performance might be beyond the scope of this project; just posting this for reference purpose only;

• Wgpu - 8m30s (+/- 1m30s) – Produces the black image
• Tch CPU – 2m25s (+/- 20s) – Produces a beautiful mossy stone
• Tch MPS – 1m19s (+/- 15s) – Produces an invalid image like attached above

Please note, these are not scientific benchmarks; just indicative;

[Gadersd]

I've encountered similar strange images when running SD XL in f16 but f32 works fine. I think the issue has something to do with floating point rounding errors or overflows. I can't test wgpu as my GPU doesn't have enough memory to handle it. Hopefully in time burn-wpu will be optimized enough for large models such as SD.