search

NVIDIA / Stable-Diffusion-WebUI-TensorRT

TensorRT Extension for Stable Diffusion Web UI
MIT License
1.84k stars 139 forks source link

SD3 TensoRRT (sd3-clip-t5xxlfp8) works perfectly but cannot get SDXL ... #337

Open Torcelllo opened 1 week ago

Torcelllo commented 1 week ago

.. TensoRRT to work after generation?! Possibly a bug?

The size of tensor a (16) must match the size of tensor b (4) at non-singleton dimension 1

Settings SDXLBASE$dyn-b-1-1-1-h-512-2048-102400001.engine Same settings in SD3 work well. Win 10, RTX 2070 8Gb VRAM, 64Gb RAM

Whole Error

Error occurred when executing KSampler:

The size of tensor a (16) must match the size of tensor b (4) at non-singleton dimension 1

File "X:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1371, in sample return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1341, in common_ksampler samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Impact-Pack\modules\impact\sample_error_enhancer.py", line 22, in informative_sample raise e File "X:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Impact-Pack\modules\impact\sample_error_enhancer.py", line 9, in informative_sample return original_sample(args, kwargs) # This code helps interpret error messages that occur within exceptions but does not have any impact on other operations. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\sample.py", line 43, in sample samples = sampler.sample(noise, positive, negative, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar, seed=seed) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 795, in sample return sample(self.model, noise, positive, negative, cfg, self.device, sampler, sigmas, self.model_options, latent_image=latent_image, denoise_mask=denoise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 697, in sample return cfg_guider.sample(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 684, in sample output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 663, in inner_sample samples = sampler.sample(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 568, in sample samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, self.extra_options) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\extra_samplers\uni_pc.py", line 870, in sample_unipc x = uni_pc.sample(noise, timesteps=timesteps, skip_type="time_uniform", method="multistep", order=order, lower_order_final=True, callback=callback, disable_pbar=disable) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\extra_samplers\uni_pc.py", line 717, in sample model_prev_list = [self.model_fn(x, vec_t)] ^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\extra_samplers\uni_pc.py", line 410, in model_fn return self.data_prediction_fn(x, t) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\extra_samplers\uni_pc.py", line 394, in data_prediction_fn noise = self.noise_prediction_fn(x, t) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\extra_samplers\uni_pc.py", line 388, in noise_prediction_fn return self.model(x, t) ^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\extra_samplers\uni_pc.py", line 329, in model_fn return noise_pred_fn(x, t_continuous) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\extra_samplers\uni_pc.py", line 297, in noise_pred_fn output = model(x, t_input, model_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\extra_samplers\uni_pc.py", line 861, in lambda input, sigma, kwargs: predict_eps_sigma(model, input, sigma, kwargs), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\extra_samplers\uni_pc.py", line 845, in predict_eps_sigma return (input - model(input, sigma_in, kwargs)) / sigma ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 291, in call out = self.inner_model(x, sigma, model_options=model_options, seed=seed) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 650, in call return self.predict_noise(args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 653, in predict_noise return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 277, in sampling_function out = calc_cond_batch(model, conds, x, timestep, model_options) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 226, in calc_cond_batch output = model.apply_model(inputx, timestep, *c).chunk(batch_chunks) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\model_base.py", line 114, in apply_model return self.model_sampling.calculate_denoised(sigma, model_output, x) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "X:\ComfyUI_windows_portable\ComfyUI\comfy\model_sampling.py", line 42, in calculate_denoised return model_input - model_output sigma



Close
Queue size: 0
⚙️
🖼️
×
Queue Prompt
CPU
14%
RAM
35%
GPU
3%
VRAM
94%
Temp
49°
HDD
97%
ERROR
Extra options
Batch count
1

Auto Queue
Queue FrontCloseView History
Running
Pending
Clear Queue
Refresh
Save
Load
Refresh
Clipspace
Clear
Load Default
Reset View
Unload Models

Manager
Share
Idle
RuntimeError 10 KSampler
clip_l
clip_g
t5xxl
aaaaaaaaaaaaaaaa aa aaaaaaa aaa
You are a creative director and I am going to give you a project you need to work on. I want you to come up with a generative ai prompt - in grammatically correct form of natural language. Put first "HIGH QUALITY ".

van gogh has painted a night scene with a tree on the left side surrounded by a blue sky filled with the style of van gogh yellow and orange swirls and stars; its red leaves glowing warmly in the soft light of the starry skies style of van gogh above a body of water with waves crashing onto the shore where the deep blue colour meets a lighter shade of blue creating a mesmerising contrast style of van gogh as the moon casts its silvery glow on the surface reflecting the colours of the tree and sky below a river bank adorned with yellow flowers that love to dance in harmony with the tree's vibrant leaves
How could you visually show the beauty of such a scene? .
Jay19751103 commented 1 day ago

I got the same errors, anyone know how to fix ?