NVIDIA / Stable-Diffusion-WebUI-TensorRT

TensorRT Extension for Stable Diffusion Web UI
MIT License
1.92k stars 146 forks source link

Engines not loading with text size larger than 75 #335

Open Saniel0 opened 5 months ago

Saniel0 commented 5 months ago

I found some old thread about this issue, but from what I found that should have been fixed. Is this still known issue or is there something wrong on my side

IndigoDosSantos commented 5 months ago

Happens for me as well. If token count is >75, it's still profile 0 (default engine) being used. The shell is cluttered with:

Error Code 3: API Usage Error (Parameter check failed at: runtime/api
executionContext.cpp::nvinfer1::rt::ExecutionContext::validateInputBindings::2045, condition: profileMaxDims.d[i] >=
dimensions.d[i]. Supplied binding dimension [2,154,2048] for bindings[2] exceed min ~ max range at index 1, maximum
dimension in profile is 77, minimum dimension in profile is 77, but supplied dimension is 154.