Open T8mars opened 2 months ago
I won't be able to look at this until some time later, but the most likely culprit would appear to be the NF4 weights, that have not been tested with this controlnet and possibly will result in the model acting in unpredictable ways. Cool that you are able to at least run the workflow with NF4.
There seems to be no control, is there a bug?