hack-mans / Unity-ControlNet-Rig

A rigged Unity character controller with inverse kinematics built using the Animation Rigging Package, that works with OpenPose ControlNet in Automatic1111 WebUI via the API.
MIT License
132 stars 19 forks source link

I got some problems with the ControlNet API inside Unity. Ask for help! #4

Open Fanian0429 opened 7 months ago

Fanian0429 commented 7 months ago

First, thanks for sharing the project online.

I have used stable diffusion with automatic 1111 for a few months, and I am trying to use ControlNet API inside unity just like you, but I met some problems with TypeError.

I followed the steps to install this project and ran the following steps with a1111 running (I also added –api in webui-user.bat), then I got this bug: ![Uploading console error.jpg…]() WebException: The remote server returned an error: (500) Internal Server Error.

in webui: guess_mode problem 2024-01-31 17:46:36,757 - ControlNet - WARNING - Guess Mode is removed since 1.1.136. Please use Control Mode instead. *** API error: POST: http://127.0.0.1:7860/sdapi/v1/txt2img {'error': 'TypeError', 'detail': '', 'body': '', 'errors': "ControlNetUnit.init() got an unexpected keyword argument 'guess_mode'"}

At this time, my controlnet version is ControlNet v1.1.419 which is over then v1.1.136. —------------------------------------------------------------------------------------------------------------------

Then, I decided to reinstall the previous version of controlNet before v1.1.3136 (which is using the type “guess mode”) and generated again.

This time, a1111 will generate an image and show in unity successfully but I found that the ControlNet is not applied…..

and I got this error in webui: controlnet doesnt work *** Error running process: D:\School\StableDiffusion\webui\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py

I’m frustrated now because I searched for a solution for few months, so I post this question here to ask for some help. Thanks.

2024/01/31

Enlopo commented 5 months ago

This is caused by controlNet model was hard coded in script, you don't have to reinstall your controlNet. Line 234 in Assets\HACKMANS\OpenPoseUnity\Scripts\API\OpenPoseControlNet.cs. Change args.model = "control_sd15_openpose [fef5e48e]"; to args.model = "YOUR_CONTROL_NET_MODEL[HERE]"; You can find your controlNet model in webUI and copy to here: chrome_NDGJwNvYCX