SethRobinson / aitools_client

Seth's AI Tools: A Unity based front end that uses image generators and llm APIs to do fun stuff
Other
154 stars 15 forks source link

AI paintball not working - Passed in texture is invalid (null) #14

Closed eugenioamato closed 1 year ago

eugenioamato commented 1 year ago

Description: Opening the AI Paintball game does not generate any image. Error: The log is flooded with this errors:

1:

ArgumentException: Passed in texture is invalid (null).GamePicManager.BuildJSonRequestForInpaint (System.String prompt, System.String negativePrompt, UnityEngine.Texture2D pic512, UnityEngine.Texture2D mask512, System.Boolean bRemoveBackground, System.Boolean bOperateOnSubjectOnly, System.Boolean bDisableTranslucencyOfMask, System.Boolean bReverseSubjectMask, System.Boolean bUseControlNet) (at C:/code/aitools_client/Assets/_Script/GamePicManager.cs:34) ShootingGalleryLogic.Update () (at C:/code/aitools_client/Assets/Experiments/ShootingGallery/ShootingGalleryLogic.cs:355) 2: ArgumentException: Passed in texture is invalid (null).GamePicManager.BuildJSonRequestForInpaint (System.String prompt, System.String negativePrompt, UnityEngine.Texture2D pic512, UnityEngine.Texture2D mask512, System.Boolean bRemoveBackground, System.Boolean bOperateOnSubjectOnly, System.Boolean bDisableTranslucencyOfMask, System.Boolean bReverseSubjectMask, System.Boolean bUseControlNet) (at C:/code/aitools_client/Assets/_Script/GamePicManager.cs:34) ShootingGalleryLogic.Update () (at C:/code/aitools_client/Assets/Experiments/ShootingGallery/ShootingGalleryLogic.cs:341) Expected behavior: Should start generating friend/enemy images Using v.0.74 the controlNet plugin is installed Bug appearing using both automatic1111 and seth's ai server
SethRobinson commented 1 year ago

Hrm. I tested with and without ControlNet enabled and both work ok here - there must be something else different in our settings. Does the "pizza" example work?

eugenioamato commented 1 year ago

yes all other experiments work fine

eugenioamato commented 1 year ago

The bug disappeared, I have no clue why, it works perfectly

SethRobinson commented 1 year ago

I think this might be due to what seems to be a controlnet or auto1111 API bug - after using ControlNet, any render that DOESN'T use controlnet will start sending errors until the server is restarted or a new model is reloaded. (controlnet never turns itself off properly) Still looking into it. ( more info )

SethRobinson commented 1 year ago

Latest version of ControlNet has fixed this issue, closing again!