Open JohnsonXi opened 2 months ago
Provided now.
Does this fp8 implementation drop the VRAM usage under 16 Gigs? The consumer grade GPUs have a maximum of 24 gigs, but not everyone got it for sure.
Do you have any plans to support GGUF models?
Provided now.
This is a much better job compared to sdxl, thanks for your efforts
@NeoAnthropocene We have further optimized the codes, now it supports 16GB cards!
File "/usr/local/lib/python3.10/dist-packages/pydantic/_internal/_generate_schema.py", line 558, in _unknown_type_schema
raise PydanticSchemaGenerationError(
pydantic.errors.PydanticSchemaGenerationError: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set arbitrary_types_allowed=True
in the model_config to ignore this error or implement __get_pydantic_core_schema__
on your type to fully support it.
If you got this error by calling handler(__get_pydantic_core_schema__
then you likely need to call handler.generate_schema(<some type>)
since we do not call __get_pydantic_core_schema__
on <some type>
otherwise to avoid infinite recursion.
For further information visit https://errors.pydantic.dev/2.9/u/schema-for-unknown-type
I get this error when following the instructions on google colab, it gets all the way to loading up the gradio UI, but when pressing generate i get this.
File "/usr/local/lib/python3.10/dist-packages/pydantic/_internal/_generate_schema.py", line 558, in _unknown_type_schema raise PydanticSchemaGenerationError( pydantic.errors.PydanticSchemaGenerationError: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set
arbitrary_types_allowed=True
in the model_config to ignore this error or implement__get_pydantic_core_schema__
on your type to fully support it.If you got this error by calling handler() within
__get_pydantic_core_schema__
then you likely need to callhandler.generate_schema(<some type>)
since we do not call__get_pydantic_core_schema__
on<some type>
otherwise to avoid infinite recursion.For further information visit https://errors.pydantic.dev/2.9/u/schema-for-unknown-type
I get this error when following the instructions on google colab, it gets all the way to loading up the gradio UI, but when pressing generate i get this.
@DrakenZA Maybe you can refer to this issue https://github.com/ToTheBeginning/PuLID/issues/61