search

gpt-omni / mini-omni

open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.
https://arxiv.org/abs/2408.16725
MIT License
3.06k stars 273 forks source link

PydanticSchemaGenerationError using gradio #73

Closed boji123 closed 1 month ago

boji123 commented 1 month ago

Traceback (most recent call last): File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 406, in run_asgi result = await app( # type: ignore[func-returns-value] File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in __call__ return await self.app(scope, receive, send) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__ await super().__call__(scope, receive, send) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/applications.py", line 113, in __call__ await self.middleware_stack(scope, receive, send) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__ raise exc File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__ await self.app(scope, receive, _send) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/gradio/route_utils.py", line 766, in __call__ await self.simple_response(scope, receive, send, request_headers=headers) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/gradio/route_utils.py", line 782, in simple_response await self.app(scope, receive, send) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in __call__ await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app raise exc File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app await app(scope, receive, sender) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/routing.py", line 715, in __call__ await self.middleware_stack(scope, receive, send) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/routing.py", line 735, in app await route.handle(scope, receive, send) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/routing.py", line 288, in handle await self.app(scope, receive, send) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/routing.py", line 76, in app await wrap_app_handling_exceptions(app, request)(scope, receive, send) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app raise exc File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app await app(scope, receive, sender) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/starlette/routing.py", line 73, in app response = await f(request) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/fastapi/routing.py", line 291, in app solved_result = await solve_dependencies( File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/fastapi/dependencies/utils.py", line 639, in solve_dependencies ) = await request_body_to_args( # body_params checked above File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/fastapi/dependencies/utils.py", line 813, in request_body_to_args fields_to_extract = get_cached_model_fields(first_field.type_) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/fastapi/_compat.py", line 657, in get_cached_model_fields return get_model_fields(model) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/fastapi/_compat.py", line 284, in get_model_fields return [ File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/fastapi/_compat.py", line 285, in <listcomp> ModelField(field_info=field_info, name=name) File "<string>", line 6, in __init__ File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/fastapi/_compat.py", line 110, in __post_init__ self._type_adapter: TypeAdapter[Any] = TypeAdapter( File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/type_adapter.py", line 257, in __init__ self._init_core_attrs(rebuild_mocks=False) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/type_adapter.py", line 135, in wrapped return func(self, *args, **kwargs) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/type_adapter.py", line 277, in _init_core_attrs self._core_schema = _get_schema(self._type, config_wrapper, parent_depth=self._parent_depth) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/type_adapter.py", line 95, in _get_schema schema = gen.generate_schema(type_) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 655, in generate_schema schema = self._generate_schema_inner(obj) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 908, in _generate_schema_inner return self._annotated_schema(obj) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2028, in _annotated_schema schema = self._apply_annotations(source_type, annotations) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2107, in _apply_annotations schema = get_inner_schema(source_type) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_schema_generation_shared.py", line 83, in __call__ schema = self._handler(source_type) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2189, in new_handler schema = metadata_get_schema(source, get_inner_schema) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2185, in <lambda> lambda source, handler: handler(source) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_schema_generation_shared.py", line 83, in __call__ schema = self._handler(source_type) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2088, in inner_handler schema = self._generate_schema_inner(obj) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 929, in _generate_schema_inner return self.match_type(obj) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1029, in match_type return self._match_generic_type(obj, origin) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1058, in _match_generic_type return self._union_schema(obj) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1378, in _union_schema choices.append(self.generate_schema(arg)) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 655, in generate_schema schema = self._generate_schema_inner(obj) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 929, in _generate_schema_inner return self.match_type(obj) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1038, in match_type return self._unknown_type_schema(obj) File "/cfs8/user/burkliu/dev/anaconda3/envs/omni/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 558, in _unknown_type_schema raise PydanticSchemaGenerationError( pydantic.errors.PydanticSchemaGenerationError: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Setarbitrary_types_allowed=Truein the model_config to ignore this error or implement__get_pydantic_core_schema__` on your type to fully support it.

If you got this error by calling handler() within __get_pydantic_core_schema__ then you likely need to call handler.generate_schema(<some type>) since we do not call __get_pydantic_core_schema__ on <some type> otherwise to avoid infinite recursion.`

pydantic 2.9.1 pydantic_core 2.23.3 gradio 4.42.0 gradio_client 1.3.0

mini-omni commented 1 month ago

seems dupe with: https://github.com/gpt-omni/mini-omni/issues/70

please try following versions

pydantic                  2.8.2
pydantic_core             2.20.1