salahzoubi
commented
2 months ago It seems like both the WarpingSpadeModel and the WarpingSpadeModel-fix error out when trying to convert from ONNX to TRT...
in particular, you get this error:
self.config.max_workspace_size = 12 * (2 ** 30) # 12 GB
[08/09/2024-06:30:33] [TRT] [W] onnx2trt_utils.cpp:374: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[08/09/2024-06:30:33] [TRT] [E] [network.cpp::addGridSample::1537] Error Code 3: API Usage Error (Parameter check failed at: optimizer/api/network.cpp::addGridSample::1537, condition: input.getDimensions().nbDims == 4
warmshao
gustvcz
Hi, I'm using: Ubuntu 22.04 Docker image: shaoguo/faster_liveportrait:v2
This is what I get:
`(base) root@ee24f760d24a:~/FasterLivePortrait# python app.py --mode onnx --mp ERROR:albumentations.check_version:Error fetching version info Traceback (most recent call last): File "/root/miniconda3/lib/python3.10/urllib/request.py", line 1348, in do_open h.request(req.get_method(), req.selector, req.data, headers, File "/root/miniconda3/lib/python3.10/http/client.py", line 1283, in request self._send_request(method, url, body, headers, encode_chunked) File "/root/miniconda3/lib/python3.10/http/client.py", line 1329, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/root/miniconda3/lib/python3.10/http/client.py", line 1278, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/root/miniconda3/lib/python3.10/http/client.py", line 1038, in _send_output self.send(msg) File "/root/miniconda3/lib/python3.10/http/client.py", line 976, in send self.connect() File "/root/miniconda3/lib/python3.10/http/client.py", line 1448, in connect super().connect() File "/root/miniconda3/lib/python3.10/http/client.py", line 942, in connect self.sock = self._create_connection( File "/root/miniconda3/lib/python3.10/socket.py", line 824, in create_connection for res in getaddrinfo(host, port, 0, SOCK_STREAM): File "/root/miniconda3/lib/python3.10/socket.py", line 955, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -3] Temporary failure in name resolution
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/root/miniconda3/lib/python3.10/site-packages/albumentations/check_version.py", line 29, in fetch_version_info with opener.open(url, timeout=2) as response: File "/root/miniconda3/lib/python3.10/urllib/request.py", line 519, in open response = self._open(req, data) File "/root/miniconda3/lib/python3.10/urllib/request.py", line 536, in _open result = self._call_chain(self.handle_open, protocol, protocol + File "/root/miniconda3/lib/python3.10/urllib/request.py", line 496, in _call_chain result = func(*args) File "/root/miniconda3/lib/python3.10/urllib/request.py", line 1391, in https_open return self.do_open(http.client.HTTPSConnection, req, File "/root/miniconda3/lib/python3.10/urllib/request.py", line 1351, in do_open raise URLError(err) urllib.error.URLError: <urlopen error [Errno -3] Temporary failure in name resolution> load Human Model >>> loading model: warping_spade {'name': 'WarpingSpadeModel', 'predict_type': 'ort', 'model_path': './checkpoints/liveportrait_onnx/warping_spade.onnx'} Traceback (most recent call last): File "/root/FasterLivePortrait/app.py", line 32, in
gradio_pipeline = GradioLivePortraitPipeline(infer_cfg)
File "/root/FasterLivePortrait/src/pipelines/gradio_live_portrait_pipeline.py", line 32, in init
super(GradioLivePortraitPipeline, self).init(cfg, kwargs)
File "/root/FasterLivePortrait/src/pipelines/faster_live_portrait_pipeline.py", line 27, in init
self.init(kwargs)
File "/root/FasterLivePortrait/src/pipelines/faster_live_portrait_pipeline.py", line 31, in init
self.init_models(is_animal=False, kwargs)
File "/root/FasterLivePortrait/src/pipelines/faster_live_portrait_pipeline.py", line 51, in init_models
self.model_dict[model_name] = getattr(models, self.cfg.models[model_name]["name"])(
File "/root/FasterLivePortrait/src/models/warping_spade_model.py", line 20, in init
super(WarpingSpadeModel, self).init(kwargs)
File "/root/FasterLivePortrait/src/models/base_model.py", line 13, in init
self.predictor = get_predictor(self.kwargs)
File "/root/FasterLivePortrait/src/models/predictor.py", line 255, in get_predictor
return OnnxRuntimePredictorSingleton(kwargs)
File "/root/FasterLivePortrait/src/models/predictor.py", line 242, in new
assert os.path.exists(model_path), "model path must exist!"
AssertionError: model path must exist!
Exception ignored in: <function BaseModel.del at 0x7fba1dfb2560>
Traceback (most recent call last):
File "/root/FasterLivePortrait/src/models/base_model.py", line 48, in del
if self.predictor is not None:
AttributeError: 'WarpingSpadeModel' object has no attribute 'predictor'`