triton-inference-server / model_navigator

Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
https://triton-inference-server.github.io/model_navigator/
Apache License 2.0
185 stars 25 forks source link

Assistance Needed: Errors Encountered While Following Tutorial #38

Open AutoStudyP opened 1 month ago

AutoStudyP commented 1 month ago

I am trying to follow the tutorial from your repository using the Triton server. However, I am encountering the following errors:

./optimize.py

Traceback (most recent call last): File "./examples/01_optimize_torch_linear_model/./optimize.py", line 17, in import model_navigator as nav File "/opt/conda/lib/python3.11/site-packages/model_navigator/init.py", line 49, in from model_navigator.inplace import ( # noqa: F401, F403 File "/opt/conda/lib/python3.11/site-packages/model_navigator/inplace/init.py", line 66, in from ..reporting.profile.events import ProfileEvent File "/opt/conda/lib/python3.11/site-packages/model_navigator/reporting/profile/init.py", line 16, in from model_navigator.reporting.profile.report import SimpleReport File "/opt/conda/lib/python3.11/site-packages/model_navigator/reporting/profile/report.py", line 36, in @dataclass ^^^^^^^^^ File "/opt/conda/lib/python3.11/dataclasses.py", line 1232, in dataclass return wrap(cls) ^^^^^^^^^ File "/opt/conda/lib/python3.11/dataclasses.py", line 1222, in wrap return _process_class(cls, init, repr, eq, order, unsafe_hash, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/lib/python3.11/dataclasses.py", line 958, in _process_class cls_fields.append(_get_field(cls, name, type, kw_only)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/lib/python3.11/dataclasses.py", line 815, in _get_field raise ValueError(f'mutable default {type(f.default)} for field ' ValueError: mutable default <class 'rich.text.Text'> for field status is not allowed: use default_factory

These errors are appearing even though I followed the provided starter instructions and installed the necessary packages using pip. Do you have any suggestions for how to resolve this issue?

piotr-bazan-nv commented 1 month ago

Thanks for reporting the issue. The exception is raised with Python version starting 3.11. We are preparing the fix. In the meantime could you try Python 3.10? Thanks!