Unable to install transformer-deploy module

[elvinagam]

Any support would be appreciated:

When running demo/torchdynamo/benchmark.ipynb, specifically this cell (pasted code), I run into the error below.

from typing import Dict

import numpy as np
import torch
from onnxruntime import GraphOptimizationLevel

from transformers import AutoModel, PreTrainedModel
from transformer_deploy.backends.ort_utils import convert_fp16
from transformer_deploy.backends.onnx_utils import save_onnx

from dynamo_utils import (
    benchmark,
    check_output,
    get_dynamo_optimizer,
    get_onnx_inference,
    get_pytorch_inference,
    get_pytorch_input,
    plot_benchmarks,
    print_pytorch_profile,
    get_tensorrt_inference,
    seq_lengths,
)

import gc
import tensorrt as trt
from tensorrt.tensorrt import ICudaEngine, Logger, Runtime
import onnx
from transformer_deploy.backends.trt_utils import build_engine, save_engine

ModuleNotFoundError Traceback (most recent call last)Cell In [3], line 8 5 from onnxruntime import GraphOptimizationLevel 7 from transformers import AutoModel, PreTrainedModel----> 8 from transformer_deploy.backends.ort_utils import convert_fp16 9 from transformer_deploy.backends.onnx_utils import save_onnx 11 from dynamo_utils import ( 12 benchmark, 13 check_output, (...) 21 seq_lengths, 22 )ModuleNotFoundError: No module named 'transformer_deploy'

[elvinagam]

@pommedeterresautee @ayoub-louati

[elvinagam]

Am I missing any steps? Since I am getting an error regarding No module named 'transformer_deploy'

[ayoub-louati]

Hello @elvinagam, are you still facing this problem ? did you tried to install transformer-deploy ?

[elvinagam]

I solved it somehow without explicitly knowing how to lol. Closing it. Thanks.