Open Selur opened 4 months ago
Why did you pip install --pre torch-tensorrt --index-url https://download.pytorch.org/whl/nightly/cu121
after pip install torch_tensorrt-2.4.0.dev0+8915f846d-cp312-cp312-win_amd64.whl
? The README didn't tell you to do that!
iirc I installed that since something was missing. Will try again and report back.
Motivated that I got vs-dpir working with your help, I wanted to add your other projects, but can into a few problems. (Sorry, this is a bit longer, but I wanted to be sure you know what I did so you might be able to see what I missed or did wrong.)
What I did was
python get-pip.py
python312._pth
by adding:
Scripts
Lib\site-packages
python -m pip install wheel/VapourSynth-68-cp312-cp312-win_amd64.whl
python -m pip install torch_tensorrt-2.4.0.dev0+8915f846d-cp312-cp312-win_amd64.whl
python -m pip install wheel
python -m pip install git+https://github.com/Jaded-Encoding-Thaumaturgy/vs-tools.git
python -m pip install -U vsdpir
python -m vsdpir
python -m pip install -U VSGAN
python -m pip install -U vsgmfss-fortuna
python -m pip install -U vsswinir
python -m vsswinir
python -m pip install --upgrade vshinet
python -m vshinet
python -m pip install -U vsanimesr
python -m pip install -U vsscunet
python -m vsscunet
python -m pip install -U vscodeformer
python -m vscodeformer
python -m pip install antlr4-python3-runtime
python -m pip install -U vsgrlir
python -m vsgrlir
So far so good.
Then I tried 'vsrealesrgan':
python -m pip install -U vsrealesrgan
python -m vsrealesrgan
this ended with:
Traceback (most recent call last):
File "<frozen runpy>", line 189, in _run_module_as_main
File "<frozen runpy>", line 148, in _get_module_details
File "<frozen runpy>", line 112, in _get_module_details
File "F:\Vapoursynth\Lib\site-packages\vsrealesrgan\__init__.py", line 9, in <module>
import tensorrt
File "F:\Vapoursynth\Lib\site-packages\tensorrt\__init__.py", line 18, in <module>
from tensorrt_bindings import *
ModuleNotFoundError: No module named 'tensorrt_bindings'
(I uninstalled vsrealesrgan then)
Then I tried 'vsrife':
python -m pip install --upgrade vsrife
python -m vsrife
this ended with:
Traceback (most recent call last):
File "<frozen runpy>", line 189, in _run_module_as_main
File "<frozen runpy>", line 148, in _get_module_details
File "<frozen runpy>", line 112, in _get_module_details
File "F:\Vapoursynth\Lib\site-packages\vsrife\__init__.py", line 9, in <module>
import tensorrt
File "F:\Vapoursynth\Lib\site-packages\tensorrt\__init__.py", line 18, in <module>
from tensorrt_bindings import *
(I uninstalled vsrife then)
Then I tried 'vsfemasr':
python -m pip install -U vsfemasr
python -m vsfemasr
endend with:
Traceback (most recent call last):
File "<frozen runpy>", line 189, in _run_module_as_main
File "<frozen runpy>", line 148, in _get_module_details
File "<frozen runpy>", line 112, in _get_module_details
File "F:\Vapoursynth\Lib\site-packages\vsfemasr\__init__.py", line 8, in <module>
import tensorrt
File "F:\Vapoursynth\Lib\site-packages\tensorrt\__init__.py", line 18, in <module>
from tensorrt_bindings import *
ModuleNotFoundError: No module named 'tensorrt_bindings'
Last I tried BasicVSR++:
python -m pip install -U openmim
ended with:
Collecting aliyun-python-sdk-core>=2.13.12 (from oss2~=2.17.0->openxlab->opendatalab->openmim)
Using cached aliyun-python-sdk-core-2.15.1.tar.gz (443 kB)
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [7 lines of output]
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "C:\Users\Selur\AppData\Local\Temp\pip-install-q56iod47\aliyun-python-sdk-core_8dd359ccd9be4d9f9b5ed369a6b219b3\setup.py", line 41, in <module>
VERSION = __import__(PACKAGE).__version__
^^^^^^^^^^^^^^^^^^^
ModuleNotFoundError: No module named 'aliyunsdkcore'
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata. ╰─> See above for output.
note: This is an issue with the package mentioned above, not pip. hint: See above for details.
=> not using "--pre torch-tensorrt" changed the output.
Your tensorrt
python package was not properly installed. Normally installing tensorrt 10 from PyPI will also install tensorrt-cu12_bindings
and tensorrt-cu12_libs
automatically. I have updated the README to specifically install them as well.
Besides, some other projects (vs-femasr, vs-gmfss_fortuna, vs-realesrgan) depend on torch_tensorrt_fx_only
package. That package is outdated and uses the same directory name as torch_tensorrt
package. Hence, some files could get overwritten by old files if you installed the aforementioned projects after torch_tensorrt
package had been installed.
!Thanks!, using:
python -m pip install torch_tensorrt_fx_only
python -m pip install wheel
python -m pip install tensorrt==10.0.1 tensorrt-cu12_bindings==10.0.1 tensorrt-cu12_libs==10.0.1 --extra-index-url https://pypi.nvidia.com
seems to do the trick 👍
(only thing that doesn't work atm. is BasicVSR++)btw.
python -m pip install -U vsdpir
only installed v4.0.0, will try in a few days again, whether it then updates to 4.1.0.Strange, just triggered it again:
F:\Vapoursynth>python -m pip install -U vsdpir
Requirement already satisfied: vsdpir in f:\vapoursynth\lib\site-packages (4.0.0)
Collecting vsdpir
Using cached vsdpir-4.1.0-py3-none-any.whl.metadata (1.8 kB)
Requirement already satisfied: numpy in f:\vapoursynth\lib\site-packages (from vsdpir) (1.26.4)
Requirement already satisfied: requests in f:\vapoursynth\lib\site-packages (from vsdpir) (2.31.0)
INFO: pip is looking at multiple versions of vsdpir to determine which version is compatible with other requirements. This could take a while.
Requirement already satisfied: torch>=2.3.0 in f:\vapoursynth\lib\site-packages (from vsdpir) (2.3.0)
Requirement already satisfied: tqdm in f:\vapoursynth\lib\site-packages (from vsdpir) (4.66.4)
Requirement already satisfied: vapoursynth>=66 in f:\vapoursynth\lib\site-packages (from vsdpir) (68)
Requirement already satisfied: vstools in f:\vapoursynth\lib\site-packages (from vsdpir) (3.1.0)
Requirement already satisfied: filelock in f:\vapoursynth\lib\site-packages (from torch>=2.3.0->vsdpir) (3.14.0)
Requirement already satisfied: typing-extensions>=4.8.0 in f:\vapoursynth\lib\site-packages (from torch>=2.3.0->vsdpir) (4.11.0)
Requirement already satisfied: sympy in f:\vapoursynth\lib\site-packages (from torch>=2.3.0->vsdpir) (1.12)
Requirement already satisfied: networkx in f:\vapoursynth\lib\site-packages (from torch>=2.3.0->vsdpir) (3.3)
Requirement already satisfied: jinja2 in f:\vapoursynth\lib\site-packages (from torch>=2.3.0->vsdpir) (3.1.4)
Requirement already satisfied: fsspec in f:\vapoursynth\lib\site-packages (from torch>=2.3.0->vsdpir) (2024.5.0)
Requirement already satisfied: mkl<=2021.4.0,>=2021.1.1 in f:\vapoursynth\lib\site-packages (from torch>=2.3.0->vsdpir) (2021.4.0)
Requirement already satisfied: charset-normalizer<4,>=2 in f:\vapoursynth\lib\site-packages (from requests->vsdpir) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in f:\vapoursynth\lib\site-packages (from requests->vsdpir) (3.7)
Requirement already satisfied: urllib3<3,>=1.21.1 in f:\vapoursynth\lib\site-packages (from requests->vsdpir) (2.2.1)
Requirement already satisfied: certifi>=2017.4.17 in f:\vapoursynth\lib\site-packages (from requests->vsdpir) (2024.2.2)
Requirement already satisfied: colorama in f:\vapoursynth\lib\site-packages (from tqdm->vsdpir) (0.4.6)
Requirement already satisfied: stgpytools>=1.0.5 in f:\vapoursynth\lib\site-packages (from vstools->vsdpir) (1.0.5)
Requirement already satisfied: rich>=12.6.0 in f:\vapoursynth\lib\site-packages (from vstools->vsdpir) (13.7.1)
Requirement already satisfied: intel-openmp==2021.* in f:\vapoursynth\lib\site-packages (from mkl<=2021.4.0,>=2021.1.1->torch>=2.3.0->vsdpir) (2021.4.0)
Requirement already satisfied: tbb==2021.* in f:\vapoursynth\lib\site-packages (from mkl<=2021.4.0,>=2021.1.1->torch>=2.3.0->vsdpir) (2021.12.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in f:\vapoursynth\lib\site-packages (from rich>=12.6.0->vstools->vsdpir) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in f:\vapoursynth\lib\site-packages (from rich>=12.6.0->vstools->vsdpir) (2.18.0)
Requirement already satisfied: MarkupSafe>=2.0 in f:\vapoursynth\lib\site-packages (from jinja2->torch>=2.3.0->vsdpir) (2.1.5)
Requirement already satisfied: mpmath>=0.19 in f:\vapoursynth\lib\site-packages (from sympy->torch>=2.3.0->vsdpir) (1.3.0)
Requirement already satisfied: mdurl~=0.1 in f:\vapoursynth\lib\site-packages (from markdown-it-py>=2.2.0->rich>=12.6.0->vstools->vsdpir) (0.1.2)
Even running python -m pip cache purge
before python -m pip install -U vsdpir
doesn't change it.
Okay, when I call python -m pip install -U vsdpir==4.1.0
Collecting vsdpir==4.1.0
Using cached vsdpir-4.1.0-py3-none-any.whl.metadata (1.8 kB)
Requirement already satisfied: numpy in f:\vapoursynth\lib\site-packages (from vsdpir==4.1.0) (1.26.4)
Requirement already satisfied: requests in f:\vapoursynth\lib\site-packages (from vsdpir==4.1.0) (2.31.0)
INFO: pip is looking at multiple versions of vsdpir to determine which version is compatible with other requirements. This could take a while.
ERROR: Could not find a version that satisfies the requirement torch>=2.4.0.dev (from vsdpir) (from versions: 2.2.0, 2.2.1, 2.2.2, 2.3.0)
ERROR: No matching distribution found for torch>=2.4.0.dev
Seems like I missed something somewhere or something got changed, steps I did were:
python get-pip.py
python312._pth
by adding:
Scripts
Lib\site-packages
python -m pip install torch_tensorrt_fx_only
python -m pip install wheel
python -m pip install tensorrt==10.0.1 tensorrt-cu12_bindings==10.0.1 tensorrt-cu12_libs==10.0.1 --extra-index-url https://pypi.nvidia.com
python -m pip install git+https://github.com/Jaded-Encoding-Thaumaturgy/vs-tools.git
python -m pip install -U vsdpir
python -m vsdpir
python -m pip install -U VSGAN
python -m pip install -U vsgmfss-fortuna
python -m pip install -U vsswinir
python -m vsswinir
python -m pip install --upgrade vshinet
python -m vshinet
python -m pip install -U vsanimesr
python -m pip install -U vsscunet
python -m vsscunet
python -m pip install -U vscodeformer
python -m vscodeformer
python -m pip install antlr4-python3-runtime
python -m pip install -U vsgrlir
python -m vsgrlir
python -m pip install -U vsrealesrgan
python -m vsrealesrgan
python -m pip install --upgrade vsrife
python -m vsrife
python -m pip install -U vsfemasr
python -m vsfemasr
The release note has mentioned PyTorch version bump. You need to install nightly build.
Ah, I still need
python -m pip install torch_tensorrt-2.4.0.dev20240518+cu121-cp312-cp312-win_amd64.whl
I wrongly assumed that:
python -m pip install --pre torch-tensorrt --index-url https://download.pytorch.org/whl/nightly/cu121
would already do the job.
=> got 4.1.0 now thanks!
I assume that for BasicVSR++ the only thing I can do is wait till openmin suppots Python 3.12, right?
Argh,.. I still didn't get it properly. Tried it anew to be sure I got the right order, but with:
python312._pth
by adding:
Scripts
Lib\site-packages
python get-pip.py
python -m pip install wheel\VapourSynth-68-cp312-cp312-win_amd64.whl
python -m pip install wheel
python -m pip install torch_tensorrt_fx_only
python -m pip install --pre torch torchvision --index-url https://download.pytorch.org/whl/nightly/cu121
python -m pip install https://github.com/HolyWu/vs-dpir/releases/download/v4.1.0/torch_tensorrt-2.4.0.dev20240518+cu121-cp312-cp312-win_amd64.whl
python -m pip install tensorrt==10.0.1 tensorrt-cu12_bindings==10.0.1 tensorrt-cu12_libs==10.0.1 --extra-index-url https://pypi.nvidia.com
it fails with vsfemasr. :(
calling python -m pip install -U vsfemasr
I get:
INFO: pip is looking at multiple versions of torch-tensorrt-fx-only to determine which version is compatible with other requirements. This could take a while.
Collecting torch-tensorrt-fx-only>=1.3.0 (from vsfemasr)
Using cached torch_tensorrt_fx_only-1.3.0-py3-none-any.whl.metadata (13 kB)
Collecting vsfemasr
Using cached vsfemasr-1.1.0-py3-none-any.whl.metadata (9.9 kB)
Using cached vsfemasr-1.0.0-py3-none-any.whl.metadata (9.9 kB)
ERROR: Cannot install vsfemasr and vsfemasr==1.0.0 because these package versions have conflicting dependencies.
The conflict is caused by: vsfemasr 1.0.0 depends on torch>=1.13.0 torch-tensorrt-fx-only 1.4.0.post1 depends on torch<2.2 and >=2.0.1 vsfemasr 1.0.0 depends on torch>=1.13.0 torch-tensorrt-fx-only 1.3.0 depends on torch<1.14.0 and >=1.13.0
To fix this you could try to:
calling `python -m pip install -U vsfemasr==1.2.0`, I get:
INFO: pip is looking at multiple versions of torch-tensorrt-fx-only to determine which version is compatible with other requirements. This could take a while. Collecting torch-tensorrt-fx-only>=1.3.0 (from vsfemasr==1.2.0) Using cached torch_tensorrt_fx_only-1.3.0-py3-none-any.whl.metadata (13 kB) ERROR: Cannot install vsfemasr and vsfemasr==1.2.0 because these package versions have conflicting dependencies.
The conflict is caused by: vsfemasr 1.2.0 depends on torch>=1.13.0 torch-tensorrt-fx-only 1.4.0.post1 depends on torch<2.2 and >=2.0.1 vsfemasr 1.2.0 depends on torch>=1.13.0 torch-tensorrt-fx-only 1.3.0 depends on torch<1.14.0 and >=1.13.0
To fix this you could try to:
ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts
=> What is the right order to install the torch dependencies?
Either don't install projects which depend on outdated torch_tensorrt_fx_only
at the moment, or install them with --no-deps
flag and hope they don't break.
vsdpir and vsrife both install but do not work and complaint about torch_tensorrt.fx.converters.converter_utils
missing.
atm. I got:
Package Version
------------------------ ------------------------
annotated-types 0.7.0
antlr4-python3-runtime 4.9.3
beautifulsoup4 4.12.3
blis 0.7.11
Bottleneck 1.3.8
catalogue 2.0.10
certifi 2024.2.2
charset-normalizer 3.3.2
click 8.1.7
cloudpathlib 0.16.0
colorama 0.4.6
confection 0.1.4
contourpy 1.2.1
cupy-cuda11x 13.1.0
cycler 0.12.1
cymem 2.0.8
einops 0.8.0
fastai 1.0.60
fastprogress 1.0.3
fastrlock 0.8.2
filelock 3.14.0
fonttools 4.52.1
fsspec 2024.5.0
huggingface-hub 0.23.1
idna 3.7
imageio 2.34.1
intel-openmp 2021.4.0
Jinja2 3.1.4
kiwisolver 1.4.5
kornia 0.7.2
kornia_rs 0.1.3
langcodes 3.4.0
language_data 1.2.0
lazy_loader 0.4
llvmlite 0.42.0
marisa-trie 1.1.1
markdown-it-py 3.0.0
MarkupSafe 2.1.5
matplotlib 3.9.0
mdurl 0.1.2
mkl 2021.4.0
mpmath 1.3.0
murmurhash 1.0.10
networkx 3.3
numba 0.59.1
numexpr 2.10.0
numpy 1.26.4
nvidia-cuda-runtime-cu12 12.5.39
nvidia-ml-py3 7.352.0
omegaconf 2.3.0
opencv-contrib-python 4.9.0.80
opencv-python 4.9.0.80
packaging 24.0
pandas 2.2.2
Pillow 10.1.0
pip 24.0
preshed 3.0.9
pydantic 2.7.1
pydantic_core 2.18.2
Pygments 2.18.0
pyparsing 3.1.2
python-dateutil 2.9.0.post0
pytz 2024.1
PyYAML 6.0.1
requests 2.32.2
rich 13.7.1
safetensors 0.4.3
scikit-image 0.23.2
scipy 1.13.1
setuptools 70.0.0
six 1.16.0
smart-open 6.4.0
soupsieve 2.5
spacy 3.7.4
spacy-legacy 3.0.12
spacy-loggers 1.0.5
srsly 2.4.8
stgpytools 1.0.5
sympy 1.12
tbb 2021.12.0
tensorrt 10.0.1
tensorrt-cu12 10.0.1
tensorrt-cu12_bindings 10.0.1
tensorrt-cu12_libs 10.0.1
thinc 8.2.3
tifffile 2024.5.22
timm 1.0.3
torch 2.4.0.dev20240523+cu121
torch_tensorrt 2.4.0.dev20240518+cu121
torch-tensorrt-fx-only 1.2.0
torchvision 0.19.0.dev20240525+cu121
tqdm 4.66.4
typer 0.9.4
typing_extensions 4.12.0
tzdata 2024.1
urllib3 2.2.1
VapourSynth 68
vsanimesr 1.0.0
vscodeformer 1.0.1
vsddcolor 1.0.1
vsdeoldify 3.5.3
vsdpir 4.1.0
vsgan 1.6.4
vsgmfss_fortuna 1.0.0
vsgrlir 1.1.1
vshinet 1.0.0
vsrealesrgan 4.0.0
vsrife 5.0.0
vsscunet 1.0.0
vsswinir 2.0.0
vstools 3.1.0
vsutil 0.8.0
wasabi 1.1.2
weasel 0.3.4
wheel 0.43.0
resetting everything up again, seems to work, will do some testing which tools installation breaks the rest.
Okay, not using:
Small update:
so atm. only:
Motivated that I got vs-dpir working with your help, I wanted to add your other projects, but can into a few problems. (Sorry, this is a bit longer, but I wanted to be sure you know what I did so you might be able to see what I missed or did wrong.)
What I did was
python get-pip.py
python312._pth
by adding:python -m pip install wheel/VapourSynth-68-cp312-cp312-win_amd64.whl
python -m pip install wheel
python -m pip install torch_tensorrt-2.4.0.dev0+8915f846d-cp312-cp312-win_amd64.whl
**python -m pip install --pre torch-tensorrt --index-url https://download.pytorch.org/whl/nightly/cu121
python -m pip install git+https://github.com/Jaded-Encoding-Thaumaturgy/vs-tools.git
pip install -U vsdpir
**python -m vsdpir
python -m pip install -U VSGAN
python -m pip install -U vsgmfss-fortuna
python -m vsswinir
python -m pip install --upgrade vshinet
python -m vshinet
python -m pip install -U vsanimesr
python -m pip install -U vsscunet
python -m vsscunet
python -m pip install -U vscodeformer
python -m vscodeformer
python -m pip install antlr4-python3-runtime
python -m pip install -U vsgrlir
**python -m vsgrlir
So far so good.
Next thing I tried was, installing vs-realesrgan, by calling:
python -m pip install -U vsrealesrgan
python -m vsrealesrgan
this ended with:I then checked
F:\Vapoursynth\Lib\site-packages\torch_tensorrt\lib\torchtrt.dll
and it did exist. So, one of it's dependencies must be missing. :( using https://github.com/lucasg/Dependencies an throwdingtorchtrt.dll
it showed the following dependencies:F:\Vapoursynth\Lib\site-packages\tensorrt_libs\nvinfer_plugin_10.dll
andF:\Vapoursynth\torch_dependencies\bin\nvinfer_plugin_10.dll
)F:\Vapoursynth\torch_dependencies\bin\nvinfer_10.dll
andF:\Vapoursynth\torch_dependencies\bin\nvinfer_plugin_10.dl
)F:\Vapoursynth\Lib\site-packages\torch\lib\torch_cpu.dll
)I know, that cuart64_12.dll comes in https://developer.download.nvidia.com/compute/cuda/12.4.1/local_installers/cuda_12.4.1_551.78_windows.exe
I hoped using:
python pip install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cu121
could help, but that ended with:So that did not work, next I tried vsrife:
python -m pip install --upgrade vsrife
python -m vsrife
ended with:Next I tried installing vsfemasr:
python -m pip install -U vsfemasr
python -m vsfemasr
endend with:Last but not least, I tried BasicVSR++:
pip install -U openmim
ended with:× Encountered error while generating package metadata. ╰─> See above for output.
note: This is an issue with the package mentioned above, not pip. hint: See above for details.