After meeting several compatibility issues while setting up the virtual environment for running the model, I retrieved the specific versions of packages and added to requirements.txt. Now inference and finetuning work without any problem. However, I was not able to install a compatible version of Triton.
After meeting several compatibility issues while setting up the virtual environment for running the model, I retrieved the specific versions of packages and added to requirements.txt. Now inference and finetuning work without any problem. However, I was not able to install a compatible version of Triton.