Hi there I follow all the instructions to setup the codellama repo on my windows pc. To avoid any issue, I try and run it with my WSL, and therefore download the 7b model for codellama. After i use the suggested command to run any of the example files, it just show a warning:
UserWarning: torch.set_default_tensor_type() is deprecated as of PyTorch 2.1, please use torch.set_default_dtype() and torch.set_default_device() as alternatives. (Triggered internally at ../torch/csrc/tensor/python_tensor.cpp:451.) _C._set_default_tensor_type(t)
loaded 128s"
And then it shows nothing else, it just gets stuck there.
Any help how I can run them and make sure these example file can run, so I can start use the codellama for myself, currently trying to avoid using Ollama, want to get into this myself.
Hi there I follow all the instructions to setup the codellama repo on my windows pc. To avoid any issue, I try and run it with my WSL, and therefore download the 7b model for codellama. After i use the suggested command to run any of the example files, it just show a warning: UserWarning: torch.set_default_tensor_type() is deprecated as of PyTorch 2.1, please use torch.set_default_dtype() and torch.set_default_device() as alternatives. (Triggered internally at ../torch/csrc/tensor/python_tensor.cpp:451.) _C._set_default_tensor_type(t) loaded 128s"
And then it shows nothing else, it just gets stuck there. Any help how I can run them and make sure these example file can run, so I can start use the codellama for myself, currently trying to avoid using Ollama, want to get into this myself.
Thanks beforehand, Best, Redon.