Open vegax87 opened 9 months ago
DirectML can run any LLM on any GPU that supports DX12:
if opt.use_dml: import torch_directml device = torch_directml.device(torch_directml.default_device()) else: device = torch.device('cuda' if opt.cuda else 'cpu')
DirectML can run any LLM on any GPU that supports DX12: