Not much to be done here, all references to typed storage has been removed, and default dtype is set to torch.float16. I tested with torch 2.3.0 and model loads fine and generates text as expected. Needs testing to make sure it doesn't break anything.
Not much to be done here, all references to typed storage has been removed, and default dtype is set to torch.float16. I tested with torch 2.3.0 and model loads fine and generates text as expected. Needs testing to make sure it doesn't break anything.
Tests: