search

shaltielshmid / TorchSharp.PyBridge

A library enabling easy transfer and handling of PyTorch models between .NET and Python environments
MIT License
14 stars 3 forks source link

Large safetensor files not supported? #12

Closed NiklasGustafsson closed 7 months ago

NiklasGustafsson commented 7 months ago

Trying to load Phi-2:

Unhandled exception. System.ArgumentOutOfRangeException: Length of JSON exceeded int.MaxValue, not supported yet (Parameter 'length')
   at TorchSharp.PyBridge.Safetensors.LoadIndex(Stream stream)
   at TorchSharp.PyBridge.PyBridgeModuleExtensions.load_safetensors(Module module, Stream stream, Boolean strict, IList`1 skip, Dictionary`2 loadedParameters, Boolean leaveOpen)
   at TorchSharp.PyBridge.PyBridgeModuleExtensions.load_safetensors(Module module, String location, Boolean strict, IList`1 skip, Dictionary`2 loadedParameters)
   at TorchSharp.PyBridge.PyBridgeModuleExtensions.load_checkpoint(Module module, String path, String checkpointName, Boolean strict, IList`1 skip, Dictionary`2 loadedParameters)
   at PhiForCasualLM.FromPretrained(String modelFolder, String configName, String checkPointName, ScalarType defaultDType, String device) in /Users/niklasgustafsson/repos/Torchsharp-phi/Phi.cs:line 41
   at Program.<Main>$(String[] args) in ./Torchsharp-phi/Program.cs:line 29