Removing PEFT from dependencies. Replacing with runtime checks

BlackSamorez / tensor_parallel

Automatically split your PyTorch models on multiple GPUs for training & inference

MIT License

619 stars 38 forks source link

Removing PEFT from dependencies. Replacing with runtime checks #87

Closed BlackSamorez closed 1 year ago

BlackSamorez commented 1 year ago

PEFT is pretty experimental and requiring everyone install it seems unnecessary since it's only used for a very specific use-case. This PR hides PEFT checks and imports behind runtime inspections.