search

FMInference / FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.
Apache License 2.0
9.21k stars 547 forks source link

AttributeError #74

Closed shadowcz007 closed 1 year ago

shadowcz007 commented 1 year ago

AttributeError: 'OptLM' object has no attribute 'weight_home'