FMInference / FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.
Apache License 2.0
9.21k stars 547 forks source link

fix import error #66

Closed TakanoTaiga closed 1 year ago

TakanoTaiga commented 1 year ago

Description

fix import library name.

attrs --> attr

What fixed

The following error occurs and needs to be corrected.

Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/USERNAME/FlexGen/flexgen/flex_opt.py", line 18, in <module>
    from flexgen.compression import CompressionConfig
  File "/home/USERNAME/FlexGen/flexgen/compression.py", line 6, in <module>
    from flexgen.pytorch_backend import (TorchTensor, TorchDevice,
  File "/home/USERNAME/FlexGen/flexgen/pytorch_backend.py", line 15, in <module>
    from flexgen.utils import (GB, T, cpu_mem_stats, vector_gather,
  File "/home/USERNAME/FlexGen/flexgen/utils.py", line 3, in <module>
    from attrs import define, field
ModuleNotFoundError: No module named 'attrs'

Check env