search

flexflow / FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.59k stars 218 forks source link

fix: 'model_configs' AttributeError #1358

Closed chenzhuofu closed 3 months ago

chenzhuofu commented 3 months ago

Description of changes:

fix python/serve/serve.py typo: 

  File "/usr/FlexFlow/python/flexflow/serve/serve.py", line 378, in compile
    in self.model_configs.__dict__
       ^^^^^^^^^^^^^^^^^^
AttributeError: 'LLM' object has no attribute 'model_configs'

Related Issues:

Linked Issues:

Issues closed by this PR:

This change is Reviewable