search

FMInference / H2O

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
369 stars 37 forks source link

ModuleNotFoundError: No module named 'streaming_llm' #8

Closed haiasd closed 9 months ago

haiasd commented 10 months ago

error while run bash scripts/streaming/eval.sh full image

haiasd commented 10 months ago

image I install this repo：https://github.com/mit-han-lab/streaming-llm/tree/main/streaming_llm but there is another error.

ChuanhongLi commented 10 months ago

image I install this repo：https://github.com/mit-han-lab/streaming-llm/tree/main/streaming_llm but there is another error.

Maybe you should use "from utils_real_drop.stream import load, download_url, load_jsonl". And in streamingllm, the load function just only has one parameter, so you can use load(model_name_or_path).

yyfcc17 commented 3 months ago

this bug is still not fixed, and i found another in h2o_hf/run_streaming.py, seem that your code is not well tested