search

SafeAILab / EAGLE

Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)
https://arxiv.org/pdf/2406.16858
Apache License 2.0
780 stars 79 forks source link

RuntimeError (porting inference on kaggle) #11

Closed rkuo2000 closed 9 months ago

rkuo2000 commented 9 months ago

RuntimeError: Failed to import transformers.modeling_utils because of the following error (look up to see its traceback): Failed to import transformers.generation.utils because of the following error (look up to see its traceback): cannot import name 'builder' from 'google.protobuf.internal' (/opt/conda/lib/python3.10/site-packages/google/protobuf/internal/init.py)

rkuo2000 commented 9 months ago

fixed, after comment !pip install -r requirements.txt, and execute pip install torch transformers accelerate fschat gradio openai anthropic sentencepiece protobuf also base_model_path = "lmsys/vicuna-7b-v1.3" EAGLE_model_path = "yuhuili/EAGLE-Vicuna-7B-v1.3"

For your reference: https://www.kaggle.com/code/rkuo2000/eagle-llm/notebook