search

alipay / PainlessInferenceAcceleration

Creative Commons Attribution 4.0 International
283 stars 18 forks source link

Dockerfile集成pia无法使用 #10

Closed May-Yaha closed 8 months ago

May-Yaha commented 8 months ago

使用docekrfile进行安装，在容器里无法使用，想确认是否有依赖lib库？ image 包： image 安装时有过错误： image

dockerfile（已经提前将项目clone到该仓库中了）：

COPY PainlessInferenceAcceleration/* ./third_party/PainlessInferenceAcceleration
# 创建普通用户并切换到该用户
RUN useradd work && \
    chown -R work:work /home/work && \
    chown -R work:work $CONDA_DIR

USER work

RUN conda create -y --name py310 python=3.10 && \
    conda clean -afy

# 设置环境变量以使用新创建的 python 环境
ENV PATH $HOME/.local/bin:/opt/conda/envs/py310/bin:$PATH

# 安装PainlessInferenceAcceleration
RUN cd $BASE_DIR/third_party/PainlessInferenceAcceleration && \
    python setup.py install
chenliangjyj commented 8 months ago

麻烦重新pull下main分支的代码 然后 python setup.py install 下

May-Yaha commented 8 months ago

image 这个变更点么？看起来没有什么变化

执行命令： python setup.py install

/home/work/chatglm3_api/third_party/PainlessInferenceAcceleration/setup.py:3: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
  import pkg_resources
/opt/conda/envs/py310/lib/python3.10/site-packages/setuptools/_distutils/dist.py:265: UserWarning: Unknown distribution option: 'URL'
  warnings.warn(msg)
running install
/opt/conda/envs/py310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/opt/conda/envs/py310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
writing pia.egg-info/PKG-INFO
writing dependency_links to pia.egg-info/dependency_links.txt
writing top-level names to pia.egg-info/top_level.txt
reading manifest file 'pia.egg-info/SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'pia.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
creating build/bdist.linux-x86_64/egg
creating build/bdist.linux-x86_64/egg/lookahead
creating build/bdist.linux-x86_64/egg/lookahead/models
creating build/bdist.linux-x86_64/egg/lookahead/models/chatglm3
copying build/lib/lookahead/models/chatglm3/tokenization_chatglm.py -> build/bdist.linux-x86_64/egg/lookahead/models/chatglm3
copying build/lib/lookahead/models/chatglm3/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/chatglm3
copying build/lib/lookahead/models/chatglm3/modeling_chatglm.py -> build/bdist.linux-x86_64/egg/lookahead/models/chatglm3
copying build/lib/lookahead/models/chatglm3/configuration_chatglm.py -> build/bdist.linux-x86_64/egg/lookahead/models/chatglm3
creating build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b
copying build/lib/lookahead/models/baichuan_13b/modeling_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b
copying build/lib/lookahead/models/baichuan_13b/tokenization_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b
copying build/lib/lookahead/models/baichuan_13b/configuration_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b
copying build/lib/lookahead/models/baichuan_13b/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b
copying build/lib/lookahead/models/baichuan_13b/generation_utils.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b
copying build/lib/lookahead/models/baichuan_13b/handler.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b
copying build/lib/lookahead/models/baichuan_13b/quantizer.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b
creating build/bdist.linux-x86_64/egg/lookahead/models/gptj
copying build/lib/lookahead/models/gptj/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/gptj
copying build/lib/lookahead/models/gptj/modeling_gptj.py -> build/bdist.linux-x86_64/egg/lookahead/models/gptj
creating build/bdist.linux-x86_64/egg/lookahead/models/bloom
copying build/lib/lookahead/models/bloom/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/bloom
copying build/lib/lookahead/models/bloom/modeling_bloom.py -> build/bdist.linux-x86_64/egg/lookahead/models/bloom
creating build/bdist.linux-x86_64/egg/lookahead/models/mistral
copying build/lib/lookahead/models/mistral/configuration_mistral.py -> build/bdist.linux-x86_64/egg/lookahead/models/mistral
copying build/lib/lookahead/models/mistral/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/mistral
copying build/lib/lookahead/models/mistral/modeling_mistral.py -> build/bdist.linux-x86_64/egg/lookahead/models/mistral
copying build/lib/lookahead/models/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models
creating build/bdist.linux-x86_64/egg/lookahead/models/baichuan_7b
copying build/lib/lookahead/models/baichuan_7b/modeling_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_7b
copying build/lib/lookahead/models/baichuan_7b/tokenization_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_7b
copying build/lib/lookahead/models/baichuan_7b/configuration_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_7b
copying build/lib/lookahead/models/baichuan_7b/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_7b
copying build/lib/lookahead/models/baichuan_7b/handler.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan_7b
creating build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b
copying build/lib/lookahead/models/baichuan2_13b/modeling_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b
copying build/lib/lookahead/models/baichuan2_13b/tokenization_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b
copying build/lib/lookahead/models/baichuan2_13b/configuration_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b
copying build/lib/lookahead/models/baichuan2_13b/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b
copying build/lib/lookahead/models/baichuan2_13b/generation_utils.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b
copying build/lib/lookahead/models/baichuan2_13b/handler.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b
copying build/lib/lookahead/models/baichuan2_13b/quantizer.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b
creating build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b
copying build/lib/lookahead/models/baichuan2_7b/modeling_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b
copying build/lib/lookahead/models/baichuan2_7b/tokenization_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b
copying build/lib/lookahead/models/baichuan2_7b/configuration_baichuan.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b
copying build/lib/lookahead/models/baichuan2_7b/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b
copying build/lib/lookahead/models/baichuan2_7b/generation_utils.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b
copying build/lib/lookahead/models/baichuan2_7b/modeling_baichuan_batch.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b
copying build/lib/lookahead/models/baichuan2_7b/quantizer.py -> build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b
creating build/bdist.linux-x86_64/egg/lookahead/models/glm
copying build/lib/lookahead/models/glm/modeling_glm_batch.py -> build/bdist.linux-x86_64/egg/lookahead/models/glm
copying build/lib/lookahead/models/glm/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/glm
copying build/lib/lookahead/models/glm/modeling_glm.py -> build/bdist.linux-x86_64/egg/lookahead/models/glm
copying build/lib/lookahead/models/glm/tokenization_glm.py -> build/bdist.linux-x86_64/egg/lookahead/models/glm
copying build/lib/lookahead/models/glm/configuration_glm.py -> build/bdist.linux-x86_64/egg/lookahead/models/glm
creating build/bdist.linux-x86_64/egg/lookahead/models/opt
copying build/lib/lookahead/models/opt/modeling_opt_batch.py -> build/bdist.linux-x86_64/egg/lookahead/models/opt
copying build/lib/lookahead/models/opt/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/opt
copying build/lib/lookahead/models/opt/modeling_opt.py -> build/bdist.linux-x86_64/egg/lookahead/models/opt
creating build/bdist.linux-x86_64/egg/lookahead/models/llama
copying build/lib/lookahead/models/llama/modeling_llama.py -> build/bdist.linux-x86_64/egg/lookahead/models/llama
copying build/lib/lookahead/models/llama/modeling_llama_batch.py -> build/bdist.linux-x86_64/egg/lookahead/models/llama
copying build/lib/lookahead/models/llama/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/llama
copying build/lib/lookahead/models/llama/modeling_llama_flash.py -> build/bdist.linux-x86_64/egg/lookahead/models/llama
creating build/bdist.linux-x86_64/egg/lookahead/models/mixtral
copying build/lib/lookahead/models/mixtral/configuration_mixtral.py -> build/bdist.linux-x86_64/egg/lookahead/models/mixtral
copying build/lib/lookahead/models/mixtral/modeling_mixtral.py -> build/bdist.linux-x86_64/egg/lookahead/models/mixtral
copying build/lib/lookahead/models/mixtral/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/mixtral
creating build/bdist.linux-x86_64/egg/lookahead/models/qwen
copying build/lib/lookahead/models/qwen/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/qwen
copying build/lib/lookahead/models/qwen/tokenization_qwen.py -> build/bdist.linux-x86_64/egg/lookahead/models/qwen
copying build/lib/lookahead/models/qwen/qwen_generation_utils.py -> build/bdist.linux-x86_64/egg/lookahead/models/qwen
copying build/lib/lookahead/models/qwen/configuration_qwen.py -> build/bdist.linux-x86_64/egg/lookahead/models/qwen
copying build/lib/lookahead/models/qwen/modeling_qwen.py -> build/bdist.linux-x86_64/egg/lookahead/models/qwen
creating build/bdist.linux-x86_64/egg/lookahead/models/chatglm
copying build/lib/lookahead/models/chatglm/tokenization_chatglm.py -> build/bdist.linux-x86_64/egg/lookahead/models/chatglm
copying build/lib/lookahead/models/chatglm/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/chatglm
copying build/lib/lookahead/models/chatglm/modeling_chatglm.py -> build/bdist.linux-x86_64/egg/lookahead/models/chatglm
copying build/lib/lookahead/models/chatglm/configuration_chatglm.py -> build/bdist.linux-x86_64/egg/lookahead/models/chatglm
creating build/bdist.linux-x86_64/egg/lookahead/models/gpt2
copying build/lib/lookahead/models/gpt2/modeling_gpt2.py -> build/bdist.linux-x86_64/egg/lookahead/models/gpt2
copying build/lib/lookahead/models/gpt2/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/models/gpt2
creating build/bdist.linux-x86_64/egg/lookahead/benchmarks
copying build/lib/lookahead/benchmarks/benchmark.py -> build/bdist.linux-x86_64/egg/lookahead/benchmarks
copying build/lib/lookahead/benchmarks/llama_benchmark.py -> build/bdist.linux-x86_64/egg/lookahead/benchmarks
copying build/lib/lookahead/benchmarks/chatglm_benchmark.py -> build/bdist.linux-x86_64/egg/lookahead/benchmarks
copying build/lib/lookahead/benchmarks/glm_benchmark.py -> build/bdist.linux-x86_64/egg/lookahead/benchmarks
copying build/lib/lookahead/benchmarks/vllm_latency.py -> build/bdist.linux-x86_64/egg/lookahead/benchmarks
copying build/lib/lookahead/benchmarks/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/benchmarks
copying build/lib/lookahead/benchmarks/pia_lantency.py -> build/bdist.linux-x86_64/egg/lookahead/benchmarks
copying build/lib/lookahead/benchmarks/preprocess_sample.py -> build/bdist.linux-x86_64/egg/lookahead/benchmarks
copying build/lib/lookahead/__init__.py -> build/bdist.linux-x86_64/egg/lookahead
creating build/bdist.linux-x86_64/egg/lookahead/common
copying build/lib/lookahead/common/lookahead_generation_utils.py -> build/bdist.linux-x86_64/egg/lookahead/common
copying build/lib/lookahead/common/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/common
copying build/lib/lookahead/common/pretrained_model.py -> build/bdist.linux-x86_64/egg/lookahead/common
copying build/lib/lookahead/common/pretrained_model_batch.py -> build/bdist.linux-x86_64/egg/lookahead/common
copying build/lib/lookahead/common/lookahead_cache.py -> build/bdist.linux-x86_64/egg/lookahead/common
creating build/bdist.linux-x86_64/egg/lookahead/csrc
creating build/bdist.linux-x86_64/egg/lookahead/csrc/triton
copying build/lib/lookahead/csrc/triton/rms_norm.py -> build/bdist.linux-x86_64/egg/lookahead/csrc/triton
copying build/lib/lookahead/csrc/triton/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/csrc/triton
copying build/lib/lookahead/csrc/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/csrc
creating build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/glm_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/baichuan2_13b_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/gptj_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/baichuan_13b_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/mixtral_quant_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/mistral_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/llama_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/qwen_quant_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/opt_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/chatglm3_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/__init__.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/chatglm_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/qwen_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/glm_batch_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/llama_stream_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/llama_batch_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/baichuan_7b_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/baichuan2_7b_batch_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/gpt2_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/baichuan2_7b_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/bloom_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/opt_batch_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/llama_flash_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/interlm_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
copying build/lib/lookahead/examples/mixtral_example.py -> build/bdist.linux-x86_64/egg/lookahead/examples
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/chatglm3/tokenization_chatglm.py to tokenization_chatglm.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/chatglm3/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/chatglm3/modeling_chatglm.py to modeling_chatglm.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/chatglm3/configuration_chatglm.py to configuration_chatglm.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b/modeling_baichuan.py to modeling_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b/tokenization_baichuan.py to tokenization_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b/configuration_baichuan.py to configuration_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b/generation_utils.py to generation_utils.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b/handler.py to handler.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_13b/quantizer.py to quantizer.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/gptj/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/gptj/modeling_gptj.py to modeling_gptj.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/bloom/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/bloom/modeling_bloom.py to modeling_bloom.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/mistral/configuration_mistral.py to configuration_mistral.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/mistral/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/mistral/modeling_mistral.py to modeling_mistral.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_7b/modeling_baichuan.py to modeling_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_7b/tokenization_baichuan.py to tokenization_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_7b/configuration_baichuan.py to configuration_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_7b/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan_7b/handler.py to handler.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b/modeling_baichuan.py to modeling_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b/tokenization_baichuan.py to tokenization_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b/configuration_baichuan.py to configuration_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b/generation_utils.py to generation_utils.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b/handler.py to handler.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_13b/quantizer.py to quantizer.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b/modeling_baichuan.py to modeling_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b/tokenization_baichuan.py to tokenization_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b/configuration_baichuan.py to configuration_baichuan.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b/generation_utils.py to generation_utils.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b/modeling_baichuan_batch.py to modeling_baichuan_batch.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/baichuan2_7b/quantizer.py to quantizer.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/glm/modeling_glm_batch.py to modeling_glm_batch.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/glm/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/glm/modeling_glm.py to modeling_glm.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/glm/tokenization_glm.py to tokenization_glm.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/glm/configuration_glm.py to configuration_glm.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/opt/modeling_opt_batch.py to modeling_opt_batch.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/opt/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/opt/modeling_opt.py to modeling_opt.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/llama/modeling_llama.py to modeling_llama.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/llama/modeling_llama_batch.py to modeling_llama_batch.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/llama/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/llama/modeling_llama_flash.py to modeling_llama_flash.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/mixtral/configuration_mixtral.py to configuration_mixtral.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/mixtral/modeling_mixtral.py to modeling_mixtral.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/mixtral/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/qwen/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/qwen/tokenization_qwen.py to tokenization_qwen.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/qwen/qwen_generation_utils.py to qwen_generation_utils.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/qwen/configuration_qwen.py to configuration_qwen.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/qwen/modeling_qwen.py to modeling_qwen.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/chatglm/tokenization_chatglm.py to tokenization_chatglm.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/chatglm/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/chatglm/modeling_chatglm.py to modeling_chatglm.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/chatglm/configuration_chatglm.py to configuration_chatglm.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/gpt2/modeling_gpt2.py to modeling_gpt2.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/models/gpt2/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/benchmarks/benchmark.py to benchmark.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/benchmarks/llama_benchmark.py to llama_benchmark.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/benchmarks/chatglm_benchmark.py to chatglm_benchmark.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/benchmarks/glm_benchmark.py to glm_benchmark.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/benchmarks/vllm_latency.py to vllm_latency.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/benchmarks/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/benchmarks/pia_lantency.py to pia_lantency.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/benchmarks/preprocess_sample.py to preprocess_sample.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/common/lookahead_generation_utils.py to lookahead_generation_utils.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/common/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/common/pretrained_model.py to pretrained_model.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/common/pretrained_model_batch.py to pretrained_model_batch.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/common/lookahead_cache.py to lookahead_cache.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/csrc/triton/rms_norm.py to rms_norm.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/csrc/triton/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/csrc/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/glm_example.py to glm_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/baichuan2_13b_example.py to baichuan2_13b_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/gptj_example.py to gptj_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/baichuan_13b_example.py to baichuan_13b_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/mixtral_quant_example.py to mixtral_quant_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/mistral_example.py to mistral_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/llama_example.py to llama_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/qwen_quant_example.py to qwen_quant_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/opt_example.py to opt_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/chatglm3_example.py to chatglm3_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/chatglm_example.py to chatglm_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/qwen_example.py to qwen_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/glm_batch_example.py to glm_batch_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/llama_stream_example.py to llama_stream_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/llama_batch_example.py to llama_batch_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/baichuan_7b_example.py to baichuan_7b_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/baichuan2_7b_batch_example.py to baichuan2_7b_batch_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/gpt2_example.py to gpt2_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/baichuan2_7b_example.py to baichuan2_7b_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/bloom_example.py to bloom_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/opt_batch_example.py to opt_batch_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/llama_flash_example.py to llama_flash_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/interlm_example.py to interlm_example.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/lookahead/examples/mixtral_example.py to mixtral_example.cpython-310.pyc
creating build/bdist.linux-x86_64/egg/EGG-INFO
copying pia.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO
copying pia.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying pia.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying pia.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
zip_safe flag not set; analyzing archive contents...
lookahead.models.glm.__pycache__.modeling_glm.cpython-310: module MAY be using inspect.stack
creating 'dist/pia-0.0.2-py3.10.egg' and adding 'build/bdist.linux-x86_64/egg' to it
removing 'build/bdist.linux-x86_64/egg' (and everything under it)
Processing pia-0.0.2-py3.10.egg
removing '/opt/conda/envs/py310/lib/python3.10/site-packages/pia-0.0.2-py3.10.egg' (and everything under it)
creating /opt/conda/envs/py310/lib/python3.10/site-packages/pia-0.0.2-py3.10.egg
Extracting pia-0.0.2-py3.10.egg to /opt/conda/envs/py310/lib/python3.10/site-packages
Adding pia 0.0.2 to easy-install.pth file

Installed /opt/conda/envs/py310/lib/python3.10/site-packages/pia-0.0.2-py3.10.egg
Processing dependencies for pia==0.0.2
Finished processing dependencies for pia==0.0.2

调试过程：

work@97aa592caf7e:~/chatglm3_api/third_party/PainlessInferenceAcceleration$ python
Python 3.10.13 (main, Sep 11 2023, 13:44:35) [GCC 11.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
>>> from transformers import AutoTokenizer
>>> 
>>> 
>>> from pia.lookahead.common.lookahead_cache import LookaheadCache
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ModuleNotFoundError: No module named 'pia'
>>> from pia.lookahead.models.llama.modeling_llama import LlamaForCausalLM
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ModuleNotFoundError: No module named 'pia'

image

May-Yaha commented 8 months ago

感觉是分发的问题： image

chenliangjyj commented 8 months ago

感觉不应该到这个目录 我看你build是安装到conda环境的 /opt/conda/envs/py310/lib/python3.10/site-packages/pia-0.0.2-py3.10.egg 先卸载确定这个目录里没有 然后在conda环境进行安装 确保安装的时候 conda环境是激活的

May-Yaha commented 8 months ago

这个我已经确认过了，因为我自己也有类似的包安装了是可以正常运行的

chenliangjyj commented 8 months ago

可以试试看手动拷贝到 /opt/conda/lib/python3.8/site-packages/pia-0.0.2-py3.8.egg 我这里是3.8的例子 之后目录结构应该如下 

.
├── EGG-INFO
│   ├── dependency_links.txt
│   ├── not-zip-safe
│   ├── PKG-INFO
│   ├── SOURCES.txt
│   └── top_level.txt
└── pia
    ├── __init__.py
    ├── lookahead
    └── __pycache__
May-Yaha commented 8 months ago

这个我也试了，其实也是有问题，但是重新完整的搞了dockerfile就可以了，如果有多个依赖的dockerfile会有问题