ModuleNotFoundError: No module named 'ftllm'

ztxz16 / fastllm

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

Apache License 2.0

3.29k stars 334 forks source link

In [1]: from ftllm import llm --------------------------------------------------------------------------- ModuleNotFoundError Traceback (most recent call last) Cell In[1], line 1 ----> 1 from ftllm import llm ModuleNotFoundError: No module named 'ftllm' In [2]: In [2]: pip install ftllm Looking in indexes: https://mirrors.aliyun.com/pypi/simple ERROR: Could not find a version that satisfies the requirement ftllm (from versions: none) ERROR: No matching distribution found for ftllm Note: you may need to restart the kernel to use updated packages. In [3]:

In [1]: from ftllm import llm
---------------------------------------------------------------------------
ModuleNotFoundError                       Traceback (most recent call last)
Cell In[1], line 1
----> 1 from ftllm import llm

ModuleNotFoundError: No module named 'ftllm'

In [2]:

In [2]: pip install ftllm
Looking in indexes: https://mirrors.aliyun.com/pypi/simple
ERROR: Could not find a version that satisfies the requirement ftllm (from versions: none)
ERROR: No matching distribution found for ftllm
Note: you may need to restart the kernel to use updated packages.

In [3]:

ftllm 模块要通过什么方式安装？

暂时只能通过代码安装（clone之后install.sh, 参见主页说明）

ztxz16 / fastllm

ModuleNotFoundError: No module named 'ftllm' #492