-
OS: ubuntu 20.04 (Google Colab)
GPU : Nvidia T4 15GB, A100 40GB (Google Colab)
```python
import nest_asyncio
from pyngrok import ngrok, conf
import uvicorn
from typing import Union
from fasta…
-
Hi team ,
Hope you are doing good !!!
I was trying to run a **"whatif.ipynb"** notebook in new **Farmvibes-ai cluster** , but Notebook is getting failed.
When I checked using **run.reason** it is…
-
### Acknowledgements
- [X] I have written a descriptive issue title
- [x] I have searched [Issues](issues?q=is%3Aissue) to see if the feature has already been requested
### Describe the Feature
hi …
-
闲来无事想试试P100的推理速度
在装载模型的时候出现错误：
```
(…)kura-14b-qwen2beta-v0.9-iq4_xs_ver2.gguf: 100%
7.85G/7.85G [00:39
-
```
Traceback (most recent call last): [53/1849]
File "/conda_tmp/mc3/bin/ns-train", line 8,…
-
[2023.10.23]
更新支持0.2.6
------
[2023.9.21]
为了方便大家学习，提供一个个人使用colab实践例子
https://colab.research.google.com/drive/107cZA3V885GtNfO8X7SIW-XdPA3WFYVG?usp=sharing
* 使用了本地部署
* LLM模型选用chatglm2-6b-int…
-
### Acknowledgements
- [X] I have written a descriptive issue title
- [X] I have searched [`pyngrok`'s documentation](https://pyngrok.readthedocs.io/en/latest/) for an answer
- [X] I have searched [I…
-
### Your current environment
```text
The output of `python env.py`
```
### How did you install Aphrodite?
When using pre conversion i ran into following error
ValueError: 17 is not a valid GGM…
-
I really like `tool.bench.dev-dependencies` to install dev dependencies, but never really understood why the syntax to specify a packages name and version differs from the standard way of specifying t…
-
Getting a dependency conflict when trying to include langchain-mistralai:
```
poetry add langchain-mistralai …