-
So this is a strange one. I am stumped.
In way, this is sort of like #416, but I confirmed that if Batch==1, then the problem does not occur. (See below)
My inference loop looks like this
```
…
-
## 项目纵向拆分
### ⓵ 定义目标和原则
终极目的
> Q：为什么你要花时间来做这项任务，而不是其他随便什么任务？
A：解决自己的切身需求，AI 革命， #397
### ⓶ 展望结果（OKRs）
利益相关人清单
> Q：当你交付最终结果的时候，会如何让世界变得更好？
A：普通人都可以根据自己的问题在书中寻找答案，无需依赖得到、樊登读书等领读人
…
-
# Trending repositories for C#
1. [**BeyondDimension / SteamTools**](https://github.com/BeyondDimension/SteamTools)
__🛠「Watt Toolkit」是一个开源跨平台的多功能 Steam 工具箱。__
11 stars to…
-
**Describe the bug**
I'm attempting to install auto-gptq into an environment with:
```
pip install auto-gptq
```
The error I get is the following:
```
File "C:\Users\domin\anaconda3\envs\local-…
-
Hi, there first of all this is an amazing project which you have built
But it seems that for each query even the basic ones token usage is in 40-50k
fopr queries based on personal .csv data (.csv…
-
This is a ticket to track a wishlist of items you wish LiteLLM had.
# **COMMENT BELOW 👇**
### With your request 🔥 - if we have any questions, we'll follow up in comments / via DMs
Respond …
-
## Environment info
- `adapter-transformers` version: 3.2.0a0 (2af89bd1135e598859e38a7b27152bef8ecdec4f)
- Platform: Linux-5.15.0-56-generic-x86_64-with-glibc2.35
- Python version: 3.10.6
- Huggin…
jdwx updated
6 months ago
-
### System Info
GPU: NVIDIA A100
Driver Version: 545.23.08
CUDA: 12.3
versions:
https://github.com/NVIDIA/TensorRT-LLM.git (bf0a5af)
https://github.com/triton-inference-server/tensorrtllm_ba…
-
### News
- Conferences
- AAAI 2023 모두들 축하드립니다 (뒷북)
- ACL 2023: Softconf 1월 17일
- ICML 2023: Openreview 1월 26일 (한국 시간 27일 새벽 5시.. )
- CVPR 2023: 리뷰 1월 10일까지.. Aㅏ.....
- [ICML 2023에서 Chat…
-
Post questions here for this week's exemplary readings:
4. van Dis, Eva A. M., Johan Bollen, Willem Zuidema, Robert van Rooij & Claudi L. Bockting. 2023. [“ChatGPT: five priorities for research: Co…
lkcao updated
7 months ago