-
https://kubernetes.io/
SidxA updated
7 months ago
-
### What happened?
`validate_environment()` works fine for `gpt-3.5-turbo` and `claude-3-sonnet-20240229`:
- When the environment is set up properly, then `keys_in_environment = True` and `missing…
-
尝试了很多此，成功安装。环境为：win10，python3.111，torch2.4.1，cuda12.4
***使用CMD***
powershell会失败，不清楚原因。
将储存库clone到本地，然后运行cmd，进入仓库目录
执行
git checkout apex_no_distributed
执行
pip install -v --no-cache-dir ./
终于成功安装
-
### Regression?
No
### System Info and Version
System/Version info
```sh
hyprctl systeminfo -c
Hyprland, built from branch at commit 918d8340afd652b011b937d29d5eea0be08467f5 (flake.lock: up…
-
### Motivation
当前 lmdeploy 支持的量化以及对应最小 cuda 能力有：
- awq: sm80
- smooth_quant: sm75
也就是说，**V100 不支持任何量化推理**。
如果能够在 sm70 平台上支持量化，将会极大地推动 lmdeploy 在社区的影响力。目前最有希望的量化方法有：
- bitsandbytes
- gptq
…
-
- [ ] Create philosophical shorts for why LLM may actually "understand"
- [ ] Create a weekly target
- [ ] Reflect on how I would trickle from year to daily vision
- [ ] Create gigs on fastwork
- [ ] …
-
I was asked “What's the number in the nickname of the original creator of Minetest, minus 1”. How am I to know the answer to this? Not even Google is able to provide the answer. I posted this question…
-
I must acknowledge that indeed **rawdog** is a masterpiece. However, it's dependency on OpenAI as the main LLM provider is a kinda drawback to me, if I was to be asked. This reason actually fueled the…
-
rbyh updated
6 months ago
-
### System Info
cargo 1.72.0 (103a7ff2e 2023-08-15)
text-generation-launcher --env :
```
2023-09-12T22:39:32.121302Z INFO text_generation_launcher: Runtime environment: …