-
使用如下命令启动vllm（readme里描述的版本），并固定住block的数量为2048，每个block size大小为16
```bash
vllm serve /hestia/model/Qwen2-VL-7B-Instruct-AWQ --quantization awq --num-gpu-blocks-override 2048 --port 8002 --served-model-…
-
### Describe the bug
I have reinstalled this from scratch and reinstalled Python.
16:16:54-681274 INFO Loading the extension "Training_PRO"
╭───────────────────────────────────────── Tracebac…
-
### Bug report info
```plain text
act version: 0.2.61
GOOS: linux
GOARCH: amd64
NumCPU: 8
Docker host: DOCKER_HOST envir…
-
### What happened?
I am using the LiteLLM proxy, and also using the `litellm` python SDK to interact with the proxy.
In my `config.yaml`, I have `langfuse` configered
```yaml
... some other config…
-
Schema generation appears to `tolower` all of the action names:
```
"actions": {
...
"debit": {
"params": {
"Object": {
"nftId": "@0",
…
-
- [ ] Give types that implement Collection a plural name (In addition to arrays)
- [ ] Name boolean variables `flag`, `flag2`, etc instead of `bl`, I think that's more readable.
- [ ] For primitive…
-
Hi @karllhughes just find this discuss and want to share it with you: https://www.producthunt.com/ask/127-what-s-the-best-business-and-domain-name-generator
-
Oftentimes when changing the manifest in repos, the build matrix generation may fail with the following error:
```
Unhandled exception: System.Reflection.TargetInvocationException: Exception has been…
-
The way that we name new GraphQL Object Types (GOTs) right now is highly varied. All our names are generated from the OAS. Sometimes the name is part of a reference, sometimes it is the name provided …
-
The `nix-env --list-generations` command is kind of cool, but doesn't actually tell you very much other than a date and a number. It'd be nice if we could associate at least a name (and ideally arbitr…