-
Hi Katie,
Am trying to generate a heatmap with the series of microbiome custom r functions you provide, very useful!
I get an error however in running the tax_glom.kv() function. my data has bee…
-
> In the current `Log4jEventBuilder#addKeyValue(String key, Object value)` implementation, complex objects are serialized using `String.valueOf()`, which lacks flexibility. My suggestion is to allow u…
-
### Environment
If applicable, please include the following:
**CPU architecture:** x86_64
**CPU/Host memory size:** 440 GiB memory
### GPU properties
GPU name: A100
GPU memory size: 160G…
-
### Your current environment
```text
The output of `python collect_env.py`
```
### 🐛 Describe the bug
vLLM has an issue where we can go OOM if too many `logprobs` are requested.
The reason t…
-
# system info
- x64
- 23.10-trtllm-python-py3 docker
- trt-llm 0.11.0.dev2024061800
- l40s
- tensorrt 10.0.1.6
- use 38g * 2
- running in container (--cap-add=SYS_PTRACE --cap-add=SYS_ADMIN --s…
-
在 Attention 方法里涉及到 KV cache 的实现部分
```
past_key, past_value = past_kv
xq = torch.cat((torch.zeros_like(x[:, :-1, :]), self.wq(current_token)), dim=1)
xk = torch.cat((past_key, self.wk(current_token…
-
### 🚀 The feature, motivation and pitch
FlashInfer v0.1.2 was just released with sliding window support:
https://github.com/flashinfer-ai/flashinfer/releases/tag/v0.1.2
This should allow vLLM…
-
sql.TestReacquireLeaseOnRestart [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Ci_TestsAwsLinuxArm64_UnitTests/16567338?buildTab=log) with [artifacts](https://teamcity.cockroac…
-
-
### next-on-pages environment related information
NEXTjs 14.2.3 wrangler 3.69.1.
no errors in output or console, just "null" KV binding is fine in production.
### Description
no errors in outpu…