-
Tried both xft 1.6.0 and 1.7.1.
For Chatglm3-6B, issue can be seen when batch-size > 32 (Tried 48, 64, 128).
For Llama2-13B, issue can be seen when batch-size >16.( Tried 32)
Specifically, on…
-
Since the new `1.14.1` release, symbols mode no longer works for me.
Other modes work perfectly fine, so maybe it has something to do with the new **AVX2** optims for symbols?
I'm on Arch Linux.…
folke updated
2 months ago
-
### Your current environment
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Debia…
-
### Your current environment
The output of `python collect_env.py`
(vllm code copied from this PR (@84789334a) was used: https://github.com/vllm-project/vllm/pull/8574)
```text
Collecting…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch…
-
# Expected behavior
I can move mouse pointer every where in the VM window and click.
## Actual behavior
Mouse can only move inside certain area of the screen. My monitor has 2560x1440 res…
-
### 🐛 Describe the bug
Building a project(resnet50) inside libtorch directory only.
Here is the content of my CMakeLists.txt:
```cmake
cmake_minimum_required(VERSION 3.18 FATAL_ERROR)
project…
-
**ProblemType**
Bug
**Date**
Tue Sep 3 16:14:22 2024
**CurrentDesktop**
ubuntu:GNOME
**ProcEnviron**
LANG=en_US.UTF-8
PATH=(custom, no user)
SHELL=/usr/bin/zsh
TERM=xterm-256color
XDG_RUNTIME_DIR=…
-
### 🐛 Describe the bug
I am running an Arch Linux system with a 4090/3090 w/ and up-to-date CUDA 12.5 (`Build cuda_12.5.r12.5/compiler.34385749_0`)
I have created a new mamba env for torchchat and…
-
title