-
在使用web_api.py时，问题如题，请问怎么解决，是哪里出问题了吗？而且只有batch api的接口有返回结果，stream api无返回结果
-
### Proposal to improve performance
I am using vllm version 0.6.3.post1 with four 4090 GPUs to infer the qwen2-72B-chat-int4 model. The request speed is very fast for a single request, but the perf…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
求教！！！！int4模型微调以后跑模型，提示报错
Some weights of ChatGLMForConditionalGeneration were not init…
-
docker container version ： ipex-llm-serving-xpu:2.2.0-b2
start shell script：
model="/llm/models/Qwen/Qwen2.5-32B-Instruct-AWQ"
served_model_name="Qwen2.5-32B-Instruct-AWQ"
export CCL_WORKER_…
-
[Section 4.7.6.1](https://registry.khronos.org/SYCL/specs/sycl-2020/html/sycl-2020.html#_data_type) in the SYCL 2020 specification (Rev. 7) limits the `DataT` template argument in image accessors to `…
-
Hi there 👋
Today I came across this paper: [QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models](https://arxiv.org/pdf/2309.14717.pdf).
So what's wrong with the current QLo…
-
At night, when the voltage/power drop to 0, I see in my json output values recorded as -3.4028234663852886e+38. I'm not sure whether the solaredge data actually holds this data, or that some python co…
-
Hi, I have encountered errors reading some of my response files in Sherpa 4.17.0. I also tried Sherpa 4.16.0, and no error appears.
I have attached the data.
```python
Python 3.11.6 | packaged b…
-
Currently
- data returned by ActiveQuery is typed if column name matches table column name.
- data returned by Query is mostly untyped.
```sql
CREATE TABLE test (
id INTEGER GENERATED AL…
-
```
What steps will reproduce the problem?
1. new Column( "visible_from", DbType.DateTime, ColumnProperty.NotNull,
DateTime.MinValue ),
2. Try to run the migration
3. Yields a syntax error
What is th…