-
### bug描述 Describe the Bug
File "/data/mlops/Open-Assistant/inference/server/oasst_inference_server/plugins/vectors_db/loaders/data_loader.py", line 383, in path_to_doc1
res = file_to_doc(file, …
-
### 问题描述 Issue Description
因为官方不提供 ARM 架构对应 wheel 安装包,因此需要从源码进行手动编译。选取目标 PaddlePaddle 版本为最新 `develop` 分支。
1. cmake
执行命令:
> cmake .. -DPY_VERSION=3.8 -DPYTHON_EXECUTABLE=`which python3` -DWITH…
-
RAG for phi 3 vision using kernel memory in place of semantic text memory.Any example for offline retrival in c#?
sorry to bother you.I am new is this arena
-
# タスクリスト
- [ ] #328
- [ ] 角速度制御の理論的導出
- [ ] 水平角度制御の理論的導出
- [ ] ヨー角制御の理論的導出
- [ ] 水平移動速度制御の理論的導出
- [ ] 水平位置制御の理論的導出
# 古典制御での特性メモ
(参照元:https://www.docswell.com/s/Kouhei_Ito/KDVNVK-2022-0…
-
### Your current environment
The output of `python collect_env.py`
```text
(myenv) aiscuser@node-0:~/vllm$ python collect_env.py
Collecting environment information...
PyTorch version: 2.4.0+c…
-
I am running the `Phi-3-mini-4k-instruct-onnx` model on desktop CPU, and one behavior I have noticed is that, after the back and forth conversation is longer than half of the context window length (in…
-
If you are submitting a bug report, please fill in the following details and use the tag [bug].
**Describe the bug**
Gemma-2-{size} is not loadable using from_pretrained. I checked OFFICIAL_MODEL_…
-
```
cargo run --example quantized-phi --release -- --prompt "what is the best thing about rust?" --which phi-3
Compiling candle-examples v0.5.0 (/Users/kenk/Documents/Code/OpenSource/candle/candl…
-
build onnx.
```
python3 -m onnxruntime_genai.models.builder -m Models/Phi-3.5-vision-instruct -o output -p fp16 -e cuda -c temp --extra_options int4_block_size=128 int4_accuracy_level=3
```
when…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
- `llamafactory` version: 0.8.2
- Platform: Linux-5.15.0-1040-azure-x86_64-with-glibc2.17
- Pytho…