-
I believe there is an issue with the calculation of the SSIM metric inside 'parallel_score.py'. I can see that it uses the metrics.structural_similarity() function from skimage.
As from the end of 2…
-
Come up with higher level LLM UDF.
When analyzing data via LLMs (text, images), step by step we have quite a lot of repetitive code like:
```python
def extract_performance(chunk: Chunk) -> CompanyPe…
-
I compared two ways to launch the server.
The model is vicuna-7b, and GPU is 2 \* A30.
and the 1st way is
```
python -m vllm.entrypoints.openai.api_server \
--model /data/models/vicuna-…
-
Since Peter brought that up in the slack here is a sketch of what I came up with using DualView as the fundamental data management approach:
```c++
// Generic helpers:
template
void dynamic_para…
-
### Is there an existing issue for the same bug?
- [X] I have checked the existing issues.
### Branch Name
main
### Commit ID
11e338e5e2e7af1493a49514b3d93b59aa2e88b3
### Other Environment Infor…
-
I would like to inquire about the possibility of combining data parallelism and model parallelism in the context of training llm. I found that the model parallel only support 1 batch while data paral…
-
-
Hello!
I read in another issue that you load data and perform training in parallel. I was just wondering how exactly you do that? Because the bottle neck does not seem to be training (takes ~0.06s)…
-
### Expected behavior
datahub:data-importer:process-queue-parallel will properly process rows, or throw errors when there is a logic error
### Actual behavior
Occasionally rows fail with the follow…
-
File "D:\llm\VideoLingo-1.7.0\st.py", line 117, in
main()
File "D:\llm\VideoLingo-1.7.0\st.py", line 113, in main
text_processing_section()
File "D:\llm\VideoLingo-1.7.0\st.py", line…