-
## Summary
Assess performance of Bloom Db as number of rows scales
## Approach
I'm running repeated invocations of `test_create_acceessioning_wf()` and monitoring the size of the `generic_instance`…
-
hi, thanks for your wonderful work. I was wondering if i want to infer a model with multi-gpu,what should i do? I have tried with belowing code when load model with `device_map` parameter:
```
model…
-
Traceback (most recent call last):
File "/home/admin/workspace/aop_lab/app_source/run_gptq.py", line 89, in
model = AutoGPTQForCausalLM.from_pretrained(args.model_name_or_path, quantize_confi…
-
**Describe the bug**
What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程,最好有截图)
![image](https://github.com/user-attachments/assets/0790fb8f-e403-4fce-9cb0-1ecaf16bb57e)
**…
-
[ /] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I'm currently trying to use HuggingFace LLMs and embedding m…
-
### Your current environment
The output of `python collect_env.py`
```text
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [X] 3. Please note that if the bug-related iss…
-
Hi @jveitchmichaelis,
Thank you for sharing these models!
When I run a coco ssd model (from the [coral.ai](https://coral.ai/models/object-detection/) site) via [tfjs](https://github.com/tensorfl…
-
### System Info
EC2 instance: G5.48xl
Nvidia driver: 535.161.08
Cuda: 12.2
commit 5d8ca2faf74c494f220c8f71130340b513eea9a9
Torch: 2.3.0
### Who can help?
@byshiue running into the issue with h…
-
### System Info
accelerate 0.31.0
peft 0.11.1
transformers 4.42.4
bitsandbytes 0.41.1
##### The following packages…