-
Dear CarlosGS20,
I hope this message finds you well. I have been working with the line data you kindly published on GitHub, and I appreciate the effort and detail that went into making this resourc…
-
### System Info
- x86_64
- 2TB RAM
- 8xH100
- TensorRT-LLM main @ 40274aac39f2542483906d92ec3b8014faf62912
- Cuda 12.5
### Who can help?
@kaiyux @byshiue
### Information
- [x] The official examp…
-
Currently the plug-in to generate the input file for the label generation only works for TensorFlow h5 models.
The plug-in should allow for other TensorFlow formats as well as PyTorch formats.
-
### System Info
- text-generation-inference:2.3.0, deployed on docker
- model info:
{
"model_id": "meta-llama/Llama-3.1-8B-Instruct",
"model_sha": "0e9e39f249a16976918f6564b8830bc894c89659…
-
**Ticket Title:** Complete `Order` Class for Item Ordering and Checkout System
**Priority:** High
**Description:**
This ticket focuses on completing the implementation of the `Order` class within th…
-
### What happened?
In the creation of electric field input data, the time dependence of the field are handled through the user-specified function; whereas for precipitation they are handled from the …
-
**Describe the bug**
The behavior is a bit random. **When the text generation input size < batch size from the previous step** and replica > 1. The final output could missing some samples. This does …
-
Hi there,
As I want to implemente this watermark, could you help invoke a sample code to integrate to model.generate mode? Like the KGW does below.
```
watermark_processor = WatermarkLogitsProces…
-
Will it work? I see it is presented as an argument for model input and defaulted to:
"cartoon style, worst quality, low quality, blurry, absolute black, absolute white, low res, extra limbs, extra di…
-
### Your question
I was looking for a way to expose the comfy math sdxl resolutions drop down selection into the Generation/Simple tabs using the swarm input dropdown node, but am not sure how to set…