-
**Is your feature request related to a problem? Please describe.**
- As a user, I want to split my documents based on a token limit. I would like to use HuggingFace tokenizers, Sentence Transformers …
-
### Is there an existing issue for the same feature request?
- [X] I have checked the existing issues.
### Is your feature request related to a problem?
_No response_
### Describe the feature you'…
-
Thanks for making this library! With both version 0.2.0 and 0.2.1 i get out of bounds errors for some of my queries. Here's a full stack trace:
```
Traceback (most recent call last):
File "/Use…
-
The code for processing sharegpt in the script prepare_train_data.sh uses sharegpt conversation splitter **(split_sharegpt_conversations.py)** , but there is no such code in the corresponding director…
-
After reviewing the documentation, I couldn't find any query parameters that allow fetching the latest messages. I want to use iOS Shortcuts to retrieve the latest messages for a specified topic. …
-
### System Info
peft 0.13.0
transformers 4.44.2
torch 2.4.0
Python 3.12.4
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [X] My own modified scripts
##…
-
### Description:
I am writing a CDK Stack that deploys a Lambda that uses the Parameters and Secrets extension. When I try to `local invoke` it fails with the error `Invoke failed error=ErrAgentN…
-
Hi! Recently a colleague split the bearer token because of some security reasons, thus I ended up having to do this in all my HTTP calls:
```elm
, headers =
[ Ht…
-
## Description:
1. If a user token splits an existing word that has a jot attached to it, then the Jot association should go to the composite token. Right now it is going to the one of the subtokens…
-
### Current behavior
such like check if jwt token veified,
base.request.headers[potential_header] is Unexpected,can you help me?
```
metadata:
language: v1-beta
name: "JWT Token Si…