-
It seems that the following post-processor block in tokenizer.json is not supported:
````
"post_processor": {
"type": "Sequence",
"processors": [
{
"type": "ByteLevel",…
-
-
So far I've ported the components I needed to support the models I tested, but there are many more in `transformers` and `tokenizers`. For example:
- https://github.com/huggingface/swift-transforme…
-
### DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE
- [X] I understand that I will be **blocked** if I remove or skip any mandatory\* field
### Checklist
- [X] I'm reporting a bug unrelated to a spe…
-
I have the following postprocessor config:
```
"postprocessors": [
{
"name": "ugoira",
"whitelist": ["pixiv", "danbooru"],
"ke…
-
Clean up post-processor to output solution.
-
We have recently noticed that our logging service has been flooded by the following warning messages:
```
2024-10-08 14:12:46 WARN OptimizedWithLastSample:113 - Skipping NAN
```
The number of mess…
-
Don't know if I'm doing something wrong as I haven't touched this part lately and I don't remember having this problem before but when I try to download the original ZIP file for an Ugoira in Danbooru…
-
### Feature request
Reran top_n is widely supported, for example here: https://github.com/run-llama/llama_index/blob/main/llama-index-integrations/postprocessor/llama-index-postprocessor-jinaai-reran…
-
### DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE
- [X] I understand that I will be **blocked** if I *intentionally* remove or skip any mandatory\* field
### Checklist
- [X] I'm requesting a featu…