search

themurtazanazir / vec2text

utilities for decoding deep representations (like sentence embeddings) back to text
Other
1 stars 0 forks source link

Add KV Caching when generating hidden states #1

Open themurtazanazir opened 3 weeks ago

themurtazanazir commented 3 weeks ago

This speedup is needed, especially for training with augmentations later on