issues
search
NolanoOrg
/
cformers
SoTA Transformers with C-backend for fast inference on your CPU.
MIT License
311
stars
29
forks
source link
Improve interface.
#25
Open
Ayushk4
opened
1 year ago
Ayushk4
commented
1 year ago
[ ] Allow stopping-generation midway
[ ] Anti-prompt for conversation models
[ ] Support returning embeddings and logits instead of token ids.