search

microsoft / Samba

Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"
https://arxiv.org/pdf/2406.07522
MIT License
778 stars 45 forks source link

inference code #19

Open myounghanmain opened 1 week ago

myounghanmain commented 1 week ago

I'm turning the learning. Is there any code to infer the model after learning? If not, when are you going to upload the inference code? And is there any reference or url to refer to for inference?

richardburleigh commented 1 week ago

I made a hacky inference script. I'm sure it could be improved, but it works. See here richardburleigh/Samba.

myounghanmain commented 1 week ago

oh Thank you so much. I'll try it out