search

ArtemisDicoTiar / FastLLM

2 stars 1 forks source link

Finishing ngrams integration #38

Closed romsto closed 11 months ago

romsto commented 11 months ago

Fixed the NgramModel#generate method to match other models and be used by speculative decoding. (#25)