WIP: sampling top-k top-p and greedy

cuda-mode / ring-attention

ring-attention experiments

Apache License 2.0

89 stars 10 forks source link

Closed melvinebenezer closed 6 months ago

melvinebenezer commented 6 months ago

Pushed the first cut, Have some errors with top-p and top-k . Working on it at the moment

melvinebenezer commented 6 months ago

pushed changes from my machine. the RunPod had Andreas as the user