search

uiuc-focal-lab / syncode

Efficient and general syntactical decoding for Large Language Models
MIT License
200 stars 16 forks source link

Remove python time based logging #97

Closed shubhamugare closed 3 months ago

shubhamugare commented 3 months ago

Since we have somewhat reasonable profiling with cprof (Except for CUDA synchronization issues), removing the hardcoded logging of time from the code.