Closed BBuf closed 1 year ago
origin:
Total generation time: 27.202331522013992 # Tokens: 897 0.030325899132680037s/token
quick_gelu:
N_token_prompt: 127 Total generation time: 25.97924460703507 # Tokens: 897 0.028962368569715798s/token
origin:
Total generation time: 27.202331522013992 # Tokens: 897 0.030325899132680037s/token
quick_gelu:
N_token_prompt: 127 Total generation time: 25.97924460703507 # Tokens: 897 0.028962368569715798s/token