search

FlagOpen / FlagGems

FlagGems is an operator library for large language models implemented in Triton Language.
Apache License 2.0
296 stars 27 forks source link

add inplace pointwise operators #224

Open iclementine opened 3 weeks ago

iclementine commented 3 weeks ago

PR Category

Operator

Type of Change

New Feature

Description

Add inplace pointwise operators.

Issue

Progress

Performance

iclementine commented 3 weeks ago

I have to solve the problem at when the output has in-appropriate dtype or shape it does not raise error.

tongxin commented 3 weeks ago

LGTM, is it necessary to add benchmark for those inplace ops?

It'll add a lot of redundancy if we include all the variants. Shall we do that later?