Closed reyna-abhyankar closed 2 months ago
@reyna-abhyankar Can you add the cuda part of kernels
to CI as part of this PR? Otherwise it'll just break immediately
lib/op-attrs/include/op-attrs/activation.h
line 8 at r1 (raw file):
namespace FlexFlow { enum class Activation { RELU, SIGMOID, TANH, GELU, NONE };
Why not just use std::optional<Activation>
where you need this behavior?
@reyna-abhyankar Ignore the above, it was already added.
Description of changes:
Build all operator
.cu
files inlib/kernels
Note: there is an issue with
embedding.cu
with thehalf
datatype. All other operators are building.This change is![Reviewable](https://reviewable.io/review_button.svg)