AlexanderLutsenko / nobuco

Pytorch to Keras/Tensorflow/TFLite conversion made intuitive
MIT License
253 stars 16 forks source link

Added nn.SiLU activation #10

Closed ffs333 closed 1 year ago

ffs333 commented 1 year ago

Added nn.SiLU actication

Since PyTorch version only supports beta = 1.0 (no argument for beta), TF version with only beta=1.0

@converter(F.silu, channel_ordering_strategy=ChannelOrderingStrategy.MINIMUM_TRANSPOSITIONS)
def converter_silu(input: Tensor, inplace=False):
    def func(input: Tensor, inplace=False):
        return tf.nn.silu(input, beta=1.0)
    return func

nn.SiLU() (inplace=False default argument value) silu