-
Hi, what's the motivation behind adversarial loss: ReLU(1 + x) + ReLU(1 - x), is there any reference?
-
## Description
I used apex's ASP to accomplish the N:M sparsity. I get the following result when I use `./trtexec --onnx=sparse.onnx --saveEngine=sparse.trt --sparsity=enable --fp16 --verbose` to gen…
-
Hello,
I started to implement the relu function for the genann library on a fork under my name (https://github.com/kasey-/genann) before sending you a PR:
```
double inline genann_act_relu(cons…
-
I am applying the use of Keras models that utilize probabilistic layers. The model below, which used to work normally, now presents the following error:
inputs = tf.keras.Input(shape=(X_train.shape…
-
https://github.com/quiqi/relu_kan/tree/main
@yu-rp claims that MLP performs better - can you test against relu_kan? https://github.com/yu-rp/KANbeFair
noticed that there's also sine_kan.
@…
-
For TTNN leaky_relu op:
The documentation does not cover supported data types (BFLOAT16/BFLOAT8_B) neither the supported layouts (ROW_MAJOR/TILE). In practice, its seems that it does support BFLOAT8_…
-
The following code
```python
import jax
from jax import numpy as jnp
!pip install equinox
import equinox as eqx
print(f"{eqx.filter_hessian(jax.nn.relu)(jnp.ones(()))=}")
print(f"{jax.hessian…
-
when i issue the training function:
model = modeling.create_and_train_model(
loaded_sim_lib,
n_epochs=100,
hidden_layer_units_list=[10, 128, 512, 512, 512, 128, 10],
activation_…
-
I noted that for activation relu is used in the generator and leaky relu is used in the Discriminator. Is there a particular reason behind this?
-
Congratulations on your new results in https://www.zama.ai/post/making-fhe-faster-for-ml-beating-our-previous-paper-benchmarks-with-concrete-ml ! We wonder if more details about the underlying improve…