Closed pmelchior closed 2 years ago
This PR adds the parameterized activation function from the Speculator paper by Alsing+2020. It slightly improves the model fidelity. By shifting the decoder MLP output by 1, the decoder has to describe the deviation from the flat median spectrum.
This PR adds the parameterized activation function from the Speculator paper by Alsing+2020. It slightly improves the model fidelity. By shifting the decoder MLP output by 1, the decoder has to describe the deviation from the flat median spectrum.