It might be useful to explore adding expression transformation rules which do not simplify the expression, but rather transform it to a more complex expression which is otherwise identical. This would let you explore the space of expressions without reducing the loss.
Feature Request
It might be useful to explore adding expression transformation rules which do not simplify the expression, but rather transform it to a more complex expression which is otherwise identical. This would let you explore the space of expressions without reducing the loss.