search

halide / Halide

a language for fast, portable data-parallel computation
https://halide-lang.org
Other
5.78k stars 1.07k forks source link

Add support for extended exp operation as halide_extended_exp. #8206

Open zvookin opened 2 months ago

zvookin commented 2 months ago

Per discussion, add operator to implement efficient two pass softmax algorithm. This is a draft as it is hoped the numerics can be improved.

steven-johnson commented 2 months ago

Per discussion, add operator to implement efficient two pass softmax algorithm. This is a draft as it is hoped the numerics can be improved.

Can you clarify a bit? It's not obvious to me what the deficiencies are (just curious)