search

LuxDL / Lux.jl

Elegant & Performant Scientific Machine Learning in Julia
https://lux.csail.mit.edu/
MIT License
456 stars 54 forks source link

Add Enzyme to benchmark infra #643

Closed avik-pal closed 2 months ago

avik-pal commented 2 months ago

https://github.com/LuxDL/Lux.jl/pull/641 github actions seems to unable to post comment or push, so checking if that is a permissions issue

avik-pal commented 2 months ago

@wsmoses seems like Enzyme is doing well for the ~smaller~ non-broadcast heavy models, but not so much for the larger ones. I would guess it is because of the broadcasting issue because most of the Lux models do heavily rely on broadcasting.

wsmoses commented 2 months ago

Yeah we should be able to improve the broadcasting perf. For now, let's add to the continuous benchmarking to keep track of over time, and open relevant perf issues on Enzyme.