Additional tests - Githubissues

learning-at-home / lean_transformer

Memory-efficient transformer. Work in progress.

MIT License

19 stars 3 forks source link

Open justheuristic opened 2 years ago

justheuristic commented 2 years ago

Why: make it harder to break individual models via subtle changes

for every model: test that it can be created, run forward and backward, all parameters have grads
check with several typical configurations via pytest.parameterize
match between pytorch and triton butterfly after conversion