search

bdusell / semiring-einsum

Generic PyTorch implementation of einsum that supports different semirings
https://bdusell.github.io/semiring-einsum/
MIT License
45 stars 7 forks source link

In log forward, include tensors saved for backward in size calculation #36

Open bdusell opened 1 year ago

bdusell commented 1 year ago

When calculating the space required for the output tensors in the forward pass of log einsum, the tensors of max values and sumexpsub values are currently not included, leading to a very low estimate. Use output_dtypes to include them.