search

mmcdermott / nested_ragged_tensors

Utilities for efficiently working with, saving, and loading, collections of connected nested ragged tensors in PyTorch
MIT License
7 stars 1 forks source link

Simplify the code to only what is absolutely required (joint collections of nested ragged tensors) and further optimize #2

Closed mmcdermott closed 10 months ago

mmcdermott commented 10 months ago

Optimizations include:

  1. Not fully flattening the values so they can be added as slices.
  2. Introducing type safety to minimize disk and memory use while manipulating.
  3. Other small changes