nod-ai / sharktank

SHARK Inference Modeling and Serving
Apache License 2.0
7 stars 9 forks source link

Add sharding of Punet's up/down block #92

Closed sogartar closed 2 weeks ago

sogartar commented 2 weeks ago

Add sharded cat with inefficient implementation.

Allow for overriding based on a general boolean type expression in SignatureDispatcher. This is used in the cat signature dispatch where we have a collection of tensors.

Add some tree structure utilities.