search

petroglyf / functional-dag

This is a key library that is used for the infrastructure for visual cognitive architectures.
MIT License
0 stars 0 forks source link

Columns and Frame strategy - using protobufs #5

Closed ndepalma closed 1 week ago

ndepalma commented 1 year ago

Sooo DLPack is a great, cheap, and flexible data structure to pass between the nodes but tensor shapes aren't a great way to identify what the data actually is. Maybe we have some sort of GUID structure or something? Come up with a plan to handle types elegantly and cheaply.

Interesting: https://www.codeproject.com/Articles/5297814/Metaprogramming-in-Cplusplus-A-Gentle-Introduction

ndepalma commented 1 month ago

We've settled on protobufs as a data interchange.

ndepalma commented 1 month ago

Noooooo flipping to flatbuffers

ndepalma commented 3 weeks ago

Flatbuffers + Apache Arrow + Meson