single-cell-data / SOMA

A flexible and extensible API for annotated 2D matrix data stored in multiple underlying formats.
MIT License
71 stars 9 forks source link

Abstract spec refinement -- tracking issue #34

Open bkmartinjr opened 1 year ago

bkmartinjr commented 1 year ago

Tracking issue for tactical refinement of the abstract spec as we run up to an early pilot implementation.


gspowley commented 1 year ago

dense nd array - should the read operator support incremental/chunked reads, or should we remove the batch_size parameter? (the end user can still do their own chunking, as they know the chunk/result size)

We can support batching for dense arrays in the SOMA C++ API. This would remove the burden of batching from the user and provide a more symmetric API for dense and sparse arrays.

bkmartinjr commented 1 year ago

support batching for dense arrays in the SOMA C++ API.

Do you have a suggestion for what the interface would look like? I.e., a suggestion on how to return the coordinates of each chunk? I do think it would be useful