Texera / texera

Collaborative Machine-Learning-Centric Data Analytics Using Workflows
https://texera.github.io
Apache License 2.0
163 stars 73 forks source link

Refine VirtualDocument APIs and PartitionDocument implementation #2669

Closed bobbai00 closed 5 months ago

bobbai00 commented 5 months ago

This PR first changes the VirtualDocument APIs, by replacing all the function names containingwrite/set, which are requiring to do append write, to append.

It also modifies the PartitionDocument and FileDocument by adding a type parameter T. Using this T, the FileDocument supports iterator and get by index to provide caller more convenient way of doing read.