Investigate Parquet/Avro usage in Enso

[JaroslavTulach]

Build up on the Arrow work and investigate how to read/generate a Parque file into a Table.

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for yesterday (2024-02-21):

Progress: Resurecting work on Arrow. Filed follow up ticket for things missed in the first iteration. Improving packaging of Arrow. Still addressing some failures in semantic versioning (#8692, needed to support more of the spec). It should be finished by 2024-02-29.

Next Day: Next day I will be working on the #8772 task. Continue Arrow work

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for yesterday (2024-02-22):

Progress: Addressing follow up issues blocking the ticket. PR is up. Looking into Parquet. Meeting on local project manager work. It should be finished by 2024-02-29.

Next Day: Next day I will be working on the #8772 task. Continue Arrow work

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for the provided date (2024-02-23):

Progress: Adding more tests to the PR demonstrating usage (gave up on extending the grammar). Investigating Parquet and Arrow integration. It should be finished by 2024-02-29.

Next Day: Next day I will be working on the #8772 task. Continue Arrow/Parquet investigation

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for yesterday (2024-02-26):

Progress: Looking into examples of reading/writing Parquet to/from Arrow. It should be finished by 2024-02-29.

Next Day: Next day I will be working on the #8772 task. Continue the investigation

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for yesterday (2024-02-27):

Progress: Investigating padding of data/bitmap buffers that was missing in the first version. It should be finished by 2024-02-29.

Next Day: Next day I will be working on the #8772 task. Continue the investigation

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for yesterday (2024-02-28):

Progress: Lots of meetings, adding padding as required by Arrow specification. Will need to improve arrow api to allow for mutable builder. It should be finished by 2024-02-29.

Next Day: Next day I will be working on the #8772 task. Continue the investigation

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for yesterday (2024-02-29):

Progress: Mostly OOO, added the padding logic. It should be finished by 2024-02-29.

Next Day: Next day I will be working on the #8772 task. Continue the investigation

[enso-bot[bot]]

Hubert Plociniczak reports a new 🔴 DELAY for the provided date (2024-03-01):

Summary: There is 8 days delay in implementation of the Investigate Parquet/Avro usage in Enso (#8772) task. It will cause 0 days delay for the delivery of this weekly plan.

Delay Cause: Addressing missing implementation details before I can add Parquet/Arrow integration.

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for the provided date (2024-03-01):

Progress: Added Arrow builder to demonstrate how to build immutable Vectors from mutable Arrow Arrays. Investigating memory allocation restrictions from the specification. It should be finished by 2024-03-08.

Next Day: Next day I will be working on the #8772 task. Continue the investigation

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for yesterday (2024-03-04):

Progress: Made sure the allocation of memory follow Arrow specific requirements. Looking how to fit local implementation into Arrow's serde capabilities. Lots of meetings. It should be finished by 2024-03-08.

Next Day: Next day I will be working on the #8772 task. Continue the investigation

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for yesterday (2024-03-05):

Progress: Addressing PR review, working towards Parquet serde. Looking into widgets/visualization slowdown. It should be finished by 2024-03-08.

Next Day: Next day I will be working on the #8772 task. Continue the investigation

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for yesterday (2024-03-06):

Progress: More work on PR review, started looking into performance problems of #9278. Investigated problems with MacOS CI build which in the end turned out to be configuration problem. It should be finished by 2024-03-08.

Next Day: Next day I will be working on the #8772 task. Address comments, tackle #9278.

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for yesterday (2024-03-07):

Progress: Addressing review comments - pushing builder pattern directly to Arrow implementation. Discussing problems with imports and FQN (#9329). It should be finished by 2024-03-08.

Next Day: Next day I will be working on the #9278 task. Address any remaining problems with PR and pick up next ticket.

[enso-bot[bot]]

Hubert Plociniczak reports a new STANDUP for the provided date (2024-03-08):

Progress: Addressed remaining problems. PR merged. Started investigating #9278. Various PR reviews. It should be finished by 2024-03-08.

Next Day: Next day I will be working on the #9278 task. Investigate next ticket.