TileDB-Inc / TileDB-VCF

Efficient variant-call data storage and retrieval library using the TileDB storage library.
https://tiledb-inc.github.io/TileDB-VCF/
MIT License
88 stars 15 forks source link

Migrate to Arrow C data interface #653

Closed gspowley closed 8 months ago

gspowley commented 8 months ago

Modify the python API to use the Arrow C data interface with pyarrow and remove the direct usage of and dependency on libarrow.

CI improvements:

These changes reduce Azure CI runs from ~1.5 hours to ~30 min.

shortcut-integration[bot] commented 8 months ago

This pull request has been linked to Shortcut Story #38405: [vcf] Stop linking against libarrow.

github-actions[bot] commented 8 months ago

The backport to release-0.28 failed:

The process '/usr/bin/git' failed with exit code 128

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add .worktrees/backport-release-0.28 release-0.28
# Navigate to the new working tree
cd .worktrees/backport-release-0.28
# Create a new branch
git switch --create backport-653-to-release-0.28
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick --mainline 1 f51eb666d2aa9f00b60a7ccb48b38bf4df3b3195
# Push it to GitHub
git push --set-upstream origin backport-653-to-release-0.28
# Go back to the original working tree
cd ../..
# Delete the working tree
git worktree remove .worktrees/backport-release-0.28

Then, create a pull request where the base branch is release-0.28 and the compare/head branch is backport-653-to-release-0.28.