search

coiled / dask-snowflake

Dask integration for Snowflake
BSD 3-Clause "New" or "Revised" License
30 stars 7 forks source link

PyPI 0.0.1 release git commit #10

Closed zzhengnan closed 3 years ago

zzhengnan commented 3 years ago

Hi team. Thanks for this inspired tool! I'm really excited about integrating Dask with Snowflake.

I understand there's a 0.0.1 release for this package on PyPI but don't see a corresponding git tag in this repo. Can you point me to the exact commit? Thanks!

https://pypi.org/project/dask-snowflake/0.0.1/

zzhengnan commented 3 years ago

Tagging @jrbourbeau as I see you are the maintainer for the PyPI package.

jrbourbeau commented 3 years ago

Glad to hear it @zzhengnan! The 0.0.1 release doesn't contain much more than a basic setup.py and README file (no actual code). We pushed that out in order to reserve the dask-snowflake name on PyPI.

We're planning to push out an actual dask-snowflake release in the next week or so. In the meantime, we're recommending installing dask-snowflake from source in this repo for folks who want to try things out.

If you'd like, I could ping you here when we push out the release

zzhengnan commented 3 years ago

Ah that makes sense. Nothing worse than a random package taking up a desirable name. And yes, please let me know once the release is out. Thanks!

zzhengnan commented 3 years ago

@jrbourbeau I see version 0.0.2 was just uploaded to PyPI (and a corresponding tag created here on GitHub). Is this version appropriate for general testing/usage?

Separately, is there anything you can share regarding the future of this project in terms of planned features etc. Thanks!

jrbourbeau commented 3 years ago

Yep! Version 0.0.2 on PyPI (and conda-forge) should be good to start testing out. Any feedback you have is very welcome : )

Separately, is there anything you can share regarding the future of this project in terms of planned features etc.

dask-snowflake is meant to provide an interface between Snowflake and Dask for parallel IO. Are there specific features you're looking for? For example, having control over the partition batch size fetched from Snowflake has come up before (xref https://github.com/coiled/dask-snowflake/issues/7)

zzhengnan commented 3 years ago

I don't have anything particular in mind. Was mostly just curious about the future direction of the project.

I look forward to testing this out for some projects at work. Will definitely check back in if I have any feedback. Thanks James!