astrojuanlu / kedro-pypi-monitor

Monitor for PyPI downloads of Kedro
0 stars 0 forks source link

Use clickpy data #1

Open astrojuanlu opened 2 months ago

astrojuanlu commented 2 months ago

I tried to use Clickpy data https://clickhouse.com/blog/clickpy-one-trillion-rows like this:

import clickhouse_connect

client = clickhouse_connect.get_client(host="clickpy-clickhouse.clickhouse.com", username="play", database="pypi", secure=True)

kedro_all_total_downloads = pl.from_arrow(client.query_arrow("SELECT project, count FROM pypi_downloads WHERE project LIKE 'kedro%'"))

However:

astrojuanlu commented 2 months ago

All of these issues are minor. Let's do this.