search

philippjfr / panel-graphic-walker

A project providing a Graphic Walker Pane for use with HoloViz Panel.
2 stars 1 forks source link

Support external urls as data source #14

Open MarcSkovMadsen opened 1 day ago

MarcSkovMadsen commented 1 day ago

As Graphic Walker can take data larger than 1 GB it would be nice to outsource those datasets to S3, Azure Blob Storage or a Fast API server.

For example in my context we have hundreds of 100MB-1GB files we would like to make explorable. If the Panel server have to first read these and then send them to the client it will be quite occupied.

I.e. please enable me to provide a url with query args instead. Support for csv and parquet formats would be really, really nice.


GraphicWalker(object="https://datasets.holoviz.org/windturbines/v1/windturbines.parq")
GraphicWalker(object="https://my-private-server.domain/give-me-my-data?file=abcd.parquet&year=2024")
GraphicWalker(object="https://myaccount.blob.core.windows.net/mycontainer/myblob?versionid=2024-02-01")