silx-kit / silx

silx toolkit
http://www.silx.org/doc/silx/latest/
MIT License
129 stars 73 forks source link

silx.io.open: Added basic support for tiled URLs #4121

Open t20100 opened 5 months ago

t20100 commented 5 months ago

Checklist:

This PR adds minimal support for tiled in silx.io.open through a silx.io.tiledh5 module. As it stand, it only supports Container and ArrayClient.

There is a way to limit the number of entries retrieved for each group by setting silx.io.tiledh5.TiledH5.MAX_CHILDREN_PER_GROUP (default: all).

silx.io.open tries to open http(s) URLs with h5pyd and tiled when available and raises an IOError exception when both fail. Other exceptions when accessing content (timeout, connection errors) are not catched.

There a shortcut in silx.io.open added in first poc when passing an URL with a tiled- prefix that I would prefer to remove now that the basic URL can be used. (Note: since first poc in this branch, I changed the prefix from tiled: to tiled- to avoid issues with URL parsing) attn @vasole

Related to #4106

vasole commented 5 months ago

I changed the prefix from tiled: to tiled- to avoid issues with URL parsing) attn @vasole

https://github.com/vasole/pymca/pull/1075 should deal with it

danielballan commented 4 months ago

Hello! I am just writing to provide a heartbeat...we're very interested in this work. We have recently had our time consumed with some urgent operational tasks, and NSLS-II heads back into operations next week. We look forward to digging into this.