search

NSLS-II-SIX / profile_collection

Collection ipython profile
BSD 3-Clause "New" or "Revised" License
0 stars 3 forks source link

Use lustre storage; create dir tree automatically by AD #36

Closed mrakitin closed 3 years ago

mrakitin commented 3 years ago

In this update I've used the HDF5Plugin_V22 plugin, which defines FilePlugin_V22, that has the create_directory component. The value for that component is set to -3 via the stage_sigs, so that 3 levels of directories are created (%Y/%m/%d).

Here is the help from CSS on that feature, for future reference: image

The storage location for the hdf5 files is set to be the Lustre mount.

mrakitin commented 3 years ago

@pelliciari tested it, and confirmed over the phone that it worked as expected.

mrakitin commented 3 years ago

I tested it with RE(bp.count([m3_diag_cam], num=3)), and got all the images back with data = np.array(list(hdr.data('m3_diag_cam_image'))). The create_dir component value is reverted to 0 (original value before the scan).

tacaswell commented 3 years ago

If this works, then this should be pushed upstream to ophyd ASAP!

mrakitin commented 3 years ago

Pushed upstream via https://github.com/bluesky/ophyd/pull/996.