ServiceX - Data Delivery for the HEP Community
ServiceX is an on-demand service that delivers data straight from the grid to high energy physics analysts in an easy, flexible, and highly performant manner.
Features
- Experiment-agnostic: Supports both the ATLAS and CMS collaborations on the LHC.
- Custom filters and pre-processing: Easily filter events, request specific columns, and unpack compressed formats using the func-adl analysis description language.
- Choose your format: ServiceX can deliver data in a variety of columnar formats, including streams of ROOT data, small ROOT files, HDF5, and Apache Arrow buffers.
- No hassle: ServiceX uses Rucio to find and access data wherever it lives, so users don't have to worry about these details.
- Simple and Pythonic: Using ServiceX takes only a few lines of code in any Python environment, such as a script or Jupyter notebook.
Getting Started
Check out our quick start guide for instructions on how to obtain credentials, install the ServiceX Python library, and make your first ServiceX transformation request.
Documentation
The ServiceX documentation is hosted on Read the Docs.
Self-Hosting
The Scalable Systems Laboratory (SSL) at IRIS-HEP maintains multiple instances of ServiceX to transform several input formats from different experiments.
In addition, ServiceX is an open-source project, and you are welcome to host your own deployment. Instructions on how to configure and deploy ServiceX can be found in our deployment guide.
Contributing
The ServiceX team welcomes community contributions. If you'd like to get involved, please check out our contributor guide.
License
ServiceX is distributed under a BSD 3-Clause License.
Acknowledgements
ServiceX is a component of the IRIS-HEP Intelligent Data Delivery Service, and is supported by National Science Foundation under Cooperative Agreement OAC-1836650. Any opinions, findings, conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.