search

ioos / ioos-code-sprint

Information about IOOS Code Sprint activities.
https://ioos.github.io/ioos-code-sprint/
MIT License
8 stars 14 forks source link

[XPublish]: Performance and scaling improvements #43

Open jonmjoyce opened 5 months ago

jonmjoyce commented 5 months ago

Project Description

The XPublish community has discussed ideas for measuring and improving performance of serving data, such as caching, integrating with dask for distributed processing of large datasets, and more. This work will improve the ability for XPublish to serve very large datasets.

Expected Outcomes

Skills required

Python with async paradigms Basic understanding of dask or other distributed computing libraries

Expertise

Expert

Topic Lead(s)

Jonathan Joyce jonmjoyce, Matt Iannucci mpiannucci

Relevant links

https://github.com/xpublish-community/xpublish/pull/208

MathewBiddle commented 4 months ago

Thank you for taking the time to propose this topic! From the Code Sprint topic survey, this has garnered a lot of interest.

Following the contributing guidelines on selecting a code sprint topic I have assigned this topic to @jonmjoyce . Unless indicated otherwise, the assignee will be responsible for identifying a plan for the code sprint topic, establishing a team, and taking the lead on executing said plan. The first action for the lead is to: