Running pipeline at speed, scaling experiments

lsst-uk / lasair-project-management

Event handling site for LSST:UK

Apache License 2.0

9 stars 0 forks source link

Open tms-epcc opened 3 years ago

tms-epcc commented 3 years ago

[x] Build test rig on new hardware
[x] Refactor Cassandra insert as callable function
[ ] Measure speed from numbers of threads, processes, nodes, memory
[ ] Evaluate Hard disk vs ssd and how they are connected into the cloud (block, cephfs)

tms-epcc commented 2 years ago

23/MAR/22 Lasair meeting

tms-epcc commented 1 year ago

14/DEC/22

@RoyWilliams will consider with the team how best to do this testing in terms of the staff effort vs benefits
want to identify bottlenecks in the pipeline and web server performance

tms-epcc commented 9 months ago

10/JAN/24