issues
search
iris-hep
/
idap-200gbps-atlas
benchmarking throughput with PHYSLITE
6
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Test fsspec-xrootd v0.3.0
#54
alexander-held
closed
4 months ago
3
Large Datasets get duplicated files
#53
gordonwatts
closed
4 months ago
2
Understand why SX Pods in the AF are so much worse than in River
#52
gordonwatts
closed
4 months ago
3
Add a range of possible individual datasets to run
#51
gordonwatts
closed
4 months ago
0
feat: optimize graph to reduce number of nodes and save pre-processing report
#50
alexander-held
closed
4 months ago
0
Try out a large data test
#49
gordonwatts
closed
4 months ago
19
Fix up how we do the non-zero count so DASK can better optimize
#48
gordonwatts
closed
4 months ago
6
Get `[cpp_vfloat]` working properly in `getAttribute`
#47
gordonwatts
closed
4 months ago
0
Run and ignore errors in SX
#46
gordonwatts
closed
4 months ago
0
Do SX Thursday Speed Test
#45
gordonwatts
closed
4 months ago
1
uproot reads need to back off when hitting the S3 infrastructure
#44
gordonwatts
closed
4 months ago
3
Use type parameterized getAttribute
#43
gordonwatts
closed
4 months ago
0
Optimize graph to have less nodes
#42
alexander-held
closed
4 months ago
1
Update ServiceX to use the new client (3.0bX)
#41
gordonwatts
closed
4 months ago
9
Save preprocessing output
#40
alexander-held
closed
4 months ago
4
Generate report for pre-processing
#39
alexander-held
closed
4 months ago
1
Migrate to using the PHYSLITE dataset
#38
gordonwatts
closed
4 months ago
0
Recursion errors at scale
#37
alexander-held
closed
4 months ago
2
Missing branches in some files
#36
alexander-held
closed
4 months ago
11
feat: move single thread debugging and add fileset configuration options
#35
alexander-held
closed
5 months ago
0
Convert the simple test to use PHYSLITE `func_adl` typing
#34
gordonwatts
closed
4 months ago
2
Use one of Alex's offical datasets for the test run
#33
gordonwatts
closed
4 months ago
1
Fix ServiceX to use the proper end point
#32
gordonwatts
closed
4 months ago
2
Factor out debugging utilities from materialize_branches
#31
alexander-held
closed
5 months ago
0
ServiceX Client S3 tells you to slow down with too many dask workers
#30
gordonwatts
closed
4 months ago
3
feat: Save figures to figures directory
#29
matthewfeickert
closed
5 months ago
0
feat: include complete list of files
#28
alexander-held
closed
5 months ago
0
Understand difference in `num_requested_bytes` between coffea + Dask setup and plain `uproot.open`
#27
alexander-held
opened
5 months ago
4
Check fraction of files read across full list of files
#26
alexander-held
closed
4 months ago
5
Profile uproot performance per branch to identify possible bottlenecks
#25
alexander-held
closed
4 months ago
7
Replicate the 190 TB into MWT2_UC_LOCALGROUPDISK
#24
gordonwatts
closed
5 months ago
1
Add `pip install` to running instructions for materalize test
#23
gordonwatts
closed
5 months ago
1
feat: nicer format for container metadata
#22
alexander-held
closed
5 months ago
0
Pretty-print format the file container_metadata json file
#21
gordonwatts
closed
5 months ago
1
ServiceX S3 tells you to "slow down"!
#20
gordonwatts
closed
5 months ago
2
Initial SX Performance Test
#19
gordonwatts
closed
5 months ago
0
Generate First Performance Report for SX Chain
#18
gordonwatts
closed
5 months ago
2
feat: update list of branches
#17
alexander-held
closed
5 months ago
0
feat: create list of containers
#16
alexander-held
closed
5 months ago
0
Derive new list of branches for full Run-2 dataset
#15
alexander-held
closed
5 months ago
0
Initial uproot speed measurement
#14
gordonwatts
closed
5 months ago
1
Lessons learned
#13
alexander-held
opened
5 months ago
6
Simple ServiceX branch materialization script
#12
gordonwatts
closed
5 months ago
1
Write simplified script that will access and materliaze all branches read from SX
#11
gordonwatts
closed
5 months ago
0
init version
#10
ivukotic
closed
5 months ago
0
create a code that will prepend correct xcache to the files in the dataset
#9
ivukotic
closed
5 months ago
0
Specification for SX leaves to extract
#8
gordonwatts
closed
4 months ago
2
ServiceX Exploratory Notebook (#4)
#7
gordonwatts
closed
5 months ago
0
Figure out how to work around the awkward array bug for ServiceX
#6
gordonwatts
closed
5 months ago
1
Understand what samples are needed to get to a full 200 TB
#5
gordonwatts
closed
5 months ago
1
Previous
Next