issues
search
lsst-uk
/
csd3-echo-somerville
Code to backup from CSD3 to Echo S3, curate at STFC cloud and expose to Somerville
Apache License 2.0
0
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
BUG - zip files marked as 'skip' are not being skipped
#81
davedavemckay
opened
5 days ago
0
78 swift dask
#80
davedavemckay
closed
5 days ago
0
updatae
#79
davedavemckay
closed
1 week ago
0
Make a Swift API version of lsst_backup.py
#78
davedavemckay
closed
5 days ago
0
76 quick check file count vs object count
#77
davedavemckay
closed
4 weeks ago
0
Quick check file count vs object count
#76
davedavemckay
closed
4 weeks ago
1
72 read write to collate json
#75
davedavemckay
closed
1 month ago
0
Parallel filesystem traversal
#74
davedavemckay
opened
1 month ago
1
71 collate at pp folder
#73
davedavemckay
closed
1 month ago
0
Add options to read and write lists of files and folders to backup.
#72
davedavemckay
closed
1 month ago
1
SLOW processing - many small subfolders
#71
davedavemckay
closed
1 month ago
0
68 permissionerrors from rds
#70
davedavemckay
closed
1 month ago
0
Verify unlogged files
#69
davedavemckay
closed
1 month ago
2
PermissionErrors from RDS
#68
davedavemckay
closed
1 month ago
1
66 offload large files
#67
davedavemckay
closed
2 months ago
0
offload large files
#66
davedavemckay
closed
2 months ago
0
64 merge zip upload
#65
davedavemckay
closed
2 months ago
0
Zips spilling to disk
#64
davedavemckay
closed
2 months ago
0
54 change multiprocessing to dask
#63
davedavemckay
closed
2 months ago
0
54 change multiprocessing to dask
#62
davedavemckay
closed
2 months ago
0
48 check zip sequence (#55)
#61
davedavemckay
closed
2 months ago
0
catchup
#60
davedavemckay
closed
2 months ago
0
.
#59
davedavemckay
closed
2 months ago
0
catchup
#58
davedavemckay
closed
2 months ago
0
48 check zip sequence (#55)
#57
davedavemckay
closed
2 months ago
0
Change zip_contents delimiter
#56
davedavemckay
closed
1 month ago
1
48 check zip sequence
#55
davedavemckay
closed
2 months ago
0
Consider changing multiprocessing usage to Dask
#54
davedavemckay
closed
2 months ago
0
Catch-up
#53
davedavemckay
closed
2 months ago
0
done - testing
#52
davedavemckay
closed
2 months ago
0
45 zip file exclusion
#51
davedavemckay
closed
2 months ago
0
Add CLI to scripts/upload_object.py
#50
davedavemckay
closed
2 months ago
1
Add type hints
#49
davedavemckay
opened
2 months ago
0
Check zip contents before zipping - current sequence of events inefficient
#48
davedavemckay
closed
2 months ago
0
Give backup progress
#47
davedavemckay
opened
3 months ago
1
44 restore apply async
#46
davedavemckay
closed
3 months ago
0
unzipped zip contents not being excluded from upload
#45
davedavemckay
closed
2 months ago
3
Restore apply_async
#44
davedavemckay
closed
3 months ago
0
37 memory error
#43
davedavemckay
closed
3 months ago
0
Handle metadata as objects in process_collated_zips.py
#42
davedavemckay
closed
2 months ago
3
Update mamba_env container to use condaforge/miniforge3 base image
#41
davedavemckay
opened
3 months ago
0
continue on parent_folder == local_dir
#40
davedavemckay
closed
3 months ago
0
Parent folder above top-level folder during collation
#39
davedavemckay
closed
3 months ago
0
memory handling efforts
#38
davedavemckay
closed
3 months ago
0
MemoryErrors - BUG
#37
davedavemckay
closed
3 months ago
2
35 change monitorpy
#36
davedavemckay
closed
3 months ago
0
Change usage of monitor.py
#35
davedavemckay
closed
3 months ago
0
33 compare csv file lists
#34
davedavemckay
closed
3 months ago
0
Change usage of "compare_csv_file_lists.py"
#33
davedavemckay
closed
3 months ago
1
31 listing csvs
#32
davedavemckay
closed
3 months ago
0
Next