issues
search
NASA-PDS
/
registry-sweepers
Scripts that run regularly on the registry database, to clean and consolidate information
Apache License 2.0
0
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
As a user, I want to know if the datasets available in the registry are published and visible in the API
#75
tloubrieu-jpl
opened
9 months ago
2
add descriptive error message for unparseable endpoint value
#74
alexdunnjpl
closed
9 months ago
0
Implement sweeper data versioning for repairkit
#73
alexdunnjpl
closed
9 months ago
0
Use opensearchPy instead of direct opensearch API requests
#72
alexdunnjpl
closed
9 months ago
0
improve log message on empty query hits
#71
alexdunnjpl
closed
9 months ago
0
Update repairkit to include repairkit version metadata and check to streamline execution
#70
jordanpadams
closed
9 months ago
2
Registry-Sweepers Error: contained no hits when hits were expected
#69
sjoshi-jpl
closed
9 months ago
6
Synchronization of Legacy Solr Registry in the new
#68
tloubrieu-jpl
closed
9 months ago
8
fix incorrectly-implemented retries
#67
alexdunnjpl
closed
10 months ago
1
Fix bugged retry functionality
#66
alexdunnjpl
closed
10 months ago
0
hotfix zero-update writes regression
#65
alexdunnjpl
closed
10 months ago
0
Empty write HTTP400 regression
#64
alexdunnjpl
closed
10 months ago
0
refactor utils module
#63
alexdunnjpl
closed
10 months ago
0
improve repairkit sweeper performance
#62
alexdunnjpl
closed
10 months ago
5
Deploy repairkit sweeper to delta and prod
#61
jordanpadams
closed
9 months ago
22
Registry-Sweeper ECS Enchancements (Post Multi-Tenancy)
#60
sjoshi-jpl
closed
2 months ago
2
Registry-Sweeper ECS Enchancements (Pre Multi-Tenancy)
#59
sjoshi-jpl
closed
9 months ago
2
Regularly synchronize the legacy registry collections on Solr in the registry in opensearch
#58
tloubrieu-jpl
closed
9 months ago
5
Bugfix http retries, increase retries
#57
alexdunnjpl
closed
11 months ago
2
Remedy absent retry-behaviour
#56
alexdunnjpl
closed
11 months ago
0
Remediate findings from Provenance Script Testing
#55
sjoshi-jpl
closed
9 months ago
6
New repairkit sweeper for updating metadata loaded with older versions of Harvest to use lists instead of single-value strings
#54
al-niessner
closed
10 months ago
17
terraform what was configured for registry-sweeper cluster/schedule
#53
tloubrieu-jpl
opened
11 months ago
0
Create registry-sweeper cluster and deploy/schedule the tasks
#52
tloubrieu-jpl
closed
10 months ago
2
implement infinite-loop guard in utils.query_registry_db()
#51
alexdunnjpl
closed
11 months ago
1
Introduce configuration
#50
alexdunnjpl
opened
11 months ago
0
fine-tune _bulk buffer flush for performance
#49
alexdunnjpl
closed
11 months ago
1
46 bulk flush tuning
#48
alexdunnjpl
closed
11 months ago
1
Improve logging configuration
#47
tloubrieu-jpl
opened
11 months ago
2
Tweak _bulk flush threshold
#46
alexdunnjpl
closed
11 months ago
0
40 add logging aggregation, LOGLEVEL env var, other logging tweaks
#45
alexdunnjpl
closed
11 months ago
2
34 43 remove broken cross-cluster remotes support
#44
alexdunnjpl
closed
11 months ago
1
Remove CCS support
#43
alexdunnjpl
closed
11 months ago
0
Implement more-robust response success checking for all Opensearch requests.
#42
alexdunnjpl
opened
11 months ago
2
amend metadata update writes to only target primary node, not CCRs
#41
alexdunnjpl
closed
11 months ago
2
Consider suppress-data-warnings option
#40
alexdunnjpl
closed
11 months ago
1
Profile memory usage
#39
alexdunnjpl
closed
5 months ago
17
fix error logging json attribute path
#38
alexdunnjpl
closed
11 months ago
1
Fatal error upon unexpected error due to bad json path
#37
alexdunnjpl
closed
11 months ago
0
Review CCR behaviour
#36
alexdunnjpl
closed
11 months ago
1
Update README.md with benchmarks, docker build instruction
#35
alexdunnjpl
closed
11 months ago
2
Provenance bulk update db writes fail under specific conditions related to presence of CCRs
#34
alexdunnjpl
closed
11 months ago
2
32 http retries and error logging/handling improvements
#33
alexdunnjpl
closed
11 months ago
3
Properly resolve errors during db write operations
#32
alexdunnjpl
closed
11 months ago
0
Limit task count to 1 for ECS provenance cluster
#31
sjoshi-jpl
closed
10 months ago
7
Configure monitoring for Registry Sweeper ECS cluster
#30
sjoshi-jpl
closed
10 months ago
5
implement chunking for utils.write_updated_docs()
#29
alexdunnjpl
closed
11 months ago
1
registry-sweepers breaks when run against production-scale data
#28
alexdunnjpl
closed
11 months ago
0
Intialize README.md
#26
tloubrieu-jpl
closed
11 months ago
0
Enhance provenance sweeper with more graceful failure when registry contains zero documents
#25
alexdunnjpl
closed
7 months ago
10
Previous
Next