issues
search
wellcomecollection
/
concepts-pipeline
Some sort of ETL pipeline for concepts in the Wellcome Collection catalogue
MIT License
0
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Use the 2023-02-21 pipeline
#100
alexwlchan
closed
1 year ago
0
Gather types and canonicalids in the Concepts Aggregator
#99
paul-butcher
closed
1 year ago
0
Split catalogue-concepts entries in the Recorder
#98
paul-butcher
closed
1 year ago
0
Catalogue pipeline 2023 01 19
#97
paul-butcher
closed
1 year ago
0
Use the new Lambda terraform module
#96
jamieparkinson
closed
1 year ago
0
extract Agents
#95
paul-butcher
closed
1 year ago
0
Bulk aggregator/recorder lambdas
#94
paul-butcher
closed
1 year ago
0
Subject ontologyType extraction
#93
paul-butcher
closed
1 year ago
0
Remove combineMat streams nonsense
#92
jamieparkinson
closed
1 year ago
0
Extract Places too
#91
jamieparkinson
closed
1 year ago
0
Use canonicalId to deduplicate concepts
#90
jamieparkinson
closed
1 year ago
0
Some concepts are missing from the API
#89
jamieparkinson
closed
1 year ago
5
combine type and identifier for catalogue concept deduplication
#88
paul-butcher
closed
1 year ago
0
Bump catalogue pipeline date
#87
jamieparkinson
closed
1 year ago
0
Use a display/query index mapping for concepts
#86
jamieparkinson
closed
2 years ago
0
Provision an ES user for the concepts API
#85
jamieparkinson
closed
2 years ago
0
A couple of improvements
#84
jamieparkinson
closed
2 years ago
0
Bump ingestor lambda timeout to 900s
#83
jamieparkinson
closed
2 years ago
0
Rename UsedConcept to CatalogueConcept
#82
jamieparkinson
closed
2 years ago
0
Bulk recording of concepts
#81
jamieparkinson
closed
2 years ago
0
extract ontologyType from catalogue concepts
#79
paul-butcher
closed
2 years ago
2
Get ontology type from LoC concept data
#78
jamieparkinson
closed
2 years ago
2
Get ontology type from concepts in catalogue
#77
jamieparkinson
closed
2 years ago
1
Recorder: bulk operation mode
#76
jamieparkinson
closed
2 years ago
0
Get the recorder working
#75
jamieparkinson
closed
2 years ago
0
Make Identifier an Indexable
#74
jamieparkinson
closed
2 years ago
0
Recorder service
#73
jamieparkinson
closed
2 years ago
0
Add a Typeclass for things we want to put into and take out of indices
#72
jamieparkinson
closed
2 years ago
0
Refactors ahead of Recorder implementation
#71
jamieparkinson
closed
2 years ago
0
Publish messages before terminating the actor system
#70
jamieparkinson
closed
2 years ago
0
Even more logging
#69
jamieparkinson
closed
2 years ago
0
Recorder skeleton
#68
paul-butcher
closed
2 years ago
0
Improve WorkIdSource logging
#67
jamieparkinson
closed
2 years ago
0
Output updates from the aggregator
#66
jamieparkinson
closed
2 years ago
0
Subscribe the concepts aggregator to the catalogue pipeline
#65
paul-butcher
closed
2 years ago
0
Create a Recorder service
#64
jamieparkinson
closed
2 years ago
3
Output changes from the aggregator
#63
jamieparkinson
closed
2 years ago
0
insert missing space
#62
paul-butcher
closed
2 years ago
0
Prevent ingestor queue overloading ES
#61
paul-butcher
closed
2 years ago
1
Deploy ingestor via CI
#60
paul-butcher
closed
2 years ago
0
Run Ingestor on Lambda
#59
paul-butcher
closed
2 years ago
0
Add code deployment
#58
paul-butcher
closed
2 years ago
1
Filter out 781 identifiers
#57
jamieparkinson
closed
2 years ago
0
Fix secret fetching
#56
paul-butcher
closed
2 years ago
0
Remove dependency on ES low-level library
#55
jamieparkinson
closed
2 years ago
0
Connect aggregator to works ingest topic
#54
paul-butcher
closed
2 years ago
5
Terraform the Aggregator Lambda
#53
paul-butcher
closed
2 years ago
0
add analysis scripts
#52
paul-butcher
closed
2 years ago
0
Aggregator as fat jar
#51
paul-butcher
closed
2 years ago
0
Ingest authoritative concepts
#50
jamieparkinson
closed
2 years ago
0
Previous
Next