During a recent full reindex, it was discovered that indexing all LoC concepts via the ingestor service takes significantly longer than the maximum Lambda allowed execution time (see here for more info).
As a result, it does not make sense to keep a deployed version of the ingestor service in its current form. Rather than refactoring the service to get around this issue, we decided to remove the Lambda function and only run the service locally on the rare occasion when we need to do a full reindex.
As part of this work, the documentation on how to run the service locally should also be improved.
During a recent full reindex, it was discovered that indexing all LoC concepts via the
ingestorservice takes significantly longer than the maximum Lambda allowed execution time (see here for more info).As a result, it does not make sense to keep a deployed version of the
ingestorservice in its current form. Rather than refactoring the service to get around this issue, we decided to remove the Lambda function and only run the service locally on the rare occasion when we need to do a full reindex.As part of this work, the documentation on how to run the service locally should also be improved.