are we using ES bulk updates when we should

AusDTO / disco_layer

Code, outputs and Information relevant to the discovery layer.

1 stars 5 forks source link

are we using ES bulk updates when we should #85

Open monkeypants opened 9 years ago

monkeypants commented 9 years ago

https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html

note the logs of celery update tasks seems to suggest there is a pack after every insert.

check that the haystack update/rebuild_index jobs are using bulk updates (read source). Also look at what the DB is doing here, that might be the crunch...