openstate / open-cultuur-data

The back- and front-end code that powers the Open Cultuur Data API
http://opencultuurdata.nl/
28 stars 18 forks source link

Open Archiven does not create it's own index #32

Closed breyten closed 10 years ago

breyten commented 10 years ago

It currently only pushes items to the combined index.

coret commented 10 years ago

Although I do not fully grasp how the ocd_openarchieven is created and filled, it is. I just checked this via:

curl -XDELETE 'http://localhost:9200/ocd_combined_index/' curl -XDELETE 'http://localhost:9200/ocd_resolver/' curl -XDELETE 'http://localhost:9200/ocd_openarchieven/' curl -XDELETE 'http://localhost:9200/ocd_erfgoed_leiden_beeldbank'

./manage.py extract start openarchieven (quit after few hundred records harvested) celery --app=ocd_backend:celery_app worker --loglevel=info --concurrency=1

and then checked http://localhost:9200/_plugin/head/ this showed an ocd_combined_index and ocd_openarchieven (and ocd_resolver), both loaded with (the same amount of) documents and contents as expected.

breyten commented 10 years ago

Ah, my bad. Probably something wonky with my index yesterday.

[2014-06-11 11:59:35,403: INFO/Worker-1] PUT http://127.0.0.1:9200/ocd_combined_index/item/27eaf0378aaf824cb9e49cf2811e87ecd3b8d2c8 [status:201 request:0.002s]
[2014-06-11 11:59:35,405: INFO/Worker-1] PUT http://127.0.0.1:9200/ocd_openarchieven/item/27eaf0378aaf824cb9e49cf2811e87ecd3b8d2c8 [status:201 request:0.001s]
[2014-06-11 11:59:35,407: INFO/Worker-1] PUT http://127.0.0.1:9200/ocd_resolver/url/c672656dacebb3109f28833e12105c171840cf61?op_type=create [status:201 request:0.001s]