crawler: addIfMissing is attempting a duplicate insert

AusDTO / disco_layer

Code, outputs and Information relevant to the discovery layer.

1 stars 5 forks source link

crawler: addIfMissing is attempting a duplicate insert #39

Closed nokout closed 9 years ago

nokout commented 9 years ago

When queuing a lot of results we can get duplicate inserts after the select count. Not a big issue because the record has infact been stored which is all we want anyhow.

nokout commented 9 years ago

This only appears to be an issue on my micro testing environment. I suspect it is just down to their only being a single CPU so there is a concurrency issue. It is only an issue with the index, should it occur in production we can just rebuild the index to recover and the orientdb index is not really being used in anger as everything will be getting indexed and queried through solr. Closing.