pelias-deprecated / quattroshapes

(DEPRECATED) Pelias import pipeline for Quattroshapes
https://github.com/pelias/whosonfirst
5 stars 1 forks source link

Invalid bulk payload length #12

Closed heffergm closed 9 years ago

heffergm commented 9 years ago

Seeing the following on admin0/1/2:

vagrant@pelias:/opt/pelias/logs$ cat quattroshapes_ITA_admin0.err
running imports for: admin0
transaction error invalid bulk payload length

vagrant@pelias:/opt/pelias/logs$ cat quattroshapes_ITA_admin0.out

{
  "start": 1416343410133
}
[]
{
  "start": 1416343410133,
  "batch_error": 1,
  "paused": false,
  "transient": 1,
  "current_length": 0
}
{
  "start": 1416343410133,
  "batch_error": 1,
  "paused": false,
  "transient": 1,
  "current_length": 0
}
{
  "start": 1416343410133,
  "batch_error": 1,
  "paused": false,
  "transient": 0,
  "current_length": 0,
  "indexed": 1,
  "batch_ok": 1,
  "batch_retries": 0,
  "failed_records": 0,
  "admin0": 1
}
missinglink commented 9 years ago

The error invalid bulk payload length is emitted by pelias/dbclient when it's been asked to submit a bulk index request where the batch length is 0 (ie. the batch is empty)

It's not an issue and I may remove the error message in the future, the heavy error reporting is there because that lib is still quite young, so thanks for reporting it, in this case I think it can be suppressed.

ref: https://github.com/pelias/dbclient/blob/1c576f360ff45b8b7e6ad285a6ab72663a974d12/src/transaction.js#L31

sevko commented 9 years ago

Closing as a pelias/dbclient issue.