uvacw / inca

24 stars 6 forks source link

fixed document insert error by dynamically inferring doctype #289

Closed bobvdvelde closed 6 years ago

bobvdvelde commented 6 years ago

There were problems when any (rss)scraper tried inserting documents. The current fix tries to find the first matching doctype key in the order doctype, _source.doctype, _type or failing those unknown (with logger warning). In addition, new documents are inserted through their _source content (for instance when imported from other Elasticsearch instances or failing that raw.