alibaba / DataX

DataX是阿里云DataWorks数据集成的开源版本。
Other
15.77k stars 5.4k forks source link

elasticsearchwriter对 es7.9.2 版本settings不生效 #866

Open flackyang opened 3 years ago

flackyang commented 3 years ago

使用elasticsearchwriter往 elasticsearch7.9.2 版本写数据, settings配置没有生效 elasticsearch 版本 7.9.2 datax配置: "writer": { "name": "elasticsearchwriter", "parameter": { "endpoint": "http://XXXX:9200", "accessId": "xxxx", "accessKey": "xxxx", "index": "XXXXX", "type": "_doc", "cleanup": true, "settings": {"index": {"number_of_shards": 2, "number_of_replicas": 0}}, "column": [ {"name": "company_id", "type": "integer"}, { "name": "company_nm","type": "text" } ], "discovery": false, "dynamic": false, "batchSize": 1000 } } }

buzhouke commented 3 years ago

这里标注清楚了仅es5.x版本

VincentSleepless commented 3 years ago

sandbox -searchbox io内部目前支持es2 es5 ,需要设置一个elasticsearchversion的一个动作,前几天看貌似es6刚push上去,es貌似还不行, es2 es5 es6 es7获取fieldmapping的请求路径不一致,可能需要手工调整下了,建议改造一下插件,或者按版本输出多个插件进行处理。