AliyunContainerService / log-pilot

Collect logs for docker containers
https://yq.aliyun.com/articles/674327
Apache License 2.0
1.43k stars 402 forks source link

现在不支持es7.x #235

Open major-jay opened 5 years ago

major-jay commented 5 years ago

2019-08-20T08:10:28Z INFO Connected to Elasticsearch version 7.2.0 2019-08-20T08:10:28Z INFO Loading template for Elasticsearch version: 7.2.0 2019-08-20T08:10:36Z ERR Failed to connect: Connection marked as failed because the onConnect callback failed: Error loading Elasticsearch template: could not load template: couldn't load template: couldn't load json. Error: 400 Bad Request: {"error":{"root_cause":[{"type":"mapper_parsing_exception","reason":"Root mapping definition has unsupported parameters: [doc : {_meta={version=6.1.1}, dynamic_templates=[{fields={path_match=fields., mapping={type=keyword}, match_mapping_type=string}}, {docker.container.labels={path_match=docker.container.labels., mapping={type=keyword}, match_mapping_type=string}},

major-jay commented 5 years ago

可以先传递给logstash后 再发送到es吗

wangycc commented 5 years ago

建议自己升级下filebeat,目前的版本比较老,不支持的。 或者发送到kafka之类的消息流服务,logstash消费之后发给es

chenjiandongx commented 4 years ago

https://github.com/chenjiandongx/conveyor 可以尝试新工具

huoarter commented 4 years ago

https://github.com/arterhuo/log-pilot/tree/master 我升级7.6.1测试可以使用,不过我是写的kafka不是直接写es。你参考下,应该可以支持7.x es

xxy123456 commented 4 years ago

我也遇到同样的问题了

bogeit commented 3 years ago

https://github.com/arterhuo/log-pilot/tree/master 我升级7.6.1测试可以使用,不过我是写的kafka不是直接写es。你参考下,应该可以支持7.x es

@huoarter 你这个版本不知道试过收集stdout的日志没有,我用的7.10,stdout和文件写es7.10都没问题,就是写到kafka的时候,stdout没效果,容器内的文件是可以的。