varnishcache-friends / varnishstatbeat

Elastic Beat for Varnish Stats
Other
7 stars 3 forks source link

Support ES7 #5

Open michbsd opened 3 years ago

michbsd commented 3 years ago

Hi,

Any chance we could get support for ES7 ?

It currently fails with ES6 template:

2021/03/05 10:32:32.951844 client.go:673: DBG  PUT http://172.16.0.166:9200/_template/varnishstatbeat.template-es6x.json  map[mappings:map[_default_:map[properties:map[@timestamp:map[type:date] beat:map[properties:map[name:map[index:false type:text] version:map[index:false type:text] hostname:map[index:false type:text]]] counter:map[type:long] fields:map[properties:map[]] meta:map[properties:map[cloud:map[properties:map[project_id:map[index:false type:text] provider:map[index:false type:text] region:map[index:false type:text] availability_zone:map[index:false type:text] instance_id:map[type:text index:false] machine_type:map[index:false type:text]]]]] tags:map[index:false type:text]] _all:map[norms:map[enabled:false]] _meta:map[version:6.0.0-alpha1] date_detection:false dynamic_templates:[map[strings_as_keyword:map[mapping:map[ignore_above:1024 index:false type:text] match_mapping_type:string]]]]] order:0 settings:map[index.refresh_interval:5s] template:varnishstatbeat-*]
2021/03/05 10:32:32.959299 sync_worker.go:87: ERR Connect failed with: Connection marked as failed because the onConnect callback failed: Could not load template: couldn't load template: couldn't load json. Error: 400 Bad Request. Response body: {"error":{"root_cause":[{"type":"mapper_parsing_exception","reason":"Root mapping definition has unsupported parameters:  [_default_ : {_meta={version=6.0.0-alpha1}, dynamic_templates=[{strings_as_keyword={mapping={ignore_above=1024, index=false, type=text}, match_mapping_type=string}}], _all={norms={enabled=false}}, date_detection=false, properties={@timestamp={type=date}, meta={properties={cloud={properties={machine_type={index=false, type=text}, availability_zone={index=false, type=text}, instance_id={index=false, type=text}, project_id={index=false, type=text}, provider={index=false, type=text}, region={index=false, type=text}}}}}, beat={properties={hostname={index=false, type=text}, name={index=false, type=text}, version={index=false, type=text}}}, counter={type=long}, fields={properties={}}, tags={index=false, type=text}}}]"}],"type":"mapper_parsing_exception","reason":"Failed to parse mapping [_doc]: Root mapping definition has unsupported parameters:  [_default_ : {_meta={version=6.0.0-alpha1}, dynamic_templates=[{strings_as_keyword={mapping={ignore_above=1024, index=false, type=text}, match_mapping_type=string}}], _all={norms={enabled=false}}, date_detection=false, properties={@timestamp={type=date}, meta={properties={cloud={properties={machine_type={index=false, type=text}, availability_zone={index=false, type=text}, instance_id={index=false, type=text}, project_id={index=false, type=text}, provider={index=false, type=text}, region={index=false, type=text}}}}}, beat={properties={hostname={index=false, type=text}, name={index=false, type=text}, version={index=false, type=text}}}, counter={type=long}, fields={properties={}}, tags={index=false, type=text}}}]","caused_by":{"type":"mapper_parsing_exception","reason":"Root mapping definition has unsupported parameters:  [_default_ : {_meta={version=6.0.0-alpha1}, dynamic_templates=[{strings_as_keyword={mapping={ignore_above=1024, index=false, type=text}, match_mapping_type=string}}], _all={norms={enabled=false}}, date_detection=false, properties={@timestamp={type=date}, meta={properties={cloud={properties={machine_type={index=false, type=text}, availability_zone={index=false, type=text}, instance_id={index=false, type=text}, project_id={index=false, type=text}, provider={index=false, type=text}, region={index=false, type=text}}}}}, beat={properties={hostname={index=false, type=text}, name={index=false, type=text}, version={index=false, type=text}}}, counter={type=long}, fields={properties={}}, tags={index=false, type=text}}}]"}},"status":400}
^C2021/03/05 10:32:34.091579 service.go:33: DBG  Received sigterm/sigint, stopping
phenomenes commented 3 years ago

Sorry, I'm no longer using Varnish at work and I don't have the time to look into this right now. Feel free to open a pull request, I will happily review it.