search

elastic / elasticsearch

Free and Open, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
69.43k stars 24.57k forks source link

simple_query_string logical operators error #54638

Closed javiramos1 closed 4 years ago

javiramos1 commented 4 years ago

Describe the feature:

Logical operators do not work in the simple_query_string search compared to query_string

Elasticsearch version 7.0.1

Plugins installed: []

JVM version (java -version): docker image elasticsearch:7.0.1

OS version (uname -a if on a Unix-like system): docker image elasticsearch:7.0.1

Description of the problem including expected versus actual behavior:

We recently switched from query_string to simple_query_string since we do not want to fail on invalid queries. We are starting to see inconsistent behavior with the logical operations where the logical AND is not respected. The simple_query_string returns results that match just one side of the logical AND. This does not happen with query_string

Steps to reproduce:

Index Settings:

{
    "live_articles_2019.12": {
        "settings": {
            "index": {
                "codec": "best_compression",
                "routing": {
                    "allocation": {
                        "require": {
                            "data": "hot"
                        }
                    }
                },
                "refresh_interval": "30s",
                "number_of_shards": "10",
                "provided_name": "live_articles_2019.12",
                "creation_date": "1581627617079",
                "sort": {
                    "field": "published_at",
                    "order": "desc"
                },
                "analysis": {
                    "filter": {
                        "en_min": {
                            "name": "minimal_english",
                            "type": "stemmer"
                        },
                        "en_possessive": {
                            "name": "possessive_english",
                            "type": "stemmer"
                        },
                        "stop_case_insensitive": {
                            "ignore_case": "true",
                            "type": "stop"
                        },
                        "c_shingle": {
                            "type": "shingle",
                            "filler_token": ""
                        },
                        "ds_replace": {
                            "pattern": "(^\\d+(?:(?:\\.|\\,|\\s+)\\d+|)$)",
                            "type": "pattern_replace",
                            "replacement": ""
                        }
                    },
                    "analyzer": {
                        "en_general": {
                            "filter": [
                                "stop_case_insensitive",
                                "classic",
                                "en_possessive",
                                "trim",
                                "asciifolding",
                                "en_min",
                                "lowercase"
                            ],
                            "tokenizer": "standard"
                        },
                        "en_special": {
                            "filter": [
                                "trim",
                                "asciifolding",
                                "lowercase",
                                "stop",
                                "c_shingle",
                                "porter_stem",
                                "trim",
                                "remove_duplicates",
                                "ds_replace"
                            ],
                            "char_filter": [
                                "html_strip"
                            ],
                            "tokenizer": "standard"
                        }
                    }
                },
                "number_of_replicas": "1",
                "uuid": "j55THr7NTdGYCEQYVpMEHw",
                "version": {
                    "created": "7000199"
                }
            }
        }
    },
...

Mappings:

{
    "live_articles_2019.08": {
        "mappings": {
            "dynamic_templates": [
                {
                    "t_en": {
                        "match": "*_t_en",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "en_general",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_es": {
                        "match": "*_t_es",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "spanish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_pt": {
                        "match": "*_t_pt",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "portuguese",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_de": {
                        "match": "*_t_de",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "german",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_fr": {
                        "match": "*_t_fr",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "french",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_it": {
                        "match": "*_t_it",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "italian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_ar": {
                        "match": "*_t_ar",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "arabic",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_da": {
                        "match": "*_t_da",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "danish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_fi": {
                        "match": "*_t_fi",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "finnish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_nl": {
                        "match": "*_t_nl",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "dutch",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_no": {
                        "match": "*_t_no",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "norwegian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_ru": {
                        "match": "*_t_ru",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "russian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_sv": {
                        "match": "*_t_sv",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "swedish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_tr": {
                        "match": "*_t_tr",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "turkish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_zh-cn": {
                        "match": "*_t_zh-cn",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "smartcn",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_zh-tw": {
                        "match": "*_t_zh-tw",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "smartcn",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_id": {
                        "match": "*_t_id",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "indonesian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_hy": {
                        "match": "*_t_hy",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "armenian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_eu": {
                        "match": "*_t_eu",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "basque",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_bn": {
                        "match": "*_t_bn",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "bengali",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_bg": {
                        "match": "*_t_bg",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "bulgarian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_ca": {
                        "match": "*_t_ca",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "catalan",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_cs": {
                        "match": "*_t_cs",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "czech",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_gl": {
                        "match": "*_t_gl",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "galician",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_hi": {
                        "match": "*_t_hi",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "hindi",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_hu": {
                        "match": "*_t_hu",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "hungarian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_ie": {
                        "match": "*_t_ie",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "irish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_lv": {
                        "match": "*_t_lv",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "latvian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_lt": {
                        "match": "*_t_lt",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "lithuanian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_ro": {
                        "match": "*_t_ro",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "romanian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_ckb": {
                        "match": "*_t_ckb",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "sorani",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_cjk": {
                        "match": "*_t_cjk",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "cjk",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_fa": {
                        "match": "*_t_fa",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "persian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_th": {
                        "match": "*_t_th",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "thai",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_el": {
                        "match": "*_t_el",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "greek",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_en": {
                        "match": "*_t_special_en",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "en_special",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_es": {
                        "match": "*_t_special_es",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "spanish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_pt": {
                        "match": "*_t_special_pt",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "portuguese",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_de": {
                        "match": "*_t_special_de",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "german",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_fr": {
                        "match": "*_t_special_fr",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "french",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_it": {
                        "match": "*_t_special_it",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "italian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_ar": {
                        "match": "*_t_special_ar",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "arabic",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_da": {
                        "match": "*_t_special_da",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "danish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_fi": {
                        "match": "*_t_special_fi",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "finnish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_nl": {
                        "match": "*_t_special_nl",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "dutch",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_no": {
                        "match": "*_t_special_no",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "norwegian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_ru": {
                        "match": "*_t_special_ru",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "russian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_sv": {
                        "match": "*_t_special_sv",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "swedish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_tr": {
                        "match": "*_t_special_tr",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "turkish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_zh-cn": {
                        "match": "*_t_special_zh-cn",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "smartcn",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_zh-tw": {
                        "match": "*_t_special_zh-tw",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "smartcn",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_id": {
                        "match": "*_t_special_id",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "indonesian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_hy": {
                        "match": "*_t_special_hy",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "armenian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_eu": {
                        "match": "*_t_special_eu",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "basque",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_bn": {
                        "match": "*_t_special_bn",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "bengali",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_bg": {
                        "match": "*_t_special_bg",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "bulgarian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_ca": {
                        "match": "*_t_special_ca",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "catalan",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_cs": {
                        "match": "*_t_special_cs",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "czech",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_gl": {
                        "match": "*_t_special_gl",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "galician",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_hi": {
                        "match": "*_t_special_hi",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "hindi",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_hu": {
                        "match": "*_t_special_hu",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "hungarian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_ie": {
                        "match": "*_t_special_ie",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "irish",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_lv": {
                        "match": "*_t_special_lv",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "latvian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_lt": {
                        "match": "*_t_special_lt",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "lithuanian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_ro": {
                        "match": "*_t_special_ro",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "romanian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_ckb": {
                        "match": "*_t_special_ckb",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "sorani",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_cjk": {
                        "match": "*_t_special_cjk",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "cjk",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_fa": {
                        "match": "*_t_special_fa",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "persian",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_th": {
                        "match": "*_t_special_th",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "thai",
                            "type": "text"
                        }
                    }
                },
                {
                    "t_special_el": {
                        "match": "*_t_special_el",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "greek",
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_en": {
                        "match": "*_tk_en",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "en_general",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_es": {
                        "match": "*_tk_es",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "spanish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_pt": {
                        "match": "*_tk_pt",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "portuguese",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_de": {
                        "match": "*_tk_de",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "german",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_fr": {
                        "match": "*_tk_fr",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "french",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_it": {
                        "match": "*_tk_it",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "italian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_ar": {
                        "match": "*_tk_ar",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "arabic",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_da": {
                        "match": "*_tk_da",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "danish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_fi": {
                        "match": "*_tk_fi",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "finnish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_nl": {
                        "match": "*_tk_nl",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "dutch",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_no": {
                        "match": "*_tk_no",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "norwegian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_ru": {
                        "match": "*_tk_ru",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "russian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_sv": {
                        "match": "*_tk_sv",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "swedish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_tr": {
                        "match": "*_tk_tr",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "turkish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_zh-cn": {
                        "match": "*_tk_zh-cn",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "smartcn",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_zh-tw": {
                        "match": "*_tk_zh-tw",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "smartcn",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_id": {
                        "match": "*_tk_id",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "indonesian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_hy": {
                        "match": "*_tk_hy",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "armenian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_eu": {
                        "match": "*_tk_eu",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "basque",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_bn": {
                        "match": "*_tk_bn",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "bengali",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_bg": {
                        "match": "*_tk_bg",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "bulgarian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_ca": {
                        "match": "*_tk_ca",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "catalan",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_cs": {
                        "match": "*_tk_cs",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "czech",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_gl": {
                        "match": "*_tk_gl",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "galician",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_hi": {
                        "match": "*_tk_hi",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "hindi",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_hu": {
                        "match": "*_tk_hu",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "hungarian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_ie": {
                        "match": "*_tk_ie",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "irish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_lv": {
                        "match": "*_tk_lv",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "latvian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_lt": {
                        "match": "*_tk_lt",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "lithuanian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_ro": {
                        "match": "*_tk_ro",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "romanian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_ckb": {
                        "match": "*_tk_ckb",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "sorani",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_cjk": {
                        "match": "*_tk_cjk",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "cjk",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_fa": {
                        "match": "*_tk_fa",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "persian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_th": {
                        "match": "*_tk_th",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "thai",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_el": {
                        "match": "*_tk_el",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "greek",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_en": {
                        "match": "*_tk_special_en",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "en_special",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_es": {
                        "match": "*_tk_special_es",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "spanish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_pt": {
                        "match": "*_tk_special_pt",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "portuguese",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_de": {
                        "match": "*_tk_special_de",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "german",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_fr": {
                        "match": "*_tk_special_fr",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "french",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_it": {
                        "match": "*_tk_special_it",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "italian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_ar": {
                        "match": "*_tk_special_ar",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "arabic",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_da": {
                        "match": "*_tk_special_da",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "danish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_fi": {
                        "match": "*_tk_special_fi",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "finnish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_nl": {
                        "match": "*_tk_special_nl",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "dutch",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_no": {
                        "match": "*_tk_special_no",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "norwegian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_ru": {
                        "match": "*_tk_special_ru",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "russian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_sv": {
                        "match": "*_tk_special_sv",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "swedish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_tr": {
                        "match": "*_tk_special_tr",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "turkish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_zh-cn": {
                        "match": "*_tk_special_zh-cn",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "smartcn",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_zh-tw": {
                        "match": "*_tk_special_zh-tw",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "smartcn",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_id": {
                        "match": "*_tk_special_id",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "indonesian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_hy": {
                        "match": "*_tk_special_hy",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "armenian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_eu": {
                        "match": "*_tk_special_eu",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "basque",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_bn": {
                        "match": "*_tk_special_bn",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "bengali",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_bg": {
                        "match": "*_tk_special_bg",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "bulgarian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_ca": {
                        "match": "*_tk_special_ca",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "catalan",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_cs": {
                        "match": "*_tk_special_cs",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "czech",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_gl": {
                        "match": "*_tk_special_gl",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "galician",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_hi": {
                        "match": "*_tk_special_hi",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "hindi",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_hu": {
                        "match": "*_tk_special_hu",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "hungarian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_ie": {
                        "match": "*_tk_special_ie",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "irish",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_lv": {
                        "match": "*_tk_special_lv",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "latvian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_lt": {
                        "match": "*_tk_special_lt",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "lithuanian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_ro": {
                        "match": "*_tk_special_ro",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "romanian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_ckb": {
                        "match": "*_tk_special_ckb",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "sorani",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_cjk": {
                        "match": "*_tk_special_cjk",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "cjk",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_fa": {
                        "match": "*_tk_special_fa",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "persian",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_th": {
                        "match": "*_tk_special_th",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "thai",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "tk_special_el": {
                        "match": "*_tk_special_el",
                        "match_mapping_type": "string",
                        "mapping": {
                            "analyzer": "greek",
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "_id": {
                        "match": "*_id",
                        "mapping": {
                            "type": "keyword"
                        }
                    }
                },
                {
                    "_at": {
                        "match": "*_at",
                        "mapping": {
                            "type": "date"
                        }
                    }
                },
                {
                    "_enabled": {
                        "match": "*_enabled",
                        "mapping": {
                            "type": "boolean"
                        }
                    }
                },
                {
                    "_bool": {
                        "match": "*_bool",
                        "mapping": {
                            "type": "boolean"
                        }
                    }
                },
                {
                    "_i": {
                        "match": "*_i",
                        "mapping": {
                            "type": "integer"
                        }
                    }
                },
                {
                    "_l": {
                        "match": "*_l",
                        "mapping": {
                            "type": "long"
                        }
                    }
                },
                {
                    "_byt": {
                        "match": "*_byt",
                        "mapping": {
                            "type": "byte"
                        }
                    }
                },
                {
                    "_t": {
                        "match": "*_t",
                        "mapping": {
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                },
                {
                    "_k": {
                        "match": "*_k",
                        "mapping": {
                            "ignore_above": 8100,
                            "type": "keyword"
                        }
                    }
                },
                {
                    "_tk": {
                        "match": "*_tk",
                        "mapping": {
                            "fields": {
                                "keyword": {
                                    "ignore_above": 8100,
                                    "type": "keyword"
                                }
                            },
                            "ignore_above": 8100,
                            "type": "text"
                        }
                    }
                }
            ],
            "properties": {
                "author_enabled": {
                    "type": "boolean"
                },
                "author_id": {
                    "type": "keyword"
                },
                "author_name_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "body_entities_dbpedia_links_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "body_entities_tk": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    }
                },
                "body_entities_types_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "body_sentiment_polarity_byt": {
                    "type": "byte"
                },
                "body_t": {
                    "type": "text"
                },
                "body_t_ar": {
                    "type": "text",
                    "analyzer": "arabic"
                },
                "body_t_da": {
                    "type": "text",
                    "analyzer": "danish"
                },
                "body_t_de": {
                    "type": "text",
                    "analyzer": "german"
                },
                "body_t_en": {
                    "type": "text",
                    "analyzer": "en_general"
                },
                "body_t_es": {
                    "type": "text",
                    "analyzer": "spanish"
                },
                "body_t_fi": {
                    "type": "text",
                    "analyzer": "finnish"
                },
                "body_t_fr": {
                    "type": "text",
                    "analyzer": "french"
                },
                "body_t_id": {
                    "type": "text",
                    "analyzer": "indonesian"
                },
                "body_t_it": {
                    "type": "text",
                    "analyzer": "italian"
                },
                "body_t_nl": {
                    "type": "text",
                    "analyzer": "dutch"
                },
                "body_t_pt": {
                    "type": "text",
                    "analyzer": "portuguese"
                },
                "body_t_ru": {
                    "type": "text",
                    "analyzer": "russian"
                },
                "body_t_special_ar": {
                    "type": "text",
                    "analyzer": "arabic"
                },
                "body_t_special_da": {
                    "type": "text",
                    "analyzer": "danish"
                },
                "body_t_special_de": {
                    "type": "text",
                    "analyzer": "german"
                },
                "body_t_special_en": {
                    "type": "text",
                    "analyzer": "en_special"
                },
                "body_t_special_es": {
                    "type": "text",
                    "analyzer": "spanish"
                },
                "body_t_special_fi": {
                    "type": "text",
                    "analyzer": "finnish"
                },
                "body_t_special_fr": {
                    "type": "text",
                    "analyzer": "french"
                },
                "body_t_special_id": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "indonesian"
                },
                "body_t_special_it": {
                    "type": "text",
                    "analyzer": "italian"
                },
                "body_t_special_nl": {
                    "type": "text",
                    "analyzer": "dutch"
                },
                "body_t_special_pt": {
                    "type": "text",
                    "analyzer": "portuguese"
                },
                "body_t_special_ru": {
                    "type": "text",
                    "analyzer": "russian"
                },
                "body_t_special_sv": {
                    "type": "text",
                    "analyzer": "swedish"
                },
                "body_t_special_tr": {
                    "type": "text",
                    "analyzer": "turkish"
                },
                "body_t_special_zh-cn": {
                    "type": "text",
                    "analyzer": "smartcn"
                },
                "body_t_special_zh-tw": {
                    "type": "text",
                    "analyzer": "smartcn"
                },
                "body_t_sv": {
                    "type": "text",
                    "analyzer": "swedish"
                },
                "body_t_tr": {
                    "type": "text",
                    "analyzer": "turkish"
                },
                "body_t_zh-cn": {
                    "type": "text",
                    "analyzer": "smartcn"
                },
                "body_t_zh-tw": {
                    "type": "text",
                    "analyzer": "smartcn"
                },
                "body_translated_t_en": {
                    "type": "text",
                    "analyzer": "en_general"
                },
                "characters_count_l": {
                    "type": "long"
                },
                "clusters_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "facebook_shares_l": {
                    "type": "long"
                },
                "google_plus_shares_l": {
                    "type": "long"
                },
                "hashtags_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "iab-qag_categories_1_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "iab-qag_categories_2_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "iab-qag_categories_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "iab-qag_categories_levels_byt": {
                    "type": "byte"
                },
                "iab-qag_confident_categories_1_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "iab-qag_confident_categories_2_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "iab-qag_confident_categories_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "id": {
                    "type": "keyword",
                    "store": true
                },
                "images_content_length_l": {
                    "type": "long"
                },
                "images_count_l": {
                    "type": "long"
                },
                "images_format_id": {
                    "type": "keyword"
                },
                "images_height_l": {
                    "type": "long"
                },
                "images_width_l": {
                    "type": "long"
                },
                "iptc-subjectcode_categories_1_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "iptc-subjectcode_categories_2_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "iptc-subjectcode_categories_3_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "iptc-subjectcode_categories_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "iptc-subjectcode_categories_levels_byt": {
                    "type": "byte"
                },
                "keywords_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "language_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "linkedin_shares_l": {
                    "type": "long"
                },
                "namespaces_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "paragraphs_count_l": {
                    "type": "long"
                },
                "published_at": {
                    "type": "date"
                },
                "reddit_shares_l": {
                    "type": "long"
                },
                "sentences_count_l": {
                    "type": "long"
                },
                "social_shares_sum_l": {
                    "type": "long"
                },
                "source_alexa_rank_AE_l": {
                    "type": "long"
                },
                "source_alexa_rank_AF_l": {
                    "type": "long"
                },
                "source_alexa_rank_AG_l": {
                    "type": "long"
                },
                "source_alexa_rank_AL_l": {
                    "type": "long"
                },
                "source_alexa_rank_AM_l": {
                    "type": "long"
                },
                "source_alexa_rank_AO_l": {
                    "type": "long"
                },
                "source_alexa_rank_AR_l": {
                    "type": "long"
                },
                "source_alexa_rank_AT_l": {
                    "type": "long"
                },
                "source_alexa_rank_AU_l": {
                    "type": "long"
                },
                "source_alexa_rank_AW_l": {
                    "type": "long"
                },
                "source_alexa_rank_AZ_l": {
                    "type": "long"
                },
                "source_alexa_rank_BA_l": {
                    "type": "long"
                },
                "source_alexa_rank_BB_l": {
                    "type": "long"
                },
                "source_alexa_rank_BD_l": {
                    "type": "long"
                },
                "source_alexa_rank_BE_l": {
                    "type": "long"
                },
                "source_alexa_rank_BF_l": {
                    "type": "long"
                },
                "source_alexa_rank_BG_l": {
                    "type": "long"
                },
                "source_alexa_rank_BH_l": {
                    "type": "long"
                },
                "source_alexa_rank_BI_l": {
                    "type": "long"
                },
                "source_alexa_rank_BJ_l": {
                    "type": "long"
                },
                "source_alexa_rank_BM_l": {
                    "type": "long"
                },
                "source_alexa_rank_BN_l": {
                    "type": "long"
                },
                "source_alexa_rank_BO_l": {
                    "type": "long"
                },
                "source_alexa_rank_BR_l": {
                    "type": "long"
                },
                "source_alexa_rank_BS_l": {
                    "type": "long"
                },
                "source_alexa_rank_BT_l": {
                    "type": "long"
                },
                "source_alexa_rank_BW_l": {
                    "type": "long"
                },
                "source_alexa_rank_BY_l": {
                    "type": "long"
                },
                "source_alexa_rank_BZ_l": {
                    "type": "long"
                },
                "source_alexa_rank_CA_l": {
                    "type": "long"
                },
                "source_alexa_rank_CD_l": {
                    "type": "long"
                },
                "source_alexa_rank_CF_l": {
                    "type": "long"
                },
                "source_alexa_rank_CG_l": {
                    "type": "long"
                },
                "source_alexa_rank_CH_l": {
                    "type": "long"
                },
                "source_alexa_rank_CI_l": {
                    "type": "long"
                },
                "source_alexa_rank_CK_l": {
                    "type": "long"
                },
                "source_alexa_rank_CL_l": {
                    "type": "long"
                },
                "source_alexa_rank_CM_l": {
                    "type": "long"
                },
                "source_alexa_rank_CN_l": {
                    "type": "long"
                },
                "source_alexa_rank_CO_l": {
                    "type": "long"
                },
                "source_alexa_rank_CR_l": {
                    "type": "long"
                },
                "source_alexa_rank_CU_l": {
                    "type": "long"
                },
                "source_alexa_rank_CV_l": {
                    "type": "long"
                },
                "source_alexa_rank_CY_l": {
                    "type": "long"
                },
                "source_alexa_rank_CZ_l": {
                    "type": "long"
                },
                "source_alexa_rank_DE_l": {
                    "type": "long"
                },
                "source_alexa_rank_DJ_l": {
                    "type": "long"
                },
                "source_alexa_rank_DK_l": {
                    "type": "long"
                },
                "source_alexa_rank_DO_l": {
                    "type": "long"
                },
                "source_alexa_rank_DZ_l": {
                    "type": "long"
                },
                "source_alexa_rank_EC_l": {
                    "type": "long"
                },
                "source_alexa_rank_EE_l": {
                    "type": "long"
                },
                "source_alexa_rank_EG_l": {
                    "type": "long"
                },
                "source_alexa_rank_ES_l": {
                    "type": "long"
                },
                "source_alexa_rank_ET_l": {
                    "type": "long"
                },
                "source_alexa_rank_FI_l": {
                    "type": "long"
                },
                "source_alexa_rank_FJ_l": {
                    "type": "long"
                },
                "source_alexa_rank_FM_l": {
                    "type": "long"
                },
                "source_alexa_rank_FO_l": {
                    "type": "long"
                },
                "source_alexa_rank_FR_l": {
                    "type": "long"
                },
                "source_alexa_rank_GA_l": {
                    "type": "long"
                },
                "source_alexa_rank_GB_l": {
                    "type": "long"
                },
                "source_alexa_rank_GE_l": {
                    "type": "long"
                },
                "source_alexa_rank_GF_l": {
                    "type": "long"
                },
                "source_alexa_rank_GH_l": {
                    "type": "long"
                },
                "source_alexa_rank_GI_l": {
                    "type": "long"
                },
                "source_alexa_rank_GL_l": {
                    "type": "long"
                },
                "source_alexa_rank_GM_l": {
                    "type": "long"
                },
                "source_alexa_rank_GN_l": {
                    "type": "long"
                },
                "source_alexa_rank_GP_l": {
                    "type": "long"
                },
                "source_alexa_rank_GQ_l": {
                    "type": "long"
                },
                "source_alexa_rank_GR_l": {
                    "type": "long"
                },
                "source_alexa_rank_GT_l": {
                    "type": "long"
                },
                "source_alexa_rank_GU_l": {
                    "type": "long"
                },
                "source_alexa_rank_GW_l": {
                    "type": "long"
                },
                "source_alexa_rank_GY_l": {
                    "type": "long"
                },
                "source_alexa_rank_HK_l": {
                    "type": "long"
                },
                "source_alexa_rank_HN_l": {
                    "type": "long"
                },
                "source_alexa_rank_HR_l": {
                    "type": "long"
                },
                "source_alexa_rank_HT_l": {
                    "type": "long"
                },
                "source_alexa_rank_HU_l": {
                    "type": "long"
                },
                "source_alexa_rank_ID_l": {
                    "type": "long"
                },
                "source_alexa_rank_IE_l": {
                    "type": "long"
                },
                "source_alexa_rank_IL_l": {
                    "type": "long"
                },
                "source_alexa_rank_IN_l": {
                    "type": "long"
                },
                "source_alexa_rank_IQ_l": {
                    "type": "long"
                },
                "source_alexa_rank_IR_l": {
                    "type": "long"
                },
                "source_alexa_rank_IS_l": {
                    "type": "long"
                },
                "source_alexa_rank_IT_l": {
                    "type": "long"
                },
                "source_alexa_rank_JE_l": {
                    "type": "long"
                },
                "source_alexa_rank_JM_l": {
                    "type": "long"
                },
                "source_alexa_rank_JO_l": {
                    "type": "long"
                },
                "source_alexa_rank_JP_l": {
                    "type": "long"
                },
                "source_alexa_rank_KE_l": {
                    "type": "long"
                },
                "source_alexa_rank_KG_l": {
                    "type": "long"
                },
                "source_alexa_rank_KH_l": {
                    "type": "long"
                },
                "source_alexa_rank_KM_l": {
                    "type": "long"
                },
                "source_alexa_rank_KN_l": {
                    "type": "long"
                },
                "source_alexa_rank_KR_l": {
                    "type": "long"
                },
                "source_alexa_rank_KW_l": {
                    "type": "long"
                },
                "source_alexa_rank_KY_l": {
                    "type": "long"
                },
                "source_alexa_rank_KZ_l": {
                    "type": "long"
                },
                "source_alexa_rank_LA_l": {
                    "type": "long"
                },
                "source_alexa_rank_LB_l": {
                    "type": "long"
                },
                "source_alexa_rank_LC_l": {
                    "type": "long"
                },
                "source_alexa_rank_LI_l": {
                    "type": "long"
                },
                "source_alexa_rank_LK_l": {
                    "type": "long"
                },
                "source_alexa_rank_LR_l": {
                    "type": "long"
                },
                "source_alexa_rank_LS_l": {
                    "type": "long"
                },
                "source_alexa_rank_LT_l": {
                    "type": "long"
                },
                "source_alexa_rank_LU_l": {
                    "type": "long"
                },
                "source_alexa_rank_LV_l": {
                    "type": "long"
                },
                "source_alexa_rank_LY_l": {
                    "type": "long"
                },
                "source_alexa_rank_MA_l": {
                    "type": "long"
                },
                "source_alexa_rank_MC_l": {
                    "type": "long"
                },
                "source_alexa_rank_MD_l": {
                    "type": "long"
                },
                "source_alexa_rank_ME_l": {
                    "type": "long"
                },
                "source_alexa_rank_MG_l": {
                    "type": "long"
                },
                "source_alexa_rank_MK_l": {
                    "type": "long"
                },
                "source_alexa_rank_ML_l": {
                    "type": "long"
                },
                "source_alexa_rank_MM_l": {
                    "type": "long"
                },
                "source_alexa_rank_MN_l": {
                    "type": "long"
                },
                "source_alexa_rank_MO_l": {
                    "type": "long"
                },
                "source_alexa_rank_MP_l": {
                    "type": "long"
                },
                "source_alexa_rank_MQ_l": {
                    "type": "long"
                },
                "source_alexa_rank_MR_l": {
                    "type": "long"
                },
                "source_alexa_rank_MT_l": {
                    "type": "long"
                },
                "source_alexa_rank_MU_l": {
                    "type": "long"
                },
                "source_alexa_rank_MV_l": {
                    "type": "long"
                },
                "source_alexa_rank_MW_l": {
                    "type": "long"
                },
                "source_alexa_rank_MX_l": {
                    "type": "long"
                },
                "source_alexa_rank_MY_l": {
                    "type": "long"
                },
                "source_alexa_rank_MZ_l": {
                    "type": "long"
                },
                "source_alexa_rank_NA_l": {
                    "type": "long"
                },
                "source_alexa_rank_NC_l": {
                    "type": "long"
                },
                "source_alexa_rank_NE_l": {
                    "type": "long"
                },
                "source_alexa_rank_NG_l": {
                    "type": "long"
                },
                "source_alexa_rank_NI_l": {
                    "type": "long"
                },
                "source_alexa_rank_NL_l": {
                    "type": "long"
                },
                "source_alexa_rank_NO_l": {
                    "type": "long"
                },
                "source_alexa_rank_NP_l": {
                    "type": "long"
                },
                "source_alexa_rank_NZ_l": {
                    "type": "long"
                },
                "source_alexa_rank_OM_l": {
                    "type": "long"
                },
                "source_alexa_rank_PA_l": {
                    "type": "long"
                },
                "source_alexa_rank_PE_l": {
                    "type": "long"
                },
                "source_alexa_rank_PF_l": {
                    "type": "long"
                },
                "source_alexa_rank_PG_l": {
                    "type": "long"
                },
                "source_alexa_rank_PH_l": {
                    "type": "long"
                },
                "source_alexa_rank_PK_l": {
                    "type": "long"
                },
                "source_alexa_rank_PL_l": {
                    "type": "long"
                },
                "source_alexa_rank_PR_l": {
                    "type": "long"
                },
                "source_alexa_rank_PS_l": {
                    "type": "long"
                },
                "source_alexa_rank_PT_l": {
                    "type": "long"
                },
                "source_alexa_rank_PY_l": {
                    "type": "long"
                },
                "source_alexa_rank_QA_l": {
                    "type": "long"
                },
                "source_alexa_rank_RE_l": {
                    "type": "long"
                },
                "source_alexa_rank_RO_l": {
                    "type": "long"
                },
                "source_alexa_rank_RS_l": {
                    "type": "long"
                },
                "source_alexa_rank_RU_l": {
                    "type": "long"
                },
                "source_alexa_rank_RW_l": {
                    "type": "long"
                },
                "source_alexa_rank_SA_l": {
                    "type": "long"
                },
                "source_alexa_rank_SB_l": {
                    "type": "long"
                },
                "source_alexa_rank_SC_l": {
                    "type": "long"
                },
                "source_alexa_rank_SD_l": {
                    "type": "long"
                },
                "source_alexa_rank_SE_l": {
                    "type": "long"
                },
                "source_alexa_rank_SG_l": {
                    "type": "long"
                },
                "source_alexa_rank_SI_l": {
                    "type": "long"
                },
                "source_alexa_rank_SK_l": {
                    "type": "long"
                },
                "source_alexa_rank_SL_l": {
                    "type": "long"
                },
                "source_alexa_rank_SN_l": {
                    "type": "long"
                },
                "source_alexa_rank_SO_l": {
                    "type": "long"
                },
                "source_alexa_rank_SV_l": {
                    "type": "long"
                },
                "source_alexa_rank_SY_l": {
                    "type": "long"
                },
                "source_alexa_rank_SZ_l": {
                    "type": "long"
                },
                "source_alexa_rank_TD_l": {
                    "type": "long"
                },
                "source_alexa_rank_TG_l": {
                    "type": "long"
                },
                "source_alexa_rank_TH_l": {
                    "type": "long"
                },
                "source_alexa_rank_TJ_l": {
                    "type": "long"
                },
                "source_alexa_rank_TL_l": {
                    "type": "long"
                },
                "source_alexa_rank_TM_l": {
                    "type": "long"
                },
                "source_alexa_rank_TN_l": {
                    "type": "long"
                },
                "source_alexa_rank_TO_l": {
                    "type": "long"
                },
                "source_alexa_rank_TR_l": {
                    "type": "long"
                },
                "source_alexa_rank_TT_l": {
                    "type": "long"
                },
                "source_alexa_rank_TW_l": {
                    "type": "long"
                },
                "source_alexa_rank_TZ_l": {
                    "type": "long"
                },
                "source_alexa_rank_UA_l": {
                    "type": "long"
                },
                "source_alexa_rank_UG_l": {
                    "type": "long"
                },
                "source_alexa_rank_US_l": {
                    "type": "long"
                },
                "source_alexa_rank_UY_l": {
                    "type": "long"
                },
                "source_alexa_rank_UZ_l": {
                    "type": "long"
                },
                "source_alexa_rank_VE_l": {
                    "type": "long"
                },
                "source_alexa_rank_VI_l": {
                    "type": "long"
                },
                "source_alexa_rank_VN_l": {
                    "type": "long"
                },
                "source_alexa_rank_VU_l": {
                    "type": "long"
                },
                "source_alexa_rank_YE_l": {
                    "type": "long"
                },
                "source_alexa_rank_YT_l": {
                    "type": "long"
                },
                "source_alexa_rank_ZA_l": {
                    "type": "long"
                },
                "source_alexa_rank_ZM_l": {
                    "type": "long"
                },
                "source_alexa_rank_ZW_l": {
                    "type": "long"
                },
                "source_alexa_rank_l": {
                    "type": "long"
                },
                "source_domain_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "source_enabled": {
                    "type": "boolean"
                },
                "source_group_query_min_characters_length_i": {
                    "type": "integer"
                },
                "source_id": {
                    "type": "keyword"
                },
                "source_locations_city_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "source_locations_country_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "source_locations_state_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "source_name_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "source_scopes_city_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "source_scopes_country_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "source_scopes_level_i": {
                    "type": "integer"
                },
                "source_scopes_state_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "source_url_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "title_entities_dbpedia_links_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "title_entities_tk": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    }
                },
                "title_entities_types_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "title_sentiment_polarity_byt": {
                    "type": "byte"
                },
                "title_t_id": {
                    "type": "text",
                    "analyzer": "indonesian"
                },
                "title_t_special_id": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "indonesian"
                },
                "title_tk": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    }
                },
                "title_tk_ar": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "arabic"
                },
                "title_tk_da": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "danish"
                },
                "title_tk_de": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "german"
                },
                "title_tk_en": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "en_general"
                },
                "title_tk_es": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "spanish"
                },
                "title_tk_fi": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "finnish"
                },
                "title_tk_fr": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "french"
                },
                "title_tk_it": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "italian"
                },
                "title_tk_nl": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "dutch"
                },
                "title_tk_pt": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "portuguese"
                },
                "title_tk_ru": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "russian"
                },
                "title_tk_special_ar": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "arabic"
                },
                "title_tk_special_da": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "danish"
                },
                "title_tk_special_de": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "german"
                },
                "title_tk_special_en": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "en_special"
                },
                "title_tk_special_es": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "spanish"
                },
                "title_tk_special_fi": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "finnish"
                },
                "title_tk_special_fr": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "french"
                },
                "title_tk_special_it": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "italian"
                },
                "title_tk_special_nl": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "dutch"
                },
                "title_tk_special_pt": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "portuguese"
                },
                "title_tk_special_ru": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "russian"
                },
                "title_tk_special_sv": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "swedish"
                },
                "title_tk_special_tr": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "turkish"
                },
                "title_tk_special_zh-cn": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "smartcn"
                },
                "title_tk_special_zh-tw": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "smartcn"
                },
                "title_tk_sv": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "swedish"
                },
                "title_tk_tr": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "turkish"
                },
                "title_tk_zh-cn": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "smartcn"
                },
                "title_tk_zh-tw": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "smartcn"
                },
                "title_translated_tk_en": {
                    "type": "text",
                    "fields": {
                        "keyword": {
                            "type": "keyword",
                            "ignore_above": 8100
                        }
                    },
                    "analyzer": "en_general"
                },
                "url_k": {
                    "type": "keyword",
                    "ignore_above": 8100
                },
                "videos_count_l": {
                    "type": "long"
                },
                "words_count_l": {
                    "type": "long"
                }
            }
        }
    },
...

Query String:

"query_string": {
   "fields": [
                      "title_tk",
                      "body_t"
               ],
  "query": "(\"Hair Connections\" OR \"Hair Connections\") AND (\"1234 1ST AVE N\"^6 OR \"FORT DODGE\"^4 OR \"Webster\"^2)"
}

This returns no results because there is no matches on the right side of the AND.

And the same version using the simple simple_query_string:

  {
                    "simple_query_string": {
                        "fields": [
                            "title_tk",
                            "body_t"
                        ],
                        "query": "(\"Hair Connections\" | \"Hair Connections\") + (\"1234 1ST AVE N\"^6 | \"FORT DODGE\"^4 | \"Webster\"^2)"
                    }
                }

Expected results: No results Actual results: several results that matches the left side of the query.

NOTE: Setting minimum_should_match to 1 seems to solve this problem. Maybe the issue is that is set to zero. I'm not sure about the relation between minimum_should_match and minimum_should_match but setting this to one solves the issue for both type of queries but I do not know the implications and it looks more like a work around. Could you check why the simple_query_string returns different data and clarify the relation to minimum_should_match? thank you very much!

Provide logs (if relevant):

Validate API Response:

{
    "_shards": {
        "total": 13,
        "successful": 13,
        "failed": 0
    },
    "valid": true,
    "explanations": [
        {
            "index": "live_articles_2019.04",
            "valid": true,
            "explanation": "+(+((title_tk:\"hair connections\" | body_t:\"hair connections\") (title_tk:\"hair connections\" | body_t:\"hair connections\")) +((title_tk:\"1234 1st ave n\" | body_t:\"1234 1st ave n\") (title_tk:6 | body_t:6)~1.0 (title_tk:\"fort dodge\" | body_t:\"fort dodge\") (title_tk:4 | body_t:4)~1.0 (title_tk:webster | body_t:webster) (title_tk:2 | body_t:2)~1.0)) #namespaces_k:public"
        },
...
elasticmachine commented 4 years ago

Pinging @elastic/es-search (:Search/Search)

matriv commented 4 years ago

@javiramos1

Could you please use the validate query API to check your query? maybe use the ?explain=true as well.

javiramos1 commented 4 years ago

@javiramos1

Could you please use the validate query API to check your query? maybe use the ?explain=true as well.

I added the response in the description

matriv commented 4 years ago

Why do you use it twice: (\"Hair Connections\" | \"Hair Connections\") ?

javiramos1 commented 4 years ago

Why do you use it twice: (\"Hair Connections\" | \"Hair Connections\") ?

This is from an user, so no idea why they did that but without it we have the same issue.

matriv commented 4 years ago

Another thing is that for the simple query string query the boost is only supported per field unlike the more complicated things you can do with boost in query string query.:

Boosts can also be applied to phrases or to groups:

"john smith"^2   (foo bar)^4
matriv commented 4 years ago

@javiramos1

Thank you very much for your interest in Elasticsearch, but as this appears to be a user question, we'd like to direct you to the forums. for further discussion. If you can stop by there, we'd appreciate it. This allows us to use GitHub for verified bug reports, feature requests, and pull requests.

There's an active community in the forums that should be able to help get an answer to your question. As such, I hope you don't mind that I close this.