Closed marcosma1 closed 2 years ago
Hi @marcosma1. I think that the problem is that your query needs to be a string rather than a dict. Try calling str
on body2
before putting it in es_read_conf
.
Also, you might try https://discuss.elastic.co/ -- it tends to be a better resource for getting answers to questions.
When I rewrite the body 2 to str:
body2=str({"query": {"bool": {"must": [{"range": {"@timestamp": {"lte": "2022-06-28T09:25:15.000-03:00","gte": "2022-06-27T09:25:15.000-03:00"}}},{"match": {"type.keyword": "TABLA1"}},{"match": {"HOSTNAME.keyword": "EQUIPO1"}}]}},"size":10})
I get the next error:
Traceback (most recent call last):
File "
It looks like you don't have the elasticsearch-spark jar in your pyspark classpath. Are you doing something like
pyspark --master yarn --deploy-mode client --jars /home/elastic/elasticsearch-spark-30_2.12-8.1.0.jar"
The actuall elasticsearch-spark jar depends on which versions of spark and scala you have.
I tied to get data from elesticsearch but I have an error
The code: