Changes in MongoDB are sometimes slow to reflect.

[lineaheshsh]

Hi rwynn.

Changes in MongoDB are sometimes slow to reflect?

For example, data came into MongoDB at 9:00, but was reflected in Elasticsearch at 11:00.

At that time, there were about 1 million data changes.

mongo-url = "mongodb://user:passwd@ip:port/database?authSource=admin"

elasticsearch-urls = ["http://ip:port","http://ip:port","http://ip:port"]
elasticsearch-max-conns = 4
elasticsearch-max-seconds = 5
elasticsearch-max-bytes = 8000000

namespace-regex = '^database\.'
change-stream-namespaces = ["database.A", "database.B", "database.C"]
direct-read-namespaces = ["database.A", "database.B", "database.C"]

dropped-collections = false
dropped-databases = false

gzip = true
verbose = true
resume = true
resume-name = "t_prd"
resume-strategy = 0
resume-from-timestamp = 0
mapper-plugin-path = "/bin/plugin.so"

[[mapping]]
namespace = "database.A"
index = "A"

[[mapping]]
namespace = "database.B"
index = "B"

[[mapping]]
namespace = "database.C"
index = "C"

[giangnth]

can you share some additional info on this?

CPU, IO on MongoDB and ElasticSearch?