rwynn / monstache

a go daemon that syncs MongoDB to Elasticsearch in realtime. you know, for search.
https://rwynn.github.io/monstache-site/
MIT License
1.28k stars 180 forks source link

monstache docker container is indexing all the collections instead of what's in toml #407

Open yunivrsl opened 4 years ago

yunivrsl commented 4 years ago

Describe the bug I have a docker-compose.yml that mounts the local volume of config.toml, which only has certain collections to index, but, monstache is indexing every collection with docs.

To Reproduce

docker-compose.yml: version: '3' monstache: restart: always image: rwynn/monstache:latest command: -f ./monstache.config.toml & volumes:

Monstache configuration:

mongourl = "mongodb://ip-address/?replicaset=rs
elasticsearch-urls=["http://ip-address:9200"]

direct-read-namespaces = ["dev.users", "dev.address"]
change-stream-namespaces = ["dev.users", "dev.address"]

Steps to reproduce the behavior:

Expected behavior monstache should only index "users" and "address" collection

Software information (please complete the following information):

Additional context Add any other context about the problem here.

Screenshots If applicable, add screenshots to help explain your problem.

yunivrsl commented 4 years ago

got into monstache docker and found the version: 4.9.0

rwynn commented 4 years ago

This is likely a docker configuration issue. Can you please check your config against the one here? https://github.com/rwynn/monstache-showcase/blob/a25cddeedc9e8f1481aa7de19cd634158792b28c/docker-compose.sc.yml#L53

rwynn commented 4 years ago

Also, please try docker pull rwynn/monstache:6.6.0 and use that. It should be the current latest image.

yunivrsl commented 4 years ago

Unfortunately, i have different docker-compose.yml for monstache, elasticsearch, and mongodb. these are all run separately.

can I build my own docker image from the source?

rwynn commented 4 years ago

Yes, you can. For example, after switching to rel6 branch run build.sh from within docker/release. https://github.com/rwynn/monstache/tree/rel6/docker/release