Configure opensearch to evenly distribute documents on nodes

NASA-PDS / planetary-data-cloud

PDS Cloud Migration documentation, issue, tracking and simple tools for assisting in the PDS hybrid cloud study and migration efforts.

Apache License 2.0

0 stars 0 forks source link

Configure opensearch to evenly distribute documents on nodes #54

Closed tloubrieu-jpl closed 1 year ago

tloubrieu-jpl commented 1 year ago

💡 Description

Following Dan Scholes issues with space on the GEO node, we noticed that the documents are all on one of the 3 nodes and the 2 others are empty.

Something need to be done with the shard configuration to distribute the documents evenly across the node.

Possibly the overall volume available could also be increased since Dan Scholes is expecting to load almost 90 milions documents and only 2 millions are loaded so far.

jimmie commented 1 year ago

All nodes' registry indexes have been re-indexed to utilize 3 shards. The exception is GEO which utilizes 6 w/ 300GB EBS.