opensearch-project / demos

Apache License 2.0
2 stars 13 forks source link

Mm ingestion #60

Closed mekaeelahmad closed 11 months ago

mekaeelahmad commented 11 months ago

Updated PR for cluster bootstrapping by switching branch

Description Utilized David's framework for cluster bootstrapping.

Issues Resolved This PR implements cluster bootstrapping using David's framework. It provides functionalities to initialize cluster settings, model groups, connectors, models, ingestion pipelines, and indices.

Enables specific OpenSearch cluster settings. Registers a model group, connector, and a neural model from Cohere. Sets up an ingestion pipeline for neural embeddings. Initializes a dedicated index for storing neural embeddings. We still need to wait on client.ml_connectors functionality in order to easily initialize a connector! By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check here.