Separate the weaviate and DAGS for dev to prod account

[sunank200]

• [x] Separate the prod and dev for ingestion and feedback DAGs.
• [x] Work on running ingestion and feedback DAGs with weaviate in dev.
• [x] Change the credentials in prod and dev for cloud build accordingly.
• [x] Migrate older prod to new weaviate account. Make older dev as dev database and new account as prod database

[pankajastro]

Separate the prod and dev for ingestion and feedback DAGs.

Are we going to keep this dag in the same astro instance?

Migrate older prod to new weaviate account. Make older dev as dev database and new account as prod database

I login to https://console.weaviate.cloud/dashboard we already have a cluster so do need a new cluster for prod or we will use the same but a different database?

@sunank200 we need to discuss these points

[sunank200]

We already have two separate deployments DAGs for prod and dev: https://cloud.astronomer.io/clmkpupdk000401lpj28teo2t/deployments

There are two clusters for prod and dev already for weaviate. I have DMed you the creds.

[pankajastro]

We have created 2 deployment ask-astro-prod-phase-2 and ask-astro-dev-phase-2 (we will rename it later). Created 2 weaviate schemas DocsDev and DocsProd and ingested data in them and tested with slack bot

[sunank200]

The URLs for the deployment can be found in connection details in the following deployments: We already have two separate deployments DAGs for prod and dev: https://cloud.astronomer.io/clmkpupdk000401lpj28teo2t/deployments

[sunank200]

@pankajastro we need to add a schedule to run the prod DAGs on daily basis. For dev it can be manual run.

[sunank200]

We should run the ask-astro-load DAG without slack ingestion.