search

astronomer / ask-astro

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
https://ask.astronomer.io/
Apache License 2.0
192 stars 47 forks source link

Rebase and update ingest DAGS #43

Closed mpgreg closed 11 months ago

mpgreg commented 11 months ago

Rebase with ci Refactored DAGs to import from includes. New version of weaviate provider had upsert and branch operator for check schema. Add cohere rerank to schema Moved env vars to .env Added openlineage data sources Fixes to enable astro deploy Added ASK_ASTRO_ENV var to enable the same code to run in all environments. Specify 'prod', 'dev', 'test', or 'local' in each astro deployment or local CLI. Added readme for setup. Added slack incremental ingest Changed to msft azure endpoint Added retries to deal with LLM rate limits.

sunank200 commented 11 months ago

The pre-commit error needs to be fixed