search

aigc-apps / PAI-RAG

An easy-to-use framework for modular RAG
247 stars 36 forks source link

Remove local storage and enable Elasticsearch hybrid query mode #60

Closed moria97 closed 1 month ago

moria97 commented 1 month ago
  1. Remove unneeded local SimpleDirectoryStorage/SimpleIndexStorage for es/holo/adb/milvus
  2. Enable using keyword/embed/hybrid query mode directly with ElasticSearch
github-actions[bot] commented 1 month ago

☂️ Python Coverage

current status: ✅

Overall Coverage

Lines Covered Coverage Threshold Status
3031 1815 60% 50% 🟢

New Files

File Coverage Status
src/pai_rag/modules/cache/oss_cache.py 93% 🟢
src/pai_rag/modules/datareader/data_loader.py 100% 🟢
src/pai_rag/modules/embedding/my_huggingface_embedding.py 58% 🟢
src/pai_rag/modules/index/index_utils.py 33% 🟢
src/pai_rag/modules/index/my_vector_store_index.py 78% 🟢
src/pai_rag/modules/retriever/my_elasticsearch_store.py 33% 🟢
src/pai_rag/utils/tokenizer.py 100% 🟢
TOTAL 71% 🟢

Modified Files

File Coverage Status
src/pai_rag/app/api/models.py 100% 🟢
src/pai_rag/core/rag_application.py 93% 🟢
src/pai_rag/data/rag_dataloader.py 66% 🟢
src/pai_rag/evaluations/batch_evaluator.py 79% 🟢
src/pai_rag/evaluations/dataset_generation/generate_dataset.py 77% 🟢
src/pai_rag/modules/init.py 100% 🟢
src/pai_rag/modules/base/configurable_module.py 87% 🟢
src/pai_rag/modules/chat/chat_engine_factory.py 88% 🟢
src/pai_rag/modules/chat/llm_chat_engine_factory.py 88% 🟢
src/pai_rag/modules/embedding/embedding.py 74% 🟢
src/pai_rag/modules/index/index.py 86% 🟢
src/pai_rag/modules/index/store.py 60% 🟢
src/pai_rag/modules/module_registry.py 98% 🟢
src/pai_rag/modules/retriever/my_vector_index_retriever.py 78% 🟢
src/pai_rag/modules/retriever/retriever.py 66% 🟢
src/pai_rag/utils/store_utils.py 49% 🟢
TOTAL 81% 🟢

updated for commit: 68263a1 by action🐍