danielchalef
commented
8 months ago Please would you try adding these environment variables to the nlp-server container environment, and not the zep server environment:
ZEP_EMBEDDINGS_MESSAGES_MODEL=all-MiniLM-L6-v2
ZEP_EMBEDDINGS_DOCUMENTS_MODEL=all-MiniLM-L6-v2
Describe the bug I set the environment variable, but from setting, seems some setting is not reflected.
To Reproduce ZEP_EMBEDDINGS_MESSAGES_MODEL=all-MiniLM-L6-v2 ZEP_EMBEDDINGS_DOCUMENTS_MODEL=all-MiniLM-L6-v2 ZEP_EXTRACTORS_MESSAGES_SUMMARIZER_ENABLED=true ZEP_EXTRACTORS_MESSAGES_ENTITIES_ENABLED=true ZEP_EXTRACTORS_MESSAGES_INTENT_ENABLED=true ZEP_EXTRACTORS_MESSAGES_EMBEDDINGS_ENABLED=true ZEP_EXTRACTORS_MESSAGES_EMBEDDINGS_DIMENSIONS=384 ZEP_EXTRACTORS_MESSAGES_EMBEDDINGS_SERVICE=local ZEP_EXTRACTORS_MESSAGES_SUMMARIZER_EMBEDDINGS_ENABLED=true ZEP_EXTRACTORS_MESSAGES_SUMMARIZER_EMBEDDINGS_DIMENSIONS=384 ZEP_EXTRACTORS_MESSAGES_SUMMARIZER_EMBEDDINGS_SERVICE=local
and I see in the webui, it's not using the local smaller model: "Extractors": { "Messages": { "Summarizer": { "Enabled": true, "Embeddings": { "Enabled": true, "Dimensions": 1536, "Service": "openai", "ChunkSize": 0 }, "Entities": { "Enabled": true } }, "Embeddings": { "Enabled": true, "Dimensions": 1536, "Service": "openai", "ChunkSize": 0 }, "Entities": { "Enabled": true }, "Intent": { "Enabled": true } },
Expected behavior should change to local model but below two config can not reflect: ZEP_EXTRACTORS_MESSAGES_EMBEDDINGS_DIMENSIONS=384 ZEP_EXTRACTORS_MESSAGES_EMBEDDINGS_SERVICE=local
Logs no logs
Environment (please complete the following information): docker compose
Note: The Zep server version is available in the Zep server logs at startup:
Starting zep server version 0.11.0-cbf4fe4 (2023-08-30T12:49:03+0000)Additional context Add any other context about the problem here.