chroma-core / chroma

the AI-native open-source embedding database
https://www.trychroma.com/
Apache License 2.0
14.58k stars 1.21k forks source link

Doubts on ChromaDB client_settings #2730

Closed Darrshan-Sankar closed 2 days ago

Darrshan-Sankar commented 3 weeks ago

I tried to implement the persistent client using Langchain with duckdb+parquet as the format, but faced deprecated error. Is really duckdb+parquet format removed? If so why. (PS: Suggest to enable discussion tab in the repository in addition to discord)

tazarov commented 3 weeks ago

@Darrshan-Sankar, duckdb+parquet has been deprecated and removed since 0.4.0 and it is unlikely to returned. Currently, Chroma relies on sqlite3 for metadata storage.

Darrshan-Sankar commented 3 weeks ago

@Darrshan-Sankar, duckdb+parquet has been deprecated and removed since 0.4.0 and it is unlikely to returned. Currently, Chroma relies on sqlite3 for metadata storage.

@tazarov Thanks for your clarification. Any room for PR: 'https://github.com/chroma-core/chroma/pull/2694' ?

ansheshwar commented 1 week ago

@Darrshan-Sankar, duckdb+parquet has been deprecated and removed since 0.4.0 and it is unlikely to returned. Currently, Chroma relies on sqlite3 for metadata storage.

@tazarov But , if i want to store in no-sql format instead of sql then how will it can be done?

tazarov commented 6 days ago

@Darrshan-Sankar, unfortunately single-node Chroma has only sqlite3 impl for metadata and system database. Adding support for other storage engines is not currently on the roadmap.

Regarding #2694, let me look into it.

jeffchuber commented 2 days ago

closing this as the question was resolved