search

chroma-core / chroma

the AI-native open-source embedding database
https://www.trychroma.com/
Apache License 2.0
14.42k stars 1.2k forks source link

[Install issue]: Help volume EFS #1609

Open eliza910115 opened 8 months ago

eliza910115 commented 8 months ago

What happened?

I am using chroma in ECS and I have the volume created in EFS. When I persist, the information is not saved in the volume, apparently it remains in the ECS. What could I be missing?

Versions

Chroma latest

Relevant log output

Where is my data stored?
tazarov commented 8 months ago

@eliza910115, how are you creating your AWS stack? Mind sharing some of the manifests that pertain to the Chroma container?

tazarov commented 7 months ago

@eliza910115, have you figured out the issue?

If your container does not have a volume mount that mounts /my/efs-storage:/chroma/chroma, then your data is likely in the container.

A note on using the EFS - this is an NFS-based file system, which might not be ideal for Chroma as some of the file operations assumptions that Chroma makes might be invalidated. One such instance is the removal of collection, which does not happen immediately on NFS drives as Chroma expects.