Is there any support for Data persistence？

[pengxiao-song]

Hey! We are the team of LaWGPT, and your work is so wonderful!

Now, We have a demand that LaWGPT needs persistent storage of user question-and-answer data (data collection) for iterative project updates. So is there any support to cope with this problem?

Thank you very much!

[deepankarm]

@pengxiao-song glad to see you here.

persistent storage of user question-and-answer data (data collection) for iterative project updates Jina AI Cloud has support for persistent data storage. Few questions

• What kind of data format do you use?
• What data size do you expect?
• Any latency expectations from the data in/out operations?

[pengxiao-song]

@pengxiao-song glad to see you here.

persistent storage of user question-and-answer data (data collection) for iterative project updates Jina AI Cloud has support for persistent data storage. Few questions

• What kind of data format do you use?
• What data size do you expect?
• Any latency expectations from the data in/out operations?

Thank you for your reply~

• Data Format: Mostly, string type
• Data Size: There is no precise estimate at the moment. For the initial stages of the project, 1G should be sufficient.
• Sorry, I am confused of "latency expectations".

[deepankarm]

Alright. Though Jina AI Cloud supports persistent storage, right now it is not exposed via langchain-serve. I'll work on this and let you know once released.

[pengxiao-song]

Alright. Though Jina AI Cloud supports persistent storage, right now it is not exposed via langchain-serve. I'll work on this and let you know once released.

Thanks, very expected to your nice work!

[deepankarm]

@pengxiao-song persistent disk is now supported with the new release 0.0.36. You can find the usage in the readme.

[pengxiao-song]

@pengxiao-song persistent disk is now supported with the new release 0.0.36. You can find the usage in the readme.

Nice work! I will take a look carefully later. Thanks!