search

teremterem / swipe-thought-bot

MIT License
0 stars 0 forks source link

DO NOT maintain long dialog contexts in SwiperChatData and in ES index unless you are using them? #84

Closed teremterem closed 3 years ago

teremterem commented 3 years ago

If we need to, we can restore context of any length from our recorded history of updates. We better stop eating up S3 space for something that is restorable if absolutely needed (and there is no certainty that it will be needed in the form we are currently recording it in).

teremterem commented 3 years ago

Alternatively, you can just delete everything that does not end with .update.json when S3 space becomes costly.

teremterem commented 3 years ago

At the very least you should stop flooding ES index with unnecessary pieces of context.