[discussion] Remove the old unused data.

vasanthv / jsonbox

HTTP-based JSON storage.

https://jsonbox.io

MIT License

2.49k stars 173 forks source link

[discussion] Remove the old unused data. #62

Closed vasanthv closed 3 years ago

vasanthv commented 4 years ago

The current number of records in Jsonbox is 218058 and its keep growing. I know this day will come that we might need to cut down the records. So I have plan for that and I need suggestions from people to find the best possible way to cut down the number of records, so that people can keep use it for free.

My suggestion: Introduce lastAccessedDate for boxes (could be GET, POST or PUT). So when this date is more than 6 months (could be 3 months also) we delete them.

harlev commented 4 years ago

If you want to be careful, you could first just add the lastAccessedDate field. Then wait a while to see what are the usage patterns. If, for example, many records are written and then never accessed again, it would be an easy decision to delete those after 3 months

vasanthv commented 4 years ago

If you want to be careful, you could first just add the lastAccessedDate field. Then wait a while to see what are the usage patterns. If, for example, many records are written and then never accessed again, it would be an easy decision to delete those after 3 months

Yes I perfectly agree and thats the way I want to proceed.

bvenkysubbu commented 4 years ago

Many may use this service for quick testing and hence the data might only be required temporarily. My suggestion would be to have a default auto-delete in 48 hours feature, which can be disabled if the user wants it for more than 2 days.
Every time, a user opens https://jsonbox.io/, a box is created. That means a box is created even when a casual visitor comes to check the website out. This can be avoided by having a "create json box" button.
Many boxes may have empty data - e.g. https://jsonbox.io/box_d3b20d9deba976587eee. These can be deleted as well.

vasanthv commented 4 years ago

@bvenkysubbu thanks for your reply.

I like the idea of auto-delete. But 48 hours seems too little time.
There is no box creation step in jsonbox. We just show a random generated id each time the user visits.
Also, the box will be created only when you first push your data to a box, so there is no concept of empty boxes as well.

siair commented 4 years ago

Can it be increased to 3 months? 1 month is a little short