search

sul-dlss / web-archiving

placeholder for web archiving work
0 stars 0 forks source link

review all storage proposal options as per discussion #20

Open drh-stanford opened 7 years ago

drh-stanford commented 7 years ago

based on 12/15 discussion and the open questions

https://github.com/sul-dlss/web-archiving/wiki/Storage#a-proposal-to-extend-warc-file-storage

drh-stanford commented 7 years ago

see https://github.com/sul-dlss/web-archiving/wiki/Storage

waiting on feedback before revising first draft.

ndushay commented 7 years ago

I have split the storage proposals into a separate document, so we now have:

https://github.com/sul-dlss/web-archiving/wiki/Storage-Expansion-Proposal and https://github.com/sul-dlss/web-archiving/wiki/Storage

I also put some changes directly into the proposal wiki in lieu of feedback.

December seems long ago, and I am wondering if there might be some additional proposals

A': sort of like A, but essentially in a one-off fashion for web archiving (we try to develop resuable stuff, but let stacks be a problem for the future and separate costs)

D: some sort of lightweight app that basically indexes an indirect url to a specific volume (I guess maybe like A, but it's an app/service rather than a gem?)

drh-stanford commented 7 years ago

Pending talking with both Chris and Julian for cost estimates...

drh-stanford commented 7 years ago

Talked with Chris and integrated his feedback into the writeup. He suggested I talk with Ben too.

drh-stanford commented 7 years ago

Looking into whether we can resize our partition from 33TB to 50TB to buy us some time. See SAR-3357

drh-stanford commented 7 years ago

i'm going to take one more pass at the writeup draft before we send it out

drh-stanford commented 7 years ago

This is ready for review -- https://github.com/sul-dlss/web-archiving/wiki/Storage-Expansion-Proposal