2023-11: Site Migration

Malshare / MalShare

http://www.malshare.com

22 stars 4 forks source link

2023-11: Site Migration #77

Closed silascutler closed 9 months ago

silascutler commented 10 months ago

Disk issues have taken down the site again. Working on migration and rebuild

silascutler commented 10 months ago

After the rebuild in #19 , we've been primarily on a dedicated server at Hetzner. Long term, we're going to keep burning through servers. The structure of the site needs a re-architecture. We've tested parts of this before #42, however, it's time to move to a proper object store for samples.

Active tasks:

[x] Backups underway (@larsborn, self, and long term s3 storage)
[x] S3 option evaluation
[ ] New server build

Pending

[ ] Migrate Frontend to use object storage

silascutler commented 10 months ago

Storage server's crashed a few times as data is being moved. It's a slow process, but we're moving along with migration

silascutler commented 10 months ago

Almost everything is off the old infrastructure. New systems will come online early next week

HSp4m commented 9 months ago

Sorry if I'm doing something wrong, but what happened?

silascutler commented 9 months ago

Site's back online

silascutler commented 9 months ago

Sorry if I'm doing something wrong, but what happened?

Server at Hetzner started to have disk issues. We'd been working to keep it online, but with how we've grown, some key architectural changes were needed (like moving the sample collection to s3)