search

astrofrog / robo-ph

#dotastro hack
3 stars 2 forks source link

Figure out long-term hosting #23

Open astrofrog opened 8 years ago

astrofrog commented 8 years ago

I looked into pricing details for S3, and I had forgotten that one also pays for downloads by default - in fact, this is what completely dominates the price:

screen shot 2015-11-08 at 1 56 10 pm

That cost is proportional to the number of subscribers (iTunes doesn't cache it, it would just get the podcasts from S3).

So with 100 subscribers, we'd be looking at a little less than $10/month, but that therefore means $100/year, which is a bit much.

I think it might be better to try and find an academic server at one of our institutions that can host this, provided we can upload by ftp (which the script could then do).

Apparently the Public folder for Dropbox is only available for paid accounts, so I'm not sure if that's a good long-term solution either.

We should look into https://archive.org/details/audio_podcast (instructions for uploading from command-line: http://askubuntu.com/questions/32763/script-to-upload-to-internet-archive-archive-org)

jegpeek commented 8 years ago

Hm, yeah. I mean, we could just put the whole shebang on my desktop, which we could access by (s)ftp or dropbox. Meaning we could use your codechecking service as our engine, and put it on my dropbox. Or we could just install the whole thing on my machine?

astrofrog commented 8 years ago

@jegpeek - if we can, we should try and use Travis to do the building (just because it's a clean environment and we can all access it).

Would your desktop be visible from the web? Or are you thinking we should go with Dropbox from your account?

astrofrog commented 8 years ago

For the record, instructions on uploading to archive.org: http://archive.org/help/abouts3.txt

jegpeek commented 8 years ago

I don't think so? But its dropbox is, which is what I was thinking.

https://www.dropbox.com/en/help/4204 says:

The total amount of traffic that all of your links and file requests together can generate without getting banned is about 200 GB per day. There's no daily limit to the number of downloads that your links can generate.

Which means at ~50 MB, we are talking > 2000 D/L per day -- I don't think we are going to be anywhere near close to that anytime soon.

astrofrog commented 8 years ago

Ok, so maybe we're fine with Dropbox!

jegpeek commented 8 years ago

So the plan is Travis -> ftp to my desktop's dropbox? I think we need sftp, fwiw.

jegpeek commented 8 years ago

I should probably check with folks at IT...

astrofrog commented 8 years ago

I still need to check if we can upload to Dropbox directly from command-line, in which case we can avoid going via your desktop. For now I'm not sure if Travis will work because the issue is going to be getting the optional voices downloaded on there.

astrofrog commented 8 years ago

If we're doing Dropbox, then really all we need is a Mac that has a Dropbox account and then we don't need to mess with anything else.

astrofrog commented 8 years ago

By the way, I just had another idea - a MacOS X VM running in VirtualBox on a Linux server - then it's isolated but will always be up?

astrokatie commented 8 years ago

Is there a way we can keep a static depository of old episodes somewhere?

astrofrog commented 8 years ago

@astrokatie - I think archive.org can store this kind of file. What would be ideal is if we could use it both as an archive and also where to get the latest files for iTunes.