search

bblockwood / lab

Repository for collecting and documenting work done by research assistants.
0 stars 0 forks source link

Add wiki page describing use of Wharton cluster #9

Closed bblockwood closed 3 years ago

bblockwood commented 3 years ago

Goal: post a page to the wiki on this repo describing how to get an account and run projects on the Wharton computing grid — particularly matlab scripts in parallel.

afras-sial commented 3 years ago

@bblockwood I've added the page here. Please feel free to make any changes or let me know if there's anything that's unclear or missing.

bblockwood commented 3 years ago

@afras-sial this is fantastic, thanks for writing it up! This looks sufficient — I'll give it a try myself, and will re-open if there are any further requests on this.

afras-sial commented 3 years ago

@bblockwood Just wanted to note that I've only used it on Windows, so the instructions are a bit Windows-centric (though I've tried to distinguish between how things on done on Windows vs. a Mac). My impression is that running things on a Mac is more straightforward, but let me know if you run into any issues while doing so.

bblockwood commented 3 years ago

@afras-sial this wiki page is super useful! I was able to get set up with the hpcc no problem this way.

One thing I think would be helpful is to have a section here on how to use git+github to sync a project directory to your home folder on the HPCC, so that we don't have to manually copy over program files and job scripts. I see that git is installed on the HPCC, so I think this is just a question of finding the right settings for git clone to set up the repo. As time allows, could you add a section on this to the wiki page? (Incidentally, the notch plots project is a good test case for making sure all works properly whether we run the code on hpcc or our own personal systems.)

Thanks!

afras-sial commented 3 years ago

@bblockwood Thanks for adding the additional Mac-related content! I've added a section about cloning a repo from GitHub. Please take a look when you have a chance. Again, I've only tried it on Windows, so it may need some Mac-specific adjustments.

bblockwood commented 3 years ago

Fantastic. The process was just the same for a mac, and your instructions were excellent.

Summary: page is created, and updated with instructions for operating with git+github.