schwilklab / skyisland-climate

Climate data and code for Sky Island project
2 stars 2 forks source link

Large results files commited and pushed TODO: fix #21

Closed dschwilk closed 7 years ago

dschwilk commented 8 years ago

Some very large images were committed and pushed to the repo.

See https://github.com/schwilklab/skyisland-climate/commit/580ea03c6d83964a92a7ec0b3e08b33a09b03740

and https://github.com/schwilklab/skyisland-climate/commit/c58fb63d639771807575ca34e8ff9e1daa479eab

These will need to be removed using git filter-branch or the bfg tool. This is a pretty big undertaking and will require a forced push afterwards and everyone who uses the repo must reclone after that. I'll deal with this eventually and send out emails to all users with instructions.

Please, as a rule of thumb, simply never commit image files. There are exceptions, but unless you are sure it is a good idea, simply never commit images. And, in general, think hard before committing anything over a couple of MB in size. We do have some large data in this repo, so things like our ascii grids are perfectly reasonable in version control. But we need to 1) keep vc useful which means not committing anything that can be created from data and code and 2) keeping the repo manageable for for students working on this sometimes over a slow satellite internet connection.

hpoulos commented 8 years ago

Got it Dylan. I was having trouble sending them to you via email and I knew you needed them for the presentation which is why I went that route. I'll use Dropbox or box next time.

On Oct 17, 2015, at 10:14 AM, Dylan Schwilk notifications@github.com wrote:

Some very large images were committed and pushed to the repo.

See 580ea03

and c58fb63

These will need to be removed using git filter-branch or the bfg tool. This is a pretty big undertaking and will require a forced push afterwards and everyone who uses the repo must reclone after that. I'll deal with this eventually and send out emails to all users with instructions.

Please, as a rule of thumb, simply never commit image files. There are exceptions, but unless you are sure it is a good idea, simply never commit images. And, in general, think hard before committing anything over a couple of MB in size. We do have some large data in this repo, so things like our ascii grids are perfectly reasonable in version control. But we need to 1) keep vc useful which means not committing anything that can be created from data and code and 2) keeping the repo manageable for for students working on this sometimes over a slow satellite internet connection.

— Reply to this email directly or view it on GitHub.

dschwilk commented 8 years ago

No worries,

Yes, I'd rather have them than not!

On 10/18/2015 10:10 AM, hpoulos wrote:

Got it Dylan. I was having trouble sending them to you via email and I knew you needed them for the presentation which is why I went that route. I'll use Dropbox or box next time.

On Oct 17, 2015, at 10:14 AM, Dylan Schwilk notifications@github.com wrote:

Some very large images were committed and pushed to the repo.

See 580ea03

and c58fb63

These will need to be removed using git filter-branch or the bfg tool. This is a pretty big undertaking and will require a forced push afterwards and everyone who uses the repo must reclone after that. I'll deal with this eventually and send out emails to all users with instructions.

Please, as a rule of thumb, simply never commit image files. There are exceptions, but unless you are sure it is a good idea, simply never commit images. And, in general, think hard before committing anything over a couple of MB in size. We do have some large data in this repo, so things like our ascii grids are perfectly reasonable in version control. But we need to 1) keep vc useful which means not committing anything that can be created from data and code and 2) keeping the repo manageable for for students working on this sometimes over a slow satellite internet connection.

— Reply to this email directly or view it on GitHub.

— Reply to this email directly or view it on GitHub https://github.com/schwilklab/skyisland-climate/issues/21#issuecomment-149023955.

dschwilk commented 7 years ago

Closing. I never filtered these, but overall size is still manageable and I hate to require a force pull from everyone.