search

gammasim / simtools

Tools and applications for the Simulation System of the CTA Observatory.
https://gammasim.github.io/simtools
BSD 3-Clause "New" or "Revised" License
10 stars 1 forks source link

gamma-sim tools repository is unnecessary large - remove obsolete old files in history #464

Open GernotMaier opened 1 year ago

GernotMaier commented 1 year ago

The gammasim-tools repositories carries around historical ballast and is quite large to checkout. There is absolutely no reason why this repo should be >150 MByte large.

This is mostly due to a couple of files, as shown by git-filter-repo --analyze:

 5df94c5349b9d6b292633be50880946da3785d6a   38913302   14386746 CTAMCFiles/RayTracing/photons-LST-d10.0-za20.0-off2.000_test-lst.lis
  8f01038ca3c4f6ca72b87bb8a7eb611f59419de8   38590673   14354094 CTAMCFiles/RayTracing/photons-LST-d10.0-za20.0-off4.000_test-lst.lis
  742acaee79c488adaa95a05d8d274e7f6e995780   38511848   14340866 CTAMCFiles/RayTracing/photons-LST-d10.0-za20.0-off4.500_test-lst.lis
  acc4c913592e1e603f0ce09a1632ccbe1fa9390f   38382312   14318916 CTAMCFiles/RayTracing/photons-LST-d10.0-za20.0-off5.000_test-lst.lis
  ada142d1e8b51f2b6e865cd664767de6c95378f3   38558790   14284308 CTAMCFiles/RayTracing/photons-LST-d10.0-za20.0-off3.500_test-lst.lis
  fe1b69bce94b0e2fd369251a53431f51767034a8   38377748   14226133 CTAMCFiles/RayTracing/photons-LST-d10.0-za20.0-off1.500_test-lst.lis
  cb3c5d7874c331fd57eaa4beb3968dfb09e4810c   38503510   14222566 CTAMCFiles/RayTracing/photons-LST-d10.0-za20.0-off3.000_test-lst.lis
  2cb953fe3d51010ebe82b4af0d2a85160078bd4d   38667417   14221694 CTAMCFiles/RayTracing/photons-LST-d10.0-za20.0-off2.500_test-lst.lis
  1df9e4b97f09d47f7f4766a228e9491948bfc043   37953733   14058847 CTAMCFiles/RayTracing/photons-LST-d10.0-za20.0-off1.000_test-lst.lis
  372c0f1061b965a8b8843804d45910b8c4920446   37750991   13801781 CTAMCFiles/RayTracing/photons-LST-d10.0-za20.0-off0.500_test-lst.lis
  e2ca8a6775ce777932c40494d7e36b9984c6f8ba   36730124   13561068 CTAMCFiles/RayTracing/photons-LST-d10.0-za20.0-off0.000_test-lst.lis

I suggest to purge these files from the history. This is not entirely straight forward, but I think we can follow those explanations: https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/removing-sensitive-data-from-a-repository

Let me know if you have any issues with this, I would otherwise go ahead and try this.

orelgueta commented 1 year ago

Sure, we can definitely remove those files, no problem. Not sure why we have to use a protocol which removes sensitive data for it considering those are just old ray tracing files, but either way it's fine.

GernotMaier commented 4 months ago

I've changed the label to "wont fix".

It is annoying that simtools is almost 200 MB large. However, we should be careful given that this rewrites the git history. Better to keep a minor annoyance than the mess up things.