Need to control size of commits

[litlfred]

Currently it looks like there is a publication every hour from the KDS. Each commit seems to be about 2mb worth of changes. The github repo will continue to grow and soon get to an unmanageable size. I see a few ways to address this. See below for git log showing the difference in one of the files in the commit. One thing to note is that the only thing that is changing in general is the timestamps proof section. Since the did.json file is all in one line, that means that the whole did.json is changed, hence each commit ends up having to have all of the contents of each of the did files.

One suggestion is that rather than having it all in one line we split into two lines like:

{"@context":[BLAH],"id":BLAH,"controller":BLAH:"verificationMethod":[BLAH] 'proof': {BLAH}}

will mean that the commit will only need to change the proof section.

Another option is perhaps to use --squash on the commits. We had a similar issue when using github pages for publishing the FHIR implementation guides. @costateixeira what exactly did you do here to make sure the IG repos didn't not blow-up?

@@ -1 +1 @@ -{"@context":["https://www.w3.org/ns/did/v1","https://w3id.org/security/suites/jws-2020/v1"],"id":"did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist- ref:-:-:DSC","controller":"did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist-ref:-:-:DSC","verificationMethod":["did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#%2FxNLImr%2B6lU%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#2SpbGPAowok%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#6u%2BdH8ficIc%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#9Tid1paSGUE%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#AYuS23oVStk%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#D%2FwOwMnJVa8%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#ETCBcZkErTs%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#EzzSmXSFKt8%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#GoBk3sBKjhU%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#KMUhltYAD%2B8%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#MljNbYidyn4%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#NUFZ%2B079T8c%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#NX529J%2FHFsw%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#UUuJcwmjoJM%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#W%2B2r9WEoRpg%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#WfUAk8GnBXE%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#WzaWeHQDDhk%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#YZITJd3wXg4%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#ZC8hppwISBw%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#ZlmDbOREX5g%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#ZzF79NvDZ0k%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#aQ7BMJAhsho%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#b906lfjAjJw%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#cShS28q1XbM%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#dRyRUE1SS6o%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#dZKOLB0pfpk%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#fmouIcUBbgc%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#hn8pla07fm0%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#pckj%2B4XSTtY%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#ppYccETUInU%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#sP828h0%2BjKc%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#vfUrd%2FVHDbc%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#wjZSzRysxoY%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#zF3bITactCQ%3D","did:web:tng-cdn-dev.who.int:trustlist"],"proof":{"type":"JsonWebSignature2020","created":"2024-06-03T08:00:14Z","nonce":"ITOQD9YEtWzMYTT98iy923fDgKQtW7Ci","proofPurpose":"assertionMethod","verificationMethod":"did:web:dummy.net","jws":"eyJiNjQiOmZhbHNlLCJjcml0IjpbImI2NCJdLCJhbGciOiJFQyJ9..CB2iCLUh1mlnMM6OomCPCBi2U3wGLITziBaR2Iy4sXE"}} \ No newline at end of file +{"@context":["https://www.w3.org/ns/did/v1","https://w3id.org/security/suites/jws-2020/v1"],"id":"did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist-ref:-:-:DSC","controller":"did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist-ref:-:-:DSC","verificationMethod":["did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#%2FxNLImr%2B6lU%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#2SpbGPAowok%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#6u%2BdH8ficIc%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#9Tid1paSGUE%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#AYuS23oVStk%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#D%2FwOwMnJVa8%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#ETCBcZkErTs%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#EzzSmXSFKt8%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#GoBk3sBKjhU%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#KMUhltYAD%2B8%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#MljNbYidyn4%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#NUFZ%2B079T8c%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#NX529J%2FHFsw%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#UUuJcwmjoJM%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#W%2B2r9WEoRpg%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#WfUAk8GnBXE%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#WzaWeHQDDhk%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#YZITJd3wXg4%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#ZC8hppwISBw%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#ZlmDbOREX5g%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#ZzF79NvDZ0k%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#aQ7BMJAhsho%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#b906lfjAjJw%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#cShS28q1XbM%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#dRyRUE1SS6o%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#dZKOLB0pfpk%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#fmouIcUBbgc%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#hn8pla07fm0%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#pckj%2B4XSTtY%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#ppYccETUInU%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#sP828h0%2BjKc%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#vfUrd%2FVHDbc%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#wjZSzRysxoY%3D","did:web:worldhealthorganization.github.io:tng-cdn-dev:v2.0.0:trustlist:-:-:DSC#zF3bITactCQ%3D","did:web:tng-cdn-dev.who.int:trustlist"],"proof":{"type":"JsonWebSignature2020","created":"2024-06-03T09:00:11Z","nonce":"y17K7Xv0NeOAZq0u5VVV9hfWvpNHJDxL","proofPurpose":"assertionMethod","verificationMethod":"did:web:dummy.net","jws":"eyJiNjQiOmZhbHNlLCJjcml0IjpbImI2NCJdLCJhbGciOiJFQyJ9..Ux1DI5F0Kw0QqOXnphkeRl8bEv2VQ3veJ17ShRcq5eU"}}

[costateixeira]

For the ImplementationGuides, we simply squashed commits, so the commit history was gone. It doesn't seem that solution would be applicable here, right?

[litlfred]

There is a GitHub workflow that handles the squashing in another (similar) project if needed. https://github.com/WorldHealthOrganization/smart-html/blob/main/.github/workflows/release.yml

[costateixeira]

this line squashes the commits in this action: https://github.com/WorldHealthOrganization/smart-base/blob/main/.github/workflows/ghbuild.yml#L105