search

KonnexionsGmbH / sqlparse

LALR grammar based SQL Parser
Other
43 stars 15 forks source link

commit history cleanup #171

Closed c-bik closed 5 years ago

c-bik commented 5 years ago

Current repo history size:

$ git clone --mirror https://github.com/k2informaticsgmbh/sqlparse
Cloning into bare repository 'sqlparse.git'...
remote: Enumerating objects: 16, done.
remote: Counting objects: 100% (16/16), done.
remote: Compressing objects: 100% (15/15), done.
remote: Total 5927 (delta 1), reused 4 (delta 0), pack-reused 5911
Receiving objects: 100% (5927/5927), 66.77 MiB | 1.14 MiB/s, done.
Resolving deltas: 100% (4292/4292), done.

$ du -sh sqlparse.git/
68M     sqlparse.git/
c-bik commented 5 years ago 
$ git rev-list --objects --all \
| git cat-file --batch-check='%(objecttype) %(objectname) %(objectsize) %(rest)' \
| sed -n 's/^blob //p' \
| grep -vF --file=<(git ls-tree -r HEAD | awk '{print $3}') \
| sort --numeric-sort --key=2 \
| cut -c 1-12,41- \
| $(command -v gnumfmt || echo numfmt) --field=2 --to=iec-i --suffix=B --padding=7 --round=nearest
...
1b6f9b206bff  427KiB erl_crash.dump
d417d7965401  468KiB priv/www/Jit/jit.js
af81cf29651b  711KiB priv/BNFC/ParSqlparse.info
5cd227757a23  821KiB priv/BNF_Converter/ParSqlparse.info
b9c9b89513fd  847KiB priv/bnf_converter/ParSqlparse.info
986250fe7368  847KiB priv/bnf_converter/ParSqlparse.info
57f64fd548ad  860KiB priv/bnf_converter/ParSqlparse.info
61002620732f  861KiB priv/bnf_converter/ParSqlparse.info
dcb6c3a9f86a  861KiB priv/bnf_converter/ParSqlparse.info
c840069a725e  861KiB priv/bnf_converter/ParSqlparse.info
6a361e439fdc  863KiB priv/bnf_converter/ParSqlparse.info
47320685f52e  864KiB priv/bnf_converter/ParSqlparse.info
f123d12c893e  866KiB priv/bnf_converter/ParSqlparse.info
3fcf8b64c9d3  885KiB priv/bnf_converter/ParSqlparse.info
4f1bedab6da5  887KiB priv/bnf_converter/ParSqlparse.info
20cd1291c06e  891KiB priv/bnf_converter/ParSqlparse.info
b4ab176c8941  900KiB priv/bnf_converter/ParSqlparse.info
d4bce61891fc  902KiB priv/bnf_converter/ParSqlparse.info
497265abe13f  909KiB priv/bnf_converter/ParSqlparse.info
3db703a60dd9  910KiB priv/bnf_converter/ParSqlparse.info
dfd8a0f7d34a  910KiB priv/bnf_converter/ParSqlparse.info
d287f2ad187b  912KiB priv/bnf_converter/ParSqlparse.info
44fa5bc2dff7  915KiB priv/bnf_converter/ParSqlparse.info
b7580bf16660  921KiB priv/bnf_converter/ParSqlparse.info
1c045b001b7f  932KiB priv/bnf_converter/ParSqlparse.info
b86f6e591623  933KiB priv/bnf_converter/ParSqlparse.info
1d8ad15cc558  1.1MiB priv/bnf_converter/ParSqlparse.info
1b688d8fef8b  1.2MiB priv/bnf_converter/ParSqlparse.info
ff47fd23ce28  1.9MiB test/performance_sql_list_SUITE.erl
471644b0110f  3.9MiB priv/bnf_converter/ParSqlparse.info
a481e64f1ea0  4.2MiB priv/bnf_converter/ParSqlparse.info
398209cc4d70  4.5MiB test/performance_sql_list_SUITE.erl
2b9eed07acde  4.8MiB test/performance_complete__compacted_sql_list_SUITE.erl
ee5e0ff97e07  4.9MiB test/performance_complete__compacted_sql_list_SUITE.erl
fb32fa4a6456  5.0MiB test/performance_complete__compacted_sql_list_SUITE.erl
81a395b15f9d  5.2MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
c8607365d869  5.2MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
7c5908c93009  5.4MiB test/performance_sql_list_SUITE.erl
2b502e40d5a9  5.6MiB test/performance_sql_list_SUITE.erl
c09c2bc51bed  5.8MiB test/performance_sql_list_SUITE.erl
00ad64a7c03e  5.9MiB test/performance_complete__compacted_sql_list_SUITE.erl
7da825578492  6.0MiB test/performance_complete__compacted_sql_list_SUITE.erl
f435aaf7ecd9  6.2MiB test/performance_sql_list_SUITE.erl
9f3f5f94f0b6  6.4MiB test/performance_complete__compacted_sql_list_SUITE.erl
e3eb7ee526da  6.4MiB test/performance_sql_list_SUITE.erl
e675cdb381aa  6.5MiB test/performance_complete__compacted_sql_list_SUITE.erl
e36d069cbd30  6.9MiB test/performance_sql_list_SUITE.erl
d48cbfec5d66  7.3MiB test/performance_sql_list_SUITE.erl
859a87961301  7.3MiB test/performance_sql_list_SUITE.erl
86468863cfe9  8.0MiB test/performance_sql_list_SUITE.erl
1669a72acde6  8.7MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
1449c6797d48  8.9MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
75eb20608d88  8.9MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
b36eb4e1d581  9.0MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
0f93add86a3d  9.0MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
69fa72a345f8  9.1MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
ec66ed2f1334  9.2MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
5ef313f1939a  9.2MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
909da6604456  9.2MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
70625f3027bc  9.3MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
3d740cb574a3  9.4MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
f4eaa752a4c1  9.4MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
291a81788c49  9.5MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
fdeeb38377b8  9.6MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
572e16a721d1  9.6MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
47dd40a200aa  9.6MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
e659127e7479  9.6MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
3b4ea68ae0fe  9.7MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
9f88f835f217   10MiB test/generated/ct/performance_complete__compacted_sql_list_SUITE.erl
875c55287744   10MiB test/performance_sql_list_SUITE.erl
b77edacb5e44   10MiB test/performance_sql_list_SUITE.erl
624979e79736   11MiB test/performance_sql_list_SUITE.erl
c288631d8b54   26MiB test/performance_sql_list_SUITE.erl
9fbd615b72dc   29MiB test/performance_sql_list_SUITE.erl

Paths / folders / files no longer exists in sqlparse:

c-bik commented 5 years ago 
$ java -jar bfg-1.13.0.jar --delete-folders generated sqlparse.git
Using repo : /home/bikram/git-cleanup/sqlparse.git

Found 64 objects to protect
Found 15 tag-pointing refs : refs/tags/1.5.1, refs/tags/1.5.2, refs/tags/1.5.3, ...
Found 118 commit-pointing refs : HEAD, refs/heads/master, refs/pull/100/head, ...

Protected commits
-----------------

These are your protected commits, and so their contents will NOT be altered:

 * commit 51129428 (protected by 'HEAD')

Cleaning
--------

Found 1046 commits
Cleaning commits:       100% (1046/1046)
Cleaning commits completed in 3,868 ms.

Updating 73 Refs
----------------

        Ref                   Before     After
        -----------------------------------------
        refs/heads/master   | 51129428 | 900dff23
        refs/pull/100/head  | 1aa6c3f4 | 368ef3ef
        refs/pull/101/head  | c58826ff | 9ff8cfa6
        refs/pull/103/head  | 54cf40c8 | a834304c
        refs/pull/104/head  | 044b28b6 | d1d31742
        refs/pull/105/head  | f6872afe | 47d9b888
        refs/pull/106/head  | 2d06b7b5 | 5800d0ce
        refs/pull/107/head  | ea191076 | c205bcc9
        refs/pull/108/head  | fceb07a4 | 9edbcacb
        refs/pull/109/head  | 88fc78ca | 43b3ef4b
        refs/pull/110/head  | 6c5dd8fa | 2e307432
        refs/pull/111/head  | 340b85ee | 96bbd7a8
        refs/pull/112/head  | 862374aa | 281ca042
        refs/pull/112/merge | 62aa9a03 | 0604217d
        refs/pull/113/head  | 41e4a7fa | b30954e7
        ...

Updating references:    100% (73/73)
...Ref update completed in 803 ms.

Commit Tree-Dirt History
------------------------

        Earliest                                              Latest
        |                                                          |
        ..................................DDDDDDDDDDDDDDDDDDDDDDDmmm

        D = dirty commits (file tree fixed)
        m = modified commits (commit message or parents changed)
        . = clean commits (no changes to file tree)

                                Before     After
        -------------------------------------------
        First modified commit | 0541df8a | 3c3a2619
        Last dirty commit     | 9e7ae79d | 956489ce

In total, 963 object ids were changed. Full details are logged here:
        /home/bikram/git-cleanup/sqlparse.git.bfg-report/2019-07-04/05-31-52

/sqlparse.git$ git reflog expire --expire=now --all && git gc --prune=now --aggressive
Counting objects: 5820, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (5738/5738), done.
Writing objects: 100% (5820/5820), done.
Total 5820 (delta 4243), reused 977 (delta 0)
Removing duplicate objects: 100% (256/256), done.

$ git push --force
Counting objects: 2004, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (626/626), done.
Writing objects: 100% (2004/2004), 1.40 MiB | 1.07 MiB/s, done.
Total 2004 (delta 1521), reused 1824 (delta 1367)
remote: Resolving deltas: 100% (1521/1521), completed with 73 local objects.
To https://github.com/k2informaticsgmbh/sqlparse
 ! [remote rejected] refs/pull/100/head -> refs/pull/100/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/101/head -> refs/pull/101/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/103/head -> refs/pull/103/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/104/head -> refs/pull/104/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/105/head -> refs/pull/105/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/106/head -> refs/pull/106/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/107/head -> refs/pull/107/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/108/head -> refs/pull/108/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/109/head -> refs/pull/109/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/110/head -> refs/pull/110/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/111/head -> refs/pull/111/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/112/head -> refs/pull/112/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/112/merge -> refs/pull/112/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/113/head -> refs/pull/113/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/114/head -> refs/pull/114/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/115/head -> refs/pull/115/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/116/head -> refs/pull/116/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/117/head -> refs/pull/117/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/119/head -> refs/pull/119/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/121/head -> refs/pull/121/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/123/head -> refs/pull/123/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/124/head -> refs/pull/124/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/128/head -> refs/pull/128/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/128/merge -> refs/pull/128/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/129/head -> refs/pull/129/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/129/merge -> refs/pull/129/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/130/head -> refs/pull/130/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/131/head -> refs/pull/131/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/133/head -> refs/pull/133/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/138/head -> refs/pull/138/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/139/head -> refs/pull/139/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/141/head -> refs/pull/141/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/143/head -> refs/pull/143/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/147/head -> refs/pull/147/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/148/head -> refs/pull/148/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/149/head -> refs/pull/149/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/150/head -> refs/pull/150/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/151/head -> refs/pull/151/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/152/head -> refs/pull/152/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/153/head -> refs/pull/153/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/154/head -> refs/pull/154/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/156/head -> refs/pull/156/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/157/head -> refs/pull/157/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/160/head -> refs/pull/160/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/161/head -> refs/pull/161/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/162/head -> refs/pull/162/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/163/head -> refs/pull/163/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/164/head -> refs/pull/164/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/165/head -> refs/pull/165/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/167/head -> refs/pull/167/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/168/head -> refs/pull/168/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/169/head -> refs/pull/169/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/170/head -> refs/pull/170/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/19/head -> refs/pull/19/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/19/merge -> refs/pull/19/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/20/head -> refs/pull/20/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/20/merge -> refs/pull/20/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/27/head -> refs/pull/27/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/28/head -> refs/pull/28/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/29/head -> refs/pull/29/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/29/merge -> refs/pull/29/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/30/head -> refs/pull/30/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/31/head -> refs/pull/31/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/32/head -> refs/pull/32/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/41/head -> refs/pull/41/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/43/head -> refs/pull/43/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/44/head -> refs/pull/44/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/47/head -> refs/pull/47/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/47/merge -> refs/pull/47/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/48/head -> refs/pull/48/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/49/head -> refs/pull/49/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/50/head -> refs/pull/50/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/52/head -> refs/pull/52/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/57/head -> refs/pull/57/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/57/merge -> refs/pull/57/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/58/head -> refs/pull/58/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/64/head -> refs/pull/64/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/64/merge -> refs/pull/64/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/65/head -> refs/pull/65/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/66/head -> refs/pull/66/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/73/head -> refs/pull/73/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/74/head -> refs/pull/74/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/75/head -> refs/pull/75/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/76/head -> refs/pull/76/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/77/head -> refs/pull/77/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/78/head -> refs/pull/78/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/79/head -> refs/pull/79/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/80/head -> refs/pull/80/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/81/head -> refs/pull/81/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/84/head -> refs/pull/84/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/84/merge -> refs/pull/84/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/85/head -> refs/pull/85/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/93/head -> refs/pull/93/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/94/head -> refs/pull/94/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/95/head -> refs/pull/95/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/96/head -> refs/pull/96/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/97/head -> refs/pull/97/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/98/head -> refs/pull/98/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/99/head -> refs/pull/99/head (deny updating a hidden ref)
error: failed to push some refs to 'https://github.com/k2informaticsgmbh/sqlparse'
c-bik commented 5 years ago 
$ java -jar bfg-1.13.0.jar --strip-blobs-bigger-than 800K sqlparse.git

Using repo : /home/bikram/git-cleanup/sqlparse.git

Scanning packfile for large blobs: 6144
Scanning packfile for large blobs completed in 133 ms.
Found 72 blob ids for large blobs - biggest=30605549 smallest=840220
Total size (unpacked)=432851185
Found 63 objects to protect
Found 15 tag-pointing refs : refs/tags/1.5.1, refs/tags/1.5.2, refs/tags/1.5.3, ...
Found 118 commit-pointing refs : HEAD, refs/heads/master, refs/pull/100/head, ...

Protected commits
-----------------

These are your protected commits, and so their contents will NOT be altered:

 * commit 3a98ac6c (protected by 'HEAD')

Cleaning
--------

Found 1166 commits
Cleaning commits:       100% (1166/1166)
Cleaning commits completed in 5,752 ms.

Updating 87 Refs
----------------

        Ref                   Before     After
        -----------------------------------------
        refs/heads/master   | 3a98ac6c | 3cba0eba
        refs/pull/100/head  | 1aa6c3f4 | 780d2eb7
        refs/pull/101/head  | c58826ff | 7368aef2
        refs/pull/103/head  | 54cf40c8 | f4340d67
        refs/pull/104/head  | 044b28b6 | c5856daf
        refs/pull/105/head  | f6872afe | d72f6402
        refs/pull/106/head  | 2d06b7b5 | 0cb71ee7
        refs/pull/107/head  | ea191076 | 84de1142
        refs/pull/108/head  | fceb07a4 | 5a3980dc
        refs/pull/109/head  | 88fc78ca | 6826774e
        refs/pull/110/head  | 6c5dd8fa | 9116938b
        refs/pull/111/head  | 340b85ee | 36c1dedb
        refs/pull/112/head  | 862374aa | cb62a1b7
        refs/pull/112/merge | 62aa9a03 | 45291fbf
        refs/pull/113/head  | 41e4a7fa | 285b12de
        ...

Updating references:    100% (87/87)
...Ref update completed in 1,229 ms.

Commit Tree-Dirt History
------------------------

        Earliest                                              Latest
        |                                                          |
        ......................DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDmmDDD

        D = dirty commits (file tree fixed)
        m = modified commits (commit message or parents changed)
        . = clean commits (no changes to file tree)

                                Before     After
        -------------------------------------------
        First modified commit | a873931a | 8245d2b8
        Last dirty commit     | 900dff23 | d7d6f2b0

Deleted files
-------------

        Filename                                             Git id
        --------------------------------------------------------------------------------------------------
        ParSqlparse.info                                   | 44fa5bc2 (915.0 KB), 47320685 (864.1 KB), ...
        performance_complete__compacted_sql_list_SUITE.erl | 2b9eed07 (4.8 MB), c8607365 (5.2 MB), ...
        performance_sql_list_SUITE.erl                     | 398209cc (4.5 MB), 9fbd615b (29.2 MB), ...

In total, 1634 object ids were changed.

$ du -sh sqlparse.git
3.3M
c-bik commented 5 years ago 
/sqlparse.git$ du -sh .
2.9M

/sqlparse.git$ git push --force
Counting objects: 3006, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (702/702), done.
Writing objects: 100% (3006/3006), 1.51 MiB | 1.19 MiB/s, done.
Total 3006 (delta 2257), reused 2909 (delta 2195)
remote: Resolving deltas: 100% (2257/2257), completed with 27 local objects.
To https://github.com/k2informaticsgmbh/sqlparse
 ! [remote rejected] refs/pull/100/head -> refs/pull/100/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/101/head -> refs/pull/101/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/103/head -> refs/pull/103/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/104/head -> refs/pull/104/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/105/head -> refs/pull/105/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/106/head -> refs/pull/106/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/107/head -> refs/pull/107/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/108/head -> refs/pull/108/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/109/head -> refs/pull/109/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/110/head -> refs/pull/110/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/111/head -> refs/pull/111/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/112/head -> refs/pull/112/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/112/merge -> refs/pull/112/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/113/head -> refs/pull/113/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/114/head -> refs/pull/114/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/115/head -> refs/pull/115/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/116/head -> refs/pull/116/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/117/head -> refs/pull/117/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/119/head -> refs/pull/119/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/121/head -> refs/pull/121/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/123/head -> refs/pull/123/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/124/head -> refs/pull/124/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/128/head -> refs/pull/128/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/128/merge -> refs/pull/128/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/129/head -> refs/pull/129/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/129/merge -> refs/pull/129/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/130/head -> refs/pull/130/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/131/head -> refs/pull/131/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/133/head -> refs/pull/133/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/138/head -> refs/pull/138/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/139/head -> refs/pull/139/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/141/head -> refs/pull/141/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/143/head -> refs/pull/143/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/147/head -> refs/pull/147/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/148/head -> refs/pull/148/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/149/head -> refs/pull/149/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/150/head -> refs/pull/150/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/151/head -> refs/pull/151/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/152/head -> refs/pull/152/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/153/head -> refs/pull/153/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/154/head -> refs/pull/154/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/156/head -> refs/pull/156/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/157/head -> refs/pull/157/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/160/head -> refs/pull/160/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/161/head -> refs/pull/161/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/162/head -> refs/pull/162/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/163/head -> refs/pull/163/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/164/head -> refs/pull/164/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/165/head -> refs/pull/165/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/167/head -> refs/pull/167/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/168/head -> refs/pull/168/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/169/head -> refs/pull/169/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/170/head -> refs/pull/170/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/19/head -> refs/pull/19/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/19/merge -> refs/pull/19/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/20/head -> refs/pull/20/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/20/merge -> refs/pull/20/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/27/head -> refs/pull/27/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/28/head -> refs/pull/28/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/29/head -> refs/pull/29/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/29/merge -> refs/pull/29/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/30/head -> refs/pull/30/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/31/head -> refs/pull/31/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/32/head -> refs/pull/32/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/41/head -> refs/pull/41/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/43/head -> refs/pull/43/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/44/head -> refs/pull/44/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/47/head -> refs/pull/47/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/47/merge -> refs/pull/47/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/48/head -> refs/pull/48/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/49/head -> refs/pull/49/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/50/head -> refs/pull/50/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/52/head -> refs/pull/52/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/57/head -> refs/pull/57/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/57/merge -> refs/pull/57/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/58/head -> refs/pull/58/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/64/head -> refs/pull/64/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/64/merge -> refs/pull/64/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/65/head -> refs/pull/65/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/66/head -> refs/pull/66/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/73/head -> refs/pull/73/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/74/head -> refs/pull/74/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/75/head -> refs/pull/75/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/76/head -> refs/pull/76/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/77/head -> refs/pull/77/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/78/head -> refs/pull/78/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/79/head -> refs/pull/79/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/80/head -> refs/pull/80/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/81/head -> refs/pull/81/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/84/head -> refs/pull/84/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/84/merge -> refs/pull/84/merge (deny updating a hidden ref)
 ! [remote rejected] refs/pull/85/head -> refs/pull/85/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/93/head -> refs/pull/93/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/94/head -> refs/pull/94/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/95/head -> refs/pull/95/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/96/head -> refs/pull/96/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/97/head -> refs/pull/97/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/98/head -> refs/pull/98/head (deny updating a hidden ref)
 ! [remote rejected] refs/pull/99/head -> refs/pull/99/head (deny updating a hidden ref)
error: failed to push some refs to 'https://github.com/k2informaticsgmbh/sqlparse'
acautin commented 5 years ago

I think the last push was successful at (maybe partially at least ?):

/Documents/k2_informatics/cpro/_build/default/lib/sqlparse $ du -hs
 65M    .
~/Documents/k2_informatics/cpro/_build/default/lib/sqlparse $ cd ..
~/Documents/k2_informatics/cpro/_build/default/lib $ rm -rf sqlparse/
~/Documents/k2_informatics/cpro/_build/default/lib $ git clone https://github.com/K2InformaticsGmbH/sqlparse.git
Cloning into 'sqlparse'...
remote: Enumerating objects: 1349, done.
remote: Counting objects: 100% (1349/1349), done.
remote: Compressing objects: 100% (836/836), done.
remote: Total 3786 (delta 536), reused 1208 (delta 465), pack-reused 2437
Receiving objects: 100% (3786/3786), 2.57 MiB | 3.18 MiB/s, done.
Resolving deltas: 100% (2578/2578), done.
~/Documents/k2_informatics/cpro/_build/default/lib $ cd sqlparse/
~/Documents/k2_informatics/cpro/_build/default/lib/sqlparse $ du -hs
4.8M    .
c-bik commented 5 years ago

I think the last push was successful at (maybe partially at least ?):

/Documents/k2_informatics/cpro/_build/default/lib/sqlparse $ du -hs
 65M  .
~/Documents/k2_informatics/cpro/_build/default/lib/sqlparse $ cd ..
~/Documents/k2_informatics/cpro/_build/default/lib $ rm -rf sqlparse/
~/Documents/k2_informatics/cpro/_build/default/lib $ git clone https://github.com/K2InformaticsGmbH/sqlparse.git
Cloning into 'sqlparse'...
remote: Enumerating objects: 1349, done.
remote: Counting objects: 100% (1349/1349), done.
remote: Compressing objects: 100% (836/836), done.
remote: Total 3786 (delta 536), reused 1208 (delta 465), pack-reused 2437
Receiving objects: 100% (3786/3786), 2.57 MiB | 3.18 MiB/s, done.
Resolving deltas: 100% (2578/2578), done.
~/Documents/k2_informatics/cpro/_build/default/lib $ cd sqlparse/
~/Documents/k2_informatics/cpro/_build/default/lib/sqlparse $ du -hs
4.8M  .

Yup. It was, but to get to 3MB from this point on I need github support.

c-bik commented 5 years ago 
java -jar bfg-1.13.0.jar --strip-blobs-bigger-than 800K --delete-folders www sqlparse.git
java -jar bfg-1.13.0.jar --delete-files *.dump sqlparse.git
java -jar bfg-1.13.0.jar --delete-files *.info sqlparse.git

Contacted Support

c-bik commented 5 years ago

Github Response

I've cleared those references and have run garbage collection on your repository which has removed any referenced commits from GitHub.

I'm sorry to say that a mistake on my part also deleted the pull requests themselves, this means that the merged pull requests and any comments within have also been deleted. I'm really sorry for any trouble or confusion that causes for you and your team.

c-bik commented 5 years ago 
$ git clone --mirror https://github.com/k2informaticsgmbh/sqlparse
Cloning into bare repository 'sqlparse.git'...
remote: Enumerating objects: 3786, done.
remote: Total 3786 (delta 0), reused 0 (delta 0), pack-reused 3786
Receiving objects: 100% (3786/3786), 2.39 MiB | 1.67 MiB/s, done.
Resolving deltas: 100% (2586/2586), done.

$ du -sh sqlparse.git/
2.7M    sqlparse.git/

/sqlparse.git$ git rev-list --objects --all \
| git cat-file --batch-check='%(objecttype) %(objectname) %(objectsize) %(rest)' \
| sed -n 's/^blob //p' \
| grep -vF --file=<(git ls-tree -r HEAD | awk '{print $3}') \
| sort --numeric-sort --key=2 \
| cut -c 1-12,41- \
| $(command -v gnumfmt || echo numfmt) --field=2 --to=iec-i --suffix=B --padding=7 --round=nearest
...
ad35108c89ab  260KiB test/src/sqlparse_generator.erl
299e4cf95fd9  260KiB test/sqlparse_generator.erl
3fae2d70ef66  262KiB test/src/sqlparse_generator.erl
ca03fe00a78c  262KiB test/src/sqlparse_generator.erl
50f4d21fddd8  262KiB test/src/sqlparse_generator.erl
0cd648e7e20f  263KiB test/src/sqlparse_generator.erl
7f3c8ad83371  263KiB test/src/sqlparse_generator.erl
912c9f3a24c3  267KiB test/src/sqlparse_generator.erl
3ab906a07f3a  531KiB src/sql_lex.erl

History reduced : 68M to 2.7M