search

forcedotcom / phoenix

BSD 3-Clause "New" or "Revised" License
558 stars 227 forks source link

huge git objects #680

Closed rtvt123 closed 10 years ago

rtvt123 commented 10 years ago

there are some large git objects in .git/objects/pack (>100MB) which slow down cloning significantly

du -a phoenix | sort -n -r | head -n 10 295688 phoenix 280160 phoenix/.git 279768 phoenix/.git/objects/pack 279768 phoenix/.git/objects 278096 phoenix/.git/objects/pack/pack-6666038f76532e580f4b7c86e695480222b520cc.pack 14448 phoenix/phoenix-core

EDIT: looks like the largest ones are client jars

git verify-pack -v .git/objects/pack/pack-6666038f76532e580f4b7c86e695480222b520cc.idx| sort -k 3 -n | tail -3 312041e9808efbd3077da7960fb91f7cecdd72a9 blob 7841031 7279643 121912863 ec017c776c90bc7d9396c0ce02dad91eab0b248a blob 7970720 7621085 85248610 1 ea55ee6457e80090d37b59215948865198fa728b blob 16390140 15053939 3859820

git rev-list --objects --all |grep ea55ee6457 ea55ee6457e80090d37b59215948865198fa728b lib/phoenix-client.jar git rev-list --objects --all |grep ec017c776 ec017c776c90bc7d9396c0ce02dad91eab0b248a releases/com/salesforce/phoenix/2.1.2/phoenix-2.1.2-client.jar git rev-list --objects --all |grep 312041e98 312041e9808efbd3077da7960fb91f7cecdd72a9 docs/hbase-0.94.0-javadoc.jar

it may be worthwhile to remove the client jars from prior versions, e.g. using the procedure described here

jtaylor-sfdc commented 10 years ago

Yes, there was some stuff checked into git that shouldn't have been. We tried to get rid of it, but didn't want to break folks who have forked. This will get fixed soon when we move to Apache.