search

evalEmpire / gitpan

Git repositories for all of CPAN
http://github.com/gitpan
73 stars 12 forks source link

Maintain one repository with all of CPAN #41

Closed avar closed 10 years ago

avar commented 14 years ago

It would be neat to be able to git clone all of CPAN. This could be done by having a huge repo with lots of submodules or in one insanely big repo. The latter would make for a neat alternative to rsyncing all of CPAN for testing / greping.

schwern commented 14 years ago

That's an interesting idea, especially considering gitpan breaks most of the easy ways to programatically get a list of repositories out of github. "Insanely big repo" is a bit too insanely big, it would be multiple gigs. But the importer could maintain one big repository of submodules. This would be far easier to clone.

A structure like dists/t/te/Test-Simple/ might make sense. I've found 21,000 subdirectories causes most shell globing to fail. I should probably make it do that internally.

So yeah, good idea.

Is there a way to set up a submodule to pull from master rather than be attached to a specific commit? Then the importer wouldn't have to constantly update the submodule link. Its not a show stopper, but would be convenient.

schwern commented 10 years ago

I'm going to close this as out of scope for Gitpan. The Github structure lends itself much better to lots of smaller repositories, and Github deals with an organization with many accounts much better now.

You're welcome to merge the Gitpan data into one super-repo if you like.