search

rust-lang / crates.io

The Rust package registry
https://crates.io
Apache License 2.0
3.01k stars 603 forks source link

More metadata in index? #410

Closed kyrias closed 7 years ago

kyrias commented 8 years ago

Currently the metadata available in the git index is very small[1], containing just what cargo itself needs, but the index would be very useful for other purposes as well, since there's no other way to get a dump of the crates data. A few things in the krate::Crate struct that would be useful for other things are the license, repo, homepage, docs, description, et.c.

Another solution would be to provide another form of data dump of the crates.io index, but adding it to the git index seems like the simplest way. Comments/thoughts?

alexcrichton commented 8 years ago

You can use the crates.io API to learn about the full metadata for a crate, but the index is intended to be a very efficient data structure used by Cargo to perform resolution very quickly, so I'd be hesitant to start expanding it for other tools.

kyrias commented 8 years ago

It would be useful to be able to download the repository data somehow without having to query the API every time at least though.

riivo commented 8 years ago

Would it be possible to obtain a dump of the crates.io database, including the full metadata and stats for each crate and excluding user information? (similarly as RubyGem provides https://rubygems.org/pages/data).

alexcrichton commented 8 years ago

@riivo perhaps yeah! Sounds like a neat idea

Keats commented 7 years ago

@alexcrichton even a pg_dump of the tables related to the crates would be enough I think

carols10cents commented 7 years ago

Closing in favor of #630!