basho-labs / riak-data-migrator

Riak logical export and data migration tool (using Java client)
15 stars 6 forks source link

Filter out _rsid_* Search index buckets when exporting/importing #4

Open dmitrizagidulin opened 11 years ago

dmitrizagidulin commented 11 years ago

To do: When performing bucket dump or load operations, filter out buckets that start with _rsid_. These are internal-use only buckets created by Riak Search, and contain the documents that search actually indexed. If they are exported and then loaded via data migrator, they result in a hook_crashed Riak error detailed here: https://github.com/basho/riak-data-migrator/issues/3

I've confirmed with Engineering that they should be left out of export/import operations. Also, Search repl also seems to filter them out: https://github.com/basho/riak_search/blob/adf52dd9b67f29d5174d47e38b5f58418634b264/src/riak_search_repl_helper.erl#L17