basho-labs / riak-data-migrator

Riak logical export and data migration tool (using Java client)
15 stars 6 forks source link

-k option fails to create file with list of keys #19

Open amgorb opened 7 years ago

amgorb commented 7 years ago
# java -jar riak-data-migrator-0.2.9/riak-data-migrator-0.2.9.jar -k -b bucket -r files -c hosts.txt -v
PB Port not specified, using the default: 8087
HTTP port not specified, using the default: 8098

no file create and no other output

# java -jar riak-data-migrator-0.2.9/riak-data-migrator-0.2.9.jar -k -b bucket -r files -h localhost -v
PB Port not specified, using the default: 8087
HTTP port not specified, using the default: 8098

Riak 2.1.4, similar request curl -i http://localhost:8098/buckets/bucket/keys?keys=true works fine. Ruby PB client works fine also.

dmitrizagidulin commented 7 years ago

Hi @amgorb! How large was the dataset in your test? (I'm wondering if this is maybe a case of the key list timing out).

amgorb commented 7 years ago

Hi @dmitrizagidulin!

I've tested with different buckets (1000000 and several keys) and there is no timeout, probably problem is somewhere else:

# time java -jar /root/riak-data-migrator-0.2.9/riak-data-migrator-0.2.9.jar -k -b test -r hereseo/ -c hosts.txt -v
PB Port not specified, using the default: 8087
HTTP port not specified, using the default: 8098

real    0m0.169s
user    0m0.093s
sys     0m0.067s

same bucket,same riak, same host but with -b works fine:

time java -jar /root/riak-data-migrator-0.2.9/riak-data-migrator-0.2.9.jar -d -b test -r hereseo/ -c hosts.txt -v
PB Port not specified, using the default: 8087
HTTP port not specified, using the default: 8098

Dumping bucket test
100% completed. Read 4 @ 51 obj/sec
Dump Summary:
         Bucket     Objects     Seconds    Objs/Sec     Size/KB Val. Err.
           test           4         0.1        51.3          46         0
       Total: 1           4         0.1        51.3          46         0

real    0m1.207s
user    0m0.990s
sys     0m0.180s
dmitrizagidulin commented 7 years ago

Thanks. Seems like a bug, yeah.