search

attic-labs / noms

The versioned, forkable, syncable database
Apache License 2.0
7.44k stars 266 forks source link

`csv-import -p` hella slow when source is remote #2036

Open aboodman opened 8 years ago

aboodman commented 8 years ago 
!? csv-import -p='http://demo.noms.io/cli-tour::sf-registered-businesses/raw.value' -dest-type='map:0' 'http://demo.noms.io/cli-tour?access_token=yeknom::aa/sf-registered-businesses'
2.61% of 40 MB (67 kB/s)...

My guess is that this is because blob reading is totally unoptimized.

I can work around this by logging into that server and doing the work there, but it feels very un-nommy to have to do that.

aboodman commented 8 years ago

fyi: @kalman, @rafael-atticlabs

aboodman commented 8 years ago

On the upside, the progress output made it obvious that this was broken :)

aboodman commented 8 years ago

Underlying cause it probably mostly #2079