dselivanov / text2vec

Fast vectorization, topic modeling, distances and GloVe word embeddings in R.
http://text2vec.org
Other
851 stars 136 forks source link

SQLite iterator #259

Closed gkoytiger closed 4 years ago

gkoytiger commented 6 years ago

It would be really useful to have the ability to generator an iterator from a sqlite query such as implemented here in the foreach package: https://raw.githubusercontent.com/cran/foreach/master/inst/examples/sqlite.R

This will allow for efficient processing of large datasets

dselivanov commented 6 years ago

Yes it should not be hard to implement - I had this in mind when I designed iterators. Pull request is welcome.

пн, 14 мая 2018 г., 4:03 gkoytiger notifications@github.com:

It would be really useful to have the ability to generator an iterator from a sqlite query such as implemented here in the foreach package: https://raw.githubusercontent.com/cran/foreach/master/inst/examples/sqlite.R

This will allow for efficient processing of large datasets

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/dselivanov/text2vec/issues/259, or mute the thread https://github.com/notifications/unsubscribe-auth/AE4u3bdHvuW0MEvjnQHB9KYO4PecZCxQks5tyMnggaJpZM4T9As4 .

dselivanov commented 4 years ago

If someone need - PR welcome. I'm not going to work on that.