Have a new option to force commit for every change processed

daevaorn / djapian

High level Xapian integration for Django

Other

6 stars 3 forks source link

Have a new option to force commit for every change processed #65

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago

When indexing a large number of objects (i.e. 100 thousands) at once, the
system will late to finish. If you just break your connection in the middle
of way, you can lose minutes or hours of indexing.

Then we should have an option "--autocommit" or "--commit-on-each-object"
or something else, to force commit on each item, when it is processed on
management/commands/index.py:42 (def update_changes)

Original issue reported on code.google.com by mari...@gmail.com on 28 May 2009 at 11:17

GoogleCodeExporter commented 9 years ago

Do you have thousands of _changed_ objects? Or do you mean `rebuild` process?

Original comment by daevaorn on 28 May 2009 at 2:19

GoogleCodeExporter commented 9 years ago

Original comment by daevaorn on 19 Sep 2009 at 9:19

Changed state: Accepted
Added labels: Milestone-Release2.3

GoogleCodeExporter commented 9 years ago

Fixed with r295. Added `--commit_each` parameter that introduced two modes of 
index
command work - operation over pages or individual objects.

Original comment by daevaorn on 4 Oct 2009 at 5:22

Changed state: Fixed