Batch update post_web_doc and check/test the batch update of update_inv_index

gcc42 / hooli

0 stars 0 forks source link

Open Abh1ram opened 7 years ago

Abh1ram commented 7 years ago

Both post_web_doc and update_inv_index updates should be updated in each node by batch, not after each page crawling/indexing.

gcc42 commented 7 years ago

Finished batch update of update_inv_index by creating hbase_util.update_inv_index_batch in commit e96bbd9c.