bug in fb_handler chunk divide

disinfoRG / FbScraper

MIT License

3 stars 2 forks source link

bug in fb_handler chunk divide #17

Closed andreawwenyi closed 4 years ago

andreawwenyi commented 4 years ago

@bruce, 這一行code是不是想要每一個iteration得到不同的items? 我看了一下你的sql，用limit的話應該會一直拿到同樣的前self.n_amount_in_a_chunk 個（照 id ascending排）

andreawwenyi commented 4 years ago

fix: commit c902adbac07dc550e8db8711d5dae2f3c22666c9 and commit 967523a

andreawwenyi commented 4 years ago

after testing, I realized this is actually doing as expected, not really a bug, because at every iteration, the items that was discovered/updated in the previous iteration would not be called, hence we'd get different items every time.