search

crawlserv / crawlservpp

crawlserv++: Application for crawling and analyzing textual content of websites.
Other
5 stars 0 forks source link

analyzer: findSavePoint can be substituted by simple MySQL condition #143

Open crawlserv opened 3 years ago

crawlserv commented 3 years ago

when selecting first chunk of corpus: SELECT …, savepoint FROM … WHERE … AND (savepoint IS NULL OR savepoint LIKE LEFT(? [fullsavepoint], LENGTH(savepoint)) … ORDER BY LENGTH(savepoint) DESC

-> always selects the longest savepoint possible