Open runarbu opened 9 years ago
The smb crawler will not download files larger than 100 Mb ( 104857600 bytes ). This is hardcoded at https://github.com/searchdaimon/enterprise-search/blob/f379ee87574aae83da0fa3cdc8e629ecc92ab1bc/src/crawlSMB/crawlsmb.c#L347
Maybe have this as an option in src/crawl/crawl.h:struct collectionFormat instead ?
The smb crawler will not download files larger than 100 Mb ( 104857600 bytes ). This is hardcoded at https://github.com/searchdaimon/enterprise-search/blob/f379ee87574aae83da0fa3cdc8e629ecc92ab1bc/src/crawlSMB/crawlsmb.c#L347
Maybe have this as an option in src/crawl/crawl.h:struct collectionFormat instead ?