Open AndreyPopovNew opened 2 years ago
in long and hard discussion with serpent_driver and researching parameters of his "superfast recaching method" finding really "magic" option for curl in crawler algorithm.
curl_setopt($ch, CURLOPT_ENCODING, "");
must be added in
/catalog/controller/extension/module)/lscache.php
after this:
curl_setopt($ch, CURLOPT_HTTP_VERSION, CURL_HTTP_VERSION_1_1);
after adding this options:
speed of recache increase up to 3 times
size of already generated cache decrease up to 10 times
file of cache after lscache header now contain not full html code of cached page like: <!DOCTYPE html>
in long and hard discussion with serpent_driver and researching parameters of his "superfast recaching method" finding really "magic" option for curl in crawler algorithm.
curl_setopt($ch, CURLOPT_ENCODING, "");must be added in
/catalog/controller/extension/module)/lscache.php
after this:
curl_setopt($ch, CURLOPT_HTTP_VERSION, CURL_HTTP_VERSION_1_1);after adding this options:
speed of recache increase up to 3 times
size of already generated cache decrease up to 10 times
file of cache after lscache header now contain not full html code of cached page like: <!DOCTYPE html>