" The most important type of configurable behavior is proxying HTTP connections ..."
Apache HttpClient 4 is recommended.
"(The classic daemon uses Apache HttpClient 3 and has been stuck there because behavioral differences between HttpClient 3 and 4 will be disruptive to critical components like the crawler and proxies. That said, we can't stay on 3 forever, so Fernando has done the work of upgrading to 4, we just haven't had sufficient testing time to tease out behavioral changes, especially under load or during various types of network disruptions. This tools can use whatever it wants to make outgoing HTTP connections, including the default Java HTTP stack, but we recommend Apache HttpClient 4. Fernando can provide a primer/demo.)"
ndushay
commented
7 years ago
from Thib's email of 2017-04-28:
" The most important type of configurable behavior is proxying HTTP connections ..."
Apache HttpClient 4 is recommended.
"(The classic daemon uses Apache HttpClient 3 and has been stuck there because behavioral differences between HttpClient 3 and 4 will be disruptive to critical components like the crawler and proxies. That said, we can't stay on 3 forever, so Fernando has done the work of upgrading to 4, we just haven't had sufficient testing time to tease out behavioral changes, especially under load or during various types of network disruptions. This tools can use whatever it wants to make outgoing HTTP connections, including the default Java HTTP stack, but we recommend Apache HttpClient 4. Fernando can provide a primer/demo.)"