stefanogram / skipfish

Automatically exported from code.google.com/p/skipfish
Apache License 2.0
2 stars 2 forks source link

Get Incomplete Page #84

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago
in next_from_queue()' loop between 'SSL_read_more' and 'goto SSL_read_more' 
cause two read() of one socket with no waiting. and got POLLHUG even when the 
page is not fully downloaded. add sleep(xx) right under lable 'SSL_read_more' 
temporarily solves it. but i don't think it is a good idea.(by the way the web 
server i test is IIS with asp)

Original issue reported on code.google.com by idc...@gmail.com on 27 Jul 2010 at 7:37

GoogleCodeExporter commented 8 years ago
This should already be fixed, what version are you using?

Original comment by lcam...@gmail.com on 27 Jul 2010 at 7:45

GoogleCodeExporter commented 8 years ago
[deleted comment]
GoogleCodeExporter commented 8 years ago
1.52b when try two get page http://www.qianzh.com/About.asp

Original comment by idc...@gmail.com on 27 Jul 2010 at 7:57

GoogleCodeExporter commented 8 years ago
Are you sure you recompiled (make clean all) correctly?

In version 1.52, SSL_read_more is called again *only* for SSL connections:

          if (c->proto == PROTO_HTTPS &&
              read_res && c->read_len < size_limit) goto SSL_read_more;

So it should have no effect on HTTP fetches. From your description above, 
sounds like you were looking at a version earlier than 1.52b, can you confirm?

Original comment by lcam...@gmail.com on 27 Jul 2010 at 8:29

GoogleCodeExporter commented 8 years ago
oh! I'm sorry. You are right, I failed to keep http_client.c updated.

Original comment by idc...@gmail.com on 27 Jul 2010 at 8:39