napoler / ganon

Automatically exported from code.google.com/p/ganon
0 stars 0 forks source link

Curl support #25

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
It is not exactly an issue, but i'd like to use this beautiful parser with 
curl. How can I use this function with your class?

function get_web_page( $url )
{
    $options = array(
        CURLOPT_RETURNTRANSFER => true,     // return web page
        CURLOPT_HEADER         => false,    // don't return headers
        CURLOPT_FOLLOWLOCATION => true,     // follow redirects
        CURLOPT_ENCODING       => "",       // handle compressed
        CURLOPT_USERAGENT      => "spider", // who am i
        CURLOPT_AUTOREFERER    => true,     // set referer on redirect
        CURLOPT_CONNECTTIMEOUT => 120,      // timeout on connect
        CURLOPT_TIMEOUT        => 120,      // timeout on response
        CURLOPT_MAXREDIRS      => 10,       // stop after 10 redirects
    );

    $ch      = curl_init( $url );
    curl_setopt_array( $ch, $options );
    $content = curl_exec( $ch );
    $err     = curl_errno( $ch );
    $errmsg  = curl_error( $ch );
    $header  = curl_getinfo( $ch );
    curl_close( $ch );

    $header['errno']   = $err;
    $header['errmsg']  = $errmsg;
    $header['content'] = $content;
    return $header;
}

Original issue reported on code.google.com by bey...@gmail.com on 24 Oct 2012 at 10:34

GoogleCodeExporter commented 9 years ago
you could just export the curl output to a .log file and then feed it to ganon 
in order to handle that data... that's what I did...

Original comment by Carlos.g...@gmail.com on 10 Nov 2012 at 3:12

GoogleCodeExporter commented 9 years ago
Yes, you can save it to a string/file and feed it to 
str_get_dom()/file_get_dom().

Original comment by niels....@gmail.com on 11 Nov 2012 at 6:32