search

Swader / diffbot-php-client

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library
MIT License
53 stars 20 forks source link

Add Streaming to Crawlbot #5

Open Swader opened 9 years ago

Swader commented 9 years ago

A crawlbot's job constantly enhances the resultset with new data. Ergo, when fetching the resultset, it's always different unless the job is done or paused.

Since the library depends on Guzzle, perhaps consider using streams?

To keep in mind: stopping the stream if job is paused. Would require re-checking job status? Open for discussion.

Swader commented 8 years ago

Client no longer depends on Guzzle. Makes it more versatile and flexible, but brings streams into questions perhaps.