issues
search
medialab
/
sandcrawler
sandcrawler.js - the server-side scraping companion.
http://medialab.github.io/sandcrawler/
GNU Lesser General Public License v3.0
107
stars
12
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Rework features
#143
Yomguithereal
opened
9 years ago
0
Provide readable streams
#142
Yomguithereal
closed
9 years ago
0
Default url in spider config
#141
Yomguithereal
opened
9 years ago
0
Phantom proxy
#140
Yomguithereal
opened
9 years ago
0
Validate config on method call
#139
Yomguithereal
closed
9 years ago
0
Static proxy
#138
Yomguithereal
closed
9 years ago
0
Check phantom cookies expiry and duplication
#137
Yomguithereal
opened
9 years ago
0
Register job call before request
#136
Yomguithereal
closed
9 years ago
0
Check cases of false asynchronicity
#135
Yomguithereal
closed
9 years ago
0
Validate to use typology error
#134
Yomguithereal
opened
9 years ago
1
Harmonize host-not-found
#133
Yomguithereal
closed
9 years ago
0
Render base64
#132
Yomguithereal
opened
9 years ago
0
Lockdown
#131
Yomguithereal
closed
9 years ago
0
Document artoo.phantom
#130
Yomguithereal
closed
9 years ago
0
Doc: possibility to retry job in quick start and clarification about error handling
#129
Yomguithereal
closed
9 years ago
0
Quickstart link on home is broken
#128
Yomguithereal
closed
9 years ago
0
Add an example requiring phantom and artoo in the quick start
#127
Yomguithereal
opened
9 years ago
1
Check time measure for job failed
#126
Yomguithereal
closed
9 years ago
0
Possibility to pass inline scritps
#125
Yomguithereal
closed
9 years ago
0
Double check redirection handling
#124
Yomguithereal
opened
9 years ago
0
jsdom through request?
#123
Yomguithereal
closed
9 years ago
1
Add misc examples section in doc
#122
Yomguithereal
opened
9 years ago
1
Cookies
#121
Yomguithereal
closed
9 years ago
0
Form data
#120
Yomguithereal
closed
9 years ago
0
Auto retry setting polymorphisme
#119
Yomguithereal
closed
9 years ago
0
Auth
#118
Yomguithereal
closed
9 years ago
0
Simplify phantom_script iife
#117
Yomguithereal
closed
9 years ago
0
Replace jQuery dependency solving by phantom side heuristic
#116
Yomguithereal
closed
9 years ago
0
Wrap static scraper functions in try catch statement
#115
Yomguithereal
closed
9 years ago
0
Urls apply polymorphism
#114
Yomguithereal
closed
9 years ago
0
Verify scraperSync in phantom
#113
Yomguithereal
closed
9 years ago
0
Test scalability and load on Hyphe's url lists
#112
Yomguithereal
closed
9 years ago
0
Fix exiting
#111
Yomguithereal
closed
9 years ago
0
Limit issues
#110
Yomguithereal
closed
9 years ago
0
Cache the scraper for more efficient communication?
#109
Yomguithereal
closed
9 years ago
1
Service mode spider with event emitter consumption
#108
Yomguithereal
closed
9 years ago
0
Possibility to pass job-level scrapers
#107
Yomguithereal
opened
9 years ago
0
Access current job in scraper static engine
#106
Yomguithereal
closed
9 years ago
0
Privatize some spider methods through _
#105
Yomguithereal
closed
9 years ago
0
Possibility to pass url as object to be build through node.url
#104
Yomguithereal
closed
9 years ago
0
PhantomSpider
#103
Yomguithereal
closed
9 years ago
0
Paginate method
#102
Yomguithereal
closed
9 years ago
0
Spiders
#101
Yomguithereal
closed
9 years ago
7
Navigation helpers
#100
Yomguithereal
closed
9 years ago
0
Passing engine to scraper?
#99
Yomguithereal
closed
9 years ago
0
Scraper.run shortcut
#98
Yomguithereal
closed
9 years ago
0
Append instead of stream write.
#97
Yomguithereal
closed
9 years ago
0
Provide an output stream and plug result on it.
#96
Yomguithereal
closed
9 years ago
0
job:result before end-user events
#95
Yomguithereal
closed
9 years ago
0
Console blessed admin plugin
#94
Yomguithereal
closed
9 years ago
0
Previous
Next