kevupton / phantom-crawler

PhantomJS Web Server Crawler
1 stars 0 forks source link

PHANTOM CRAWLER SERVER

Easy web-crawling using HTTP API server.

INSTALL

npm i -g phantom-crawler-server

USAGE

Execute command to run:

phantom-crawler

GET

Get a specific page

METHOD: GET
URL: /get/:url
RESPONSE:
{
  status_code: 200,
  data: "<html></html>"
}

DOWNLOAD

Download the active page

METHOD: GET
URL: /download
RESPONSE: content.html

DISPLAY

Display the active page

METHOD: GET
URL: /display
RESPONSE: <html></html>

CLICK

Click on something on the page

METHOD: POST
URL: /click
BODY: 
{
  query: "#someQuerySelector"
}

FILL

Fill out some form inputs

METHOD: POST
URL: /fill
BODY: 
{
  inputs: {
    #someQuerySelector": "value"
    #someQuerySelector2": "value2"
  }
}