101Crawlers

Docker based crawler customization and monitoring infrastructure

Open source developing application.

Organization

• docs General project documentation
• butler Dockerized crawlers management system.
• site Distributed web system that serves multiple users

Butler

Butler has been built in java using the following technologies:

• Lucene
• Spring Shell
• Docker

Server side

The server side has been built in java using the following technologies:

• Spring Framework
• JDCB Database

Client interface

The client interface has been build using the following technologies:

• AngularJS
• HTML5
• CSS3
• Bootstrap
• Javascript & JQuery