Scrapmeister

Technologies

• Java
• Spring Boot
• PostgreSql
• Jsoup
• Git / GitHub

• Heroku

  On frontend (Angular2).

  Release 1

Release 1 should contain/implement the following features (in no particular order):

• initial db design (Website, Rule, Feed)
• initial MVC design (controller, services, repositories(models))
• CRUD for Models (Website, Rule, Feed)
• scrap one page
• multiple pages scraping (0 and 1 layer)
• export json , csv , plain test, xls, and xml (where all except xml will be done on frontend)
• Unit tests

Future proof things like:

• multiple rules for website