c2siorg / b0bot

B0Bot - Bug Zero Twitter Bot
MIT License
15 stars 14 forks source link

Added first version of database update script under `\db_update` directory #14

Closed CoToYo closed 1 year ago

CoToYo commented 1 year ago

Description

  1. Added first version of database update script under \db_update directory.
  2. Setup MongoDB Atlas database for cyber news storage

For now, Python package cybernews will be used for fetching news data from the Internet and to the database. Once the part of API service is completed, this part (news db updating) will begin by implementing web scraping logic based on the code of cybernews pacakge.

Related Issue

Motivation and Context

According to the new design, a separate service is needed for updating the knowledge base of cyber news.

This service should be run separately and periodically as a scheduled task while the API service is running continuously as web service for listening requests from users.

Therefore, a new directory \db_update was created for it.

How Has This Been Tested?

Screenshots (if appropriate):

News were successfully written into the database, which prove the functionality of the db update script works normally. image

Types of changes

Checklist: