Here are two formats I believe we could use to communicate with a json file:
The web scraper automatically stores the scraped data to the postgresql database in its own table and then the backend retrieves it through a simple query to that table. Scraper has write access to that table and backend only has a read access to that table.
Backend has an end point in the RESTful services to recieve a json file and the scraper automatically sends a post resquest to the backend.
Here are two formats I believe we could use to communicate with a json file:
The web scraper automatically stores the scraped data to the postgresql database in its own table and then the backend retrieves it through a simple query to that table. Scraper has write access to that table and backend only has a read access to that table.
Backend has an end point in the RESTful services to recieve a json file and the scraper automatically sends a post resquest to the backend.