One of the biggest real tasks of the Core (#2) will be recieving big data from any source and imports it to a database.
The source could be JSON, XML, ZIP archive, Excel or CSV.
The abstract layer of the importer should consist of:
Recieving as a parameter the type of the importing resource (e.g. json)
Recieving as a parameter the type of the database which will import into
A Dependency injection container for creating and forking instances..
An importer strategy for each concrete type
A parsing layer which creates an instance of the necessary strategy depending on the type then connects to the database (which can be any kind of DB that the ORM supports) and then kickstarts the import.
The importer should be aware of duplicates and any kind of corrupted data, so we will not import falsy or duplicated data into the database.
RoYaLBG
commented
9 years ago
One of the biggest real tasks of the Core (#2) will be recieving big data from any source and imports it to a database.
The source could be JSON, XML, ZIP archive, Excel or CSV.
The abstract layer of the importer should consist of:
The importer should be aware of duplicates and any kind of corrupted data, so we will not import falsy or duplicated data into the database.