search

ivylabs / suitecrm-data-integration

6 stars 5 forks source link

Improve Demo Data creating time #152

Closed fraserward closed 3 years ago

fraserward commented 3 years ago

Currently the demo data is. generated through multiple transformations during the setup phase.

Going forward, as more demo data is populated this process will take longer.

If insert into script are produced then the majority of these transformations are not required to be run by the user.

The only issue arising would be current dates. A small transformation would need to be run in the install script to generate current dates and place them into the insert statements. This would reduce the amount of transformation running on the users machine and improve overall loading times.

  1. The above will require a good amount of rework on many of the demo data transformations.
  2. A new transformation to be used in the install script to generate current dates to place them into the install script.

Planning required to ensure this will work as efficiently as possible and is future proof.

fraserward commented 3 years ago

Going to create transformations to extra the time between dates from the Fact tables. Then I will use those number ranges to created transformations that will keep demo data up to date based on today's date.

fraserward commented 3 years ago

Pull Request: https://github.com/ivylabs/suitecrm-data-integration/pull/158