search

mecdcme / is2

IS2 Workbench - An open source runtime environment to execute statistical services
European Union Public License 1.1
5 stars 9 forks source link

Performance on contengency and matching tables computating #40

Open Nolife999 opened 3 years ago

Nolife999 commented 3 years ago

Hello friends

The creation of the contengency table calculation and of the matching table cannot really exceed 100'000 of records or it hit performance and memory problem.

100'000 of records is really too little for our linkages. Most of the files we are processing with linkage process would weight about 2Go and hit 10 millions of line.

Nolife999 commented 3 years ago

I will make a branch to make some simple tries on this issue.