insongkim / PanelMatch

113 stars 34 forks source link

Refactor PanelEstimate calculations to handle large data sets #47

Closed adamrauh closed 4 years ago

adamrauh commented 4 years ago

The procedures within the handle_vits function do not scale well to large data sets (about 1M rows in original data is the max). Currently, I need to create a vector that is (N * number of matched sets) large, which breaks when the required size is larger than is allowed by Cpp/system restrictions.

adamrauh commented 4 years ago

Solved here and patched here