search

globalgov / manypkgs

Support for creating new manyverse packages
https://globalgov.github.io/manypkgs/
GNU Affero General Public License v3.0
2 stars 0 forks source link

Possible data size issue with code_memberships() #75

Closed jaeltan closed 2 years ago

jaeltan commented 2 years ago

code_memberships() and get_articles() run into errors (C stack usage too close to the limit) when used on manytrade AGR_TXT texts data, which might be due to large data size

henriquesposito commented 2 years ago

The issue here is with the get_article() function which takes too much memory (above the limit at times) when running on large text databases. I am currently re-working get_articles() to make it less recursive and more efficient. Thank you.

henriquesposito commented 2 years ago

I have been re-working the function in the past couple of days, and I think the memory issue has been fixed by altering how the function works. However, I still need to get the function returns as expected.

henriquesposito commented 2 years ago

The get_articles() function is fixed, I just tested in manytrade and all works on my side.