Memory issue of steps 5 in ETL Script

[Ratanr]

Hi All,

I am executing the step 5 python ETL script and getting the below error.

when I tested the script with test data, it executed successfully but when I am running this on cSynpuf claims data I am having this issue.

I am running this on Intel i7-6600U CPU 2.81 GHz processor and 12 GB RAM. additionally, i have more than 150 GB space free on the drive.

Please let me know if someone has come across this issue while their implementation process and steps to resolve this.

Thanks in advance for your help.

Thanks, Ratan

[Ratanr]

@ericaVoss @ChristopheLambert

[ericaVoss]

I have to leave this one to @ChristopheLambert

[ChristopheLambert]

Have you created a .env file, modeled off of .env.example.windows, correctly specifying all of the appropriate directories for input and output?

[Ratanr]

Yes, Christophe,

it is created and I am able to run and generate the test data. This issue is only happening when I am running synpuf claims data i.e DE_1-DE_20.

Thanks, Ratan

[ChristopheLambert]

Can you print the entire traceback? The screenshot looks partial.

[Ratanr]

Hi Christophe,

here is the entire screenshot of the CMD, I cannot see any additional trackback.

I tried to run this on a different system but still getting this issue. any help to resolve this issue would be grateful.

Thanks, Ratan

[ChristopheLambert]

Is it possible you are using a 32-bit version of python that is maxing out the 2 or 4 GB limit of the memory space of 32-bit processes? In particular, if you installed 32-bit cygwin, I think the python that would be installed would also be 32-bit.

[Ratanr]

Hi Christophe,

yes, that was the issue. I installed 64 bit and it is working now. I thought I already have 64-bit version installed on my system but it was 32 bit.

Thanks a lot :)

Thanks, Ratan

[ChristopheLambert]

Closing issue as it appears to be resolved.