run_synthea hangs when p = 100000000

synthetichealth / synthea

Synthetic Patient Population Simulator

https://synthetichealth.github.io/synthea

Apache License 2.0

2.15k stars 645 forks source link

run_synthea hangs when p = 100000000 #1515

Open jackliusr-synapxe opened 2 weeks ago

jackliusr-synapxe commented 2 weeks ago

What happened?

run_synthea hangs when p = 100000000. I can run it with 10,000,000.

./run_synthea -p 100000000

Environment

- OS:aws linux
- Java: aws jdk 17

Relevant log output

No response

jawalonoski commented 2 weeks ago

Did you run out of disk space?

At what point does it hang?

jackliusr commented 2 weeks ago

aws ec2 instance type: m5a.2xlarge os: amazon/al2023-ami-2023.5.20241001.1-kernel-6.1-x86_64 vCPU: 8 memory: 32Gib

speed of generating(patient/s),441
total record,10000000
total mins,22675.7369614512
hours,377.928949357521
days,15.7470395565634

jackliusr commented 2 weeks ago

Did you run out of disk space?

At what point does it hang?

No. I have enough disk space. about 1T. It hangs when generating around 100 to 400 patient as in my terminal console. there is no errors.

jawalonoski commented 2 weeks ago

I managed to recreate this issue pretty easily... my initial guess is this is related to the number of threads being thrown into the ExecutorService threadPool...