dluxhu / perl-parallel-forkmanager

Parallel::ForkManager
20 stars 11 forks source link

Memory Allocate Error: #29

Open Sahilshetye opened 5 years ago

Sahilshetye commented 5 years ago

I am facing an issue for parallelizing an in-memory array of more than 50,000. I have tried using forks ranging from 10 - 20. This is running on 72 core dedicated Computer.

` perl

my $pm = Parallel::ForkManager->new(20);
$pm-> run_on_finish (
   # Some  code....
    });

SEQUENCEOBJECTS:
foreach my $rh_thisSeqObject (@{$rah_arrayOfSequencObjects}) {

   # Start the  forks....
    $pm -> start() and next SEQUENCEOBJECTS;
    # Parallel implementation of the code.......
   # blahhhh.. blahh...

   # finish logic to filter  some squences. for this  issue this can be ignored.
    # Pass  reference to includeThisSequence
    if(defined($includeThisSequence)) {
        $pm ->finish(0,$includeThisSequence);
    }
    # do not pass any reference to finish object so that  it is not registered..
    else{
        $pm -> finish(0);
    }
}

`

Sahilshetye commented 5 years ago

27 It is similar to this....