Intervention / image

PHP Image Processing
https://image.intervention.io
MIT License
13.88k stars 1.5k forks source link

Image::encode() leaks memory #426

Open itsgoingd opened 9 years ago

itsgoingd commented 9 years ago

Hey, I'm working on a batch script that processes lots of images in a loop, always crashing due to memory exhaustion caused by intervention/image. Here is a very simplified script that reproduces this problem:

use Intervention\Image\ImageManager;

$manager = new ImageManager(array('driver' => 'gd'));

for ($i = 0; $i < 1000; $i++) {
    $image = $manager->make(__DIR__ . '/image.png');
    $image->encode('jpg');
    echo "$i. " . memory_get_peak_usage(true) . "\n";
}

I've traced this problem to this assignment https://github.com/Intervention/image/blob/master/src/Intervention/Image/AbstractEncoder.php#L87, which I believe creates a circular reference between the Image and Encoder instances, causing the memory to never be freed.

Simply unsetting the $this->image reference after the image is encoded fixes this problem.

public function process(Image $image, $format = null, $quality = null)
{
        ...

        $this->setImage(null);

        return $image->setEncoded($this->result);
}
olivervogel commented 9 years ago

I would use destroy() to free memory in each iteration. Unsetting the image after encoding, might not be always wanted.

itsgoingd commented 9 years ago

That doesn't fix the problem, it still leaks, just a lot less. Better workaround is to call gc_collect_cycles() in each iteration, it's still just a workaround though, end user shouldn't be expected to do this.

olivervogel commented 9 years ago

So this seems to be a problem of the GD function. Or is it the code from Intervention Image leaking memory?

itsgoingd commented 9 years ago

This is an issue with Intervention Image itself (it can be reproduced with both gd and imagick), I believe what is happening is:

That's why unsetting the Image reference in Encoder::process after it's no longer needed fixes the problem. Unsetting Image reference in my client-code in that case frees the memory as no other references for that object exist at that point.

I hope that makes at least some sense, I'm pretty awful at explaining stuff. :)

abhimanyu003 commented 8 years ago

+1

kleisauke commented 8 years ago

I can confirm that $this->setImage(null); fixes also the problem for Imagick.

Test case using this picture (on the filesystem):

require 'vendor/autoload.php';

use Intervention\Image\ImageManager;

$manager = new ImageManager(array('driver' => 'imagick'));

for ($i = 0; $i < 10; $i++) {
    $image = $manager->make(__DIR__ . '/lichtenstein.jpg');
    $image->encode('png');
    $image->destroy();
    echo "$i. " . memory_get_peak_usage(true) . "\n";
}

Output without $this->setImage(null);:

  1. 6553600
  2. 11796480
  3. 17039360
  4. 22282240
  5. 27525120
  6. 32768000
  7. 38010880
  8. 43253760
  9. 48496640
  10. 53739520

Output with $this->setImage(null);:

  1. 6553600
  2. 7077888
  3. 7077888
  4. 7077888
  5. 7077888
  6. 7077888
  7. 7077888
  8. 7077888
  9. 7077888
  10. 7077888

But it still takes 20.45 seconds to process the whole script using the Imagick driver and 16.75 seconds using the GD driver.

Server details: Intel Xeon E3-1225 V2 @ 3.20GHz - 16GB Ram ImageMagick 6.9.2-10 Q16 x86_64 2015-12-26 GD 2.1.1 PHP Version 5.6.16

itstudiocz commented 8 years ago

Can this also be fixed on 2.2.2? It's the latest version for PHP 5.3, which we use.

derekaug commented 8 years ago

Ran into this when trying to batch optimize a bunch of jpegs today... $this->setImage(null); worked wonders.