search

leetaizhu / libyuv

Automatically exported from code.google.com/p/libyuv
BSD 3-Clause "New" or "Revised" License
0 stars 0 forks source link

ScaleTo320x240 from 65536x256 crashes #410

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
set LIBYUV_WIDTH=65536
set LIBYUV_HEIGHT=256
out\release\libyuv_unittest.exe --gtest_catch_exceptions=0 
--gtest_filter=libyuvTest.ScaleTo320x240_None

filter 3 -    15945 us C -    15891 us OPT
[       OK ] libyuvTest.ScaleFrom1x1_Box (64 ms)
[ RUN      ] libyuvTest.ScaleTo1x1_Box_16
[       OK ] libyuvTest.ScaleTo1x1_Box_16 (514 ms)
[ RUN      ] libyuvTest.ScaleFrom1x1_Box_16
[       OK ] libyuvTest.ScaleFrom1x1_Box_16 (73 ms)
[ RUN      ] libyuvTest.ScaleTo320x240_None
TIMEX 681277.00 ms (681.28 seconds) (11.35 minutes), runyuv, returncode 
-1073741819

scale uses 16.16 fixed point internally so 32767 is the maximum source size.
either scale should gracefully fail, or test should limit size.

Original issue reported on code.google.com by fbarch...@google.com on 9 Mar 2015 at 10:19

GoogleCodeExporter commented 9 years ago 
fixed in r1320
values larger than 32768 return with -1

Original comment by fbarch...@google.com on 10 Mar 2015 at 10:31