skufog / libyuv

Automatically exported from code.google.com/p/libyuv
BSD 3-Clause "New" or "Revised" License
0 stars 0 forks source link

LIBYUV_WIDTH=10000 causes some functions to crash #239

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
set LIBYUV_WIDTH=10000
out\release\libyuv_unittest

Some tests/functions fail

Original issue reported on code.google.com by fbarch...@google.com on 31 May 2013 at 1:30

GoogleCodeExporter commented 9 years ago
LIBYUV_HEIGHT=100000 fails (SEH) on the following
[  PASSED  ] 632 tests.
[  FAILED  ] 30 tests, listed below:
[  FAILED  ] libyuvTest.I411ToI420_Unaligned
[  FAILED  ] libyuvTest.I411ToI420_Invert
[  FAILED  ] libyuvTest.I411ToI420_Opt
[  FAILED  ] libyuvTest.I420ToI411_Unaligned
[  FAILED  ] libyuvTest.I420ToI411_Opt
[  FAILED  ] libyuvTest.ARGBScaleDownBy2_None
[  FAILED  ] libyuvTest.ARGBScaleDownBy1_None
[  FAILED  ] libyuvTest.ARGBScaleDownBy4_None
[  FAILED  ] libyuvTest.ARGBScaleDownBy5_None
[  FAILED  ] libyuvTest.ScaleDownBy2_None
[  FAILED  ] libyuvTest.ScaleDownBy2_Box
[  FAILED  ] libyuvTest.ScaleDownBy4_None
[  FAILED  ] libyuvTest.ScaleDownBy5_None
[  FAILED  ] libyuvTest.ScaleDownBy8_None
[  FAILED  ] libyuvTest.ScaleDownBy8_Bilinear
[  FAILED  ] libyuvTest.ScaleDownBy8_Box
[  FAILED  ] libyuvTest.ScaleDownBy23_None
[  FAILED  ] libyuvTest.ScaleDownBy34_None
[  FAILED  ] libyuvTest.ScaleDownBy38_None
[  FAILED  ] libyuvTest.ScaleDownBy38_Box
[  FAILED  ] libyuvTest.ScaleTo1366x768_None
[  FAILED  ] libyuvTest.ScaleTo1366x768_Bilinear
[  FAILED  ] libyuvTest.ScaleTo1280x720_None
[  FAILED  ] libyuvTest.ScaleTo1280x720_Bilinear
[  FAILED  ] libyuvTest.ScaleTo1280x720_Box
[  FAILED  ] libyuvTest.ScaleTo853x480_None
[  FAILED  ] libyuvTest.ScaleTo853x480_Bilinear
[  FAILED  ] libyuvTest.ScaleTo853x480_Box
[  FAILED  ] libyuvTest.ScaleFrom640x360_None
[  FAILED  ] libyuvTest.ScaleFrom640x360_Bilinear

30 FAILED TESTS

Original comment by fbarch...@google.com on 31 May 2013 at 2:02

GoogleCodeExporter commented 9 years ago
Scale functions use fixed point 16.16 which overflows if integer portion is 
more than 32767.

Original comment by fbarch...@google.com on 31 May 2013 at 2:14

GoogleCodeExporter commented 9 years ago
Fixed in r712

Original comment by fbarch...@google.com on 31 May 2013 at 6:02