search

bajdcc / box2d

Automatically exported from code.google.com/p/box2d
0 stars 1 forks source link

Stack overwrite in b2CollidePolygons #312

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
No steps, sorry. One time exception in release mode, so I don't even know what 
input data was.

All I know is that I've got stack overwrite in b2CollidePolygons.

The only way this could happen is if b2ClipSegmentToLine overwrote vOut[2] with 
three elements. While not possible with regular numbers, maybe some combination 
(NaN? Inf?) can lead to three elements being inserted into vOut...

Another possibility is to blame compiler optimizations that use SSE2 for 
floating point operations.

Using Box2D 2.2.1 (official). OS Win 8 x64. VS2012 Compiler injected security 
measure (a cookie) looking for stack overwrites. It detected a problem and 
invoked __report_gsfailure which I guess terminates app.

Original issue reported on code.google.com by exif...@gmail.com on 6 Jun 2013 at 1:03

GoogleCodeExporter commented 9 years ago 
Not much to go on here. Be sure b2_maxPolygonVertices is not exceeded. Also, 
try running the trunk (pre-2.3).

Original comment by erinca...@gmail.com on 28 Oct 2013 at 5:55