[FRG-147] varbinary input not truncated before storing

[dynamobi-build]

[reporter="kvu", created="Wed, 7 Jun 2006 16:31:47 -0500 (GMT-05:00)"] This query breaks sqllineEngine after the second insert (which tries to stuff a 8-byte values into the varbinary(6)).

CREATE TABLE foo (x int, y varbinary(6));
insert into foo values (1, X'1bad3bad');
insert into foo values (3, X'1bad2bad3bad4bad');


java: TupleAccessor.cpp:500: void fennel::TupleAccessor::marshal(const fennel::TupleData&, uint8t): Assertion `value.cbData <= accessor.cbStorage' failed.
_\ CAUGHT SIGNAL 6; BACKTRACE:
/home/kvu/open/fennel/libfennel/.libs/libfennel_common-0.5.0.so(fennel::AutoBacktrace::signal_handler(int)+0x29) [0x3b755]
[0xffffe420]
[0xffffe410]
/lib/tls/i686/cmov/libc.so.6(gsignal+0x51) [0xb7ea49d1]
/lib/tls/i686/cmov/libc.so.6(abort+0xe9) [0xb7ea62e9]
/lib/tls/i686/cmov/libc.so.6(__assert_fail+0x101) [0x21f71]
/home/kvu/open/fennel/libfennel/.libs/libfenneltuple-0.5.0.so(fennel::TupleAccessor::marshal(fennel::TupleData const&, unsigned char)+0x14b) [0x261a7]
/home/kvu/open/fennel/libfennel/.libs/libfennel_ftrs-0.5.0.so(fennel::ExecStreamBufAccessor::produceTuple(fennel::TupleData const&)+0xcc) [0x323b6]
/home/kvu/open/fennel/disruptivetech/libfennel_dt/.libs/libfennel_dt_xo-0.5.0.so(fennel::CalcExecStream::execute(fennel::ExecStreamQuantum const&)+0xb9b) [0x1ee55]
/home/kvu/open/fennel/libfennel/.libs/libfennel_exec-0.5.0.so(fennel::ExecStreamScheduler::executeStream(fennel::ExecStream&, fennel::ExecStreamQuantum const&)+0x45) [0xc1325]
/home/kvu/open/fennel/libfennel/.libs/libfennel_exec-0.5.0.so(fennel::DfsTreeExecStreamScheduler::readStream(fennel::ExecStream&)+0x4b9) [0xbf477]
/home/kvu/open/fennel/farrago/.libs/libfarrago-0.5.0.so(Java_net_sf_farrago_fennel_FennelStorage_tupleStreamFetch+0xa6) [0xb1270d38]
[0xb26c941b]
[0xb26c39cf]
[0xb26c39cf]
[0xb26c39cf]
[0xb26c3caa]
[0xb26c3923]
[0xb26c3c29]
[0xb26c3d81]
[0xb26c3c29]
[0xb26c3923]
[0xb26c3923]
[0xb26c3923]
[0xb26c3a7b]
[0xb26c3a7b]
[0xb26c1157]
/usr/java/jdk1.5.0_07/jre/lib/i386/client/libjvm.so [0xb785b00c]
/usr/java/jdk1.5.0_07/jre/lib/i386/client/libjvm.so [0xb7968278]
/usr/java/jdk1.5.0_07/jre/lib/i386/client/libjvm.so [0xb785ae3f]
/usr/java/jdk1.5.0_07/jre/lib/i386/client/libjvm.so [0xb78855e2]
/usr/java/jdk1.5.0_07/jre/lib/i386/client/libjvm.so [0xb78767f2]
./sqllineEngine: line 16: 15450 Aborted java ${SERVER_JAVA_ARGS} ${SQLLINE_JAVAARGS} -u jdbc:luciddb: -d com.lucidera.jdbc.LucidDbLocalDriver -n sa $
Terminal reset because sqlline crashed

[dynamobi-build]

[author="elin", created="Mon, 3 Jul 2006 11:49:18 -0500 (GMT-05:00)"] Khanh, please check, reenable, and remove knownFailure tag from test in open/luciddb/test/sql/calc/varbinary.sql when issue is resolved. thanks.

[dynamobi-build]

[author="elin", created="Thu, 21 Sep 2006 17:14:25 -0500 (GMT-05:00)"] binary values have similar issues of not being truncated when switching to java calc.
(test: calc.binary)

[dynamobi-build]

[author="jpham", created="Sun, 24 Sep 2006 15:02:34 -0500 (GMT-05:00)"] Note that luciddb prints out in hexadecimal (base-16) representation. In hexadecimal, each character represents 4 bits, so two characters are needed to represent each (8-bit) byte. Seemed to be working as of 7760. Perhaps it was fixed earlier.