Open GoogleCodeExporter opened 9 years ago
Superb report. Accepting and putting it on the radar.
Original comment by linas.vi...@continuent.com
on 22 Jul 2014 at 12:19
[deleted comment]
[deleted comment]
[deleted comment]
Oh, our datadir (/data/tungsten) is not symlinked. I simply edited
/software/tungsten-replicator/samples/conf/appliers/batch.tpl and set
replicator.applier.dbms.stageDirectory=/data/tungsten
Sorry for missing this on the initial bug report.
Original comment by disqkk
on 23 Jul 2014 at 7:29
Sorry, the previous commit message was erroneous - it was meant for issue 975.
Original comment by eric.har...@continuent.com
on 23 Jul 2014 at 7:57
disqkk,
I just found a bug in Vertica's ddlscan template and added a comment:
https://code.google.com/p/tungsten-replicator/issues/detail?id=895#c10
On other words, try adding tungsten_commit_timestamp field to the staging table
right after tungsten_row_id.
Original comment by linas.vi...@continuent.com
on 28 Jul 2014 at 11:57
Added. I've attached the latest log.
I even tried dropping the dropped column from the Vertica schema by manually
editing ddl.sql before creation, didn't help.
INFO | jvm 1 | 2014/08/15 10:51:07 |
com.continuent.tungsten.replicator.ReplicatorException: Invalid write to CSV
file: name=/data/tungsten/staging0/drop_test.table1.csv table=Table
name=drop_test.table1 (Column name=id, Column name=col2) table_columns=id,col2
csv_columns=tungsten_opcode,tungsten_seqno,tungsten_row_id,id,col2
INFO | jvm 1 | 2014/08/15 10:51:07 | at
com.continuent.tungsten.replicator.applier.batch.SimpleBatchApplier.writeValues(
SimpleBatchApplier.java:981)
INFO | jvm 1 | 2014/08/15 10:51:07 | at
com.continuent.tungsten.replicator.applier.batch.SimpleBatchApplier.apply(Simple
BatchApplier.java:337)
INFO | jvm 1 | 2014/08/15 10:51:07 | at
com.continuent.tungsten.replicator.applier.ApplierWrapper.apply(ApplierWrapper.j
ava:101)
INFO | jvm 1 | 2014/08/15 10:51:07 | at
com.continuent.tungsten.replicator.pipeline.SingleThreadStageTask.apply(SingleTh
readStageTask.java:768)
INFO | jvm 1 | 2014/08/15 10:51:07 | at
com.continuent.tungsten.replicator.pipeline.SingleThreadStageTask.runTask(Single
ThreadStageTask.java:501)
INFO | jvm 1 | 2014/08/15 10:51:07 | at
com.continuent.tungsten.replicator.pipeline.SingleThreadStageTask.run(SingleThre
adStageTask.java:176)
INFO | jvm 1 | 2014/08/15 10:51:07 | at
java.lang.Thread.run(Thread.java:744)
INFO | jvm 1 | 2014/08/15 10:51:07 | Caused by:
com.continuent.tungsten.common.csv.CsvException: Attempt to write to invalid
column index: index=6 value=test2 row size=5
INFO | jvm 1 | 2014/08/15 10:51:07 | at
com.continuent.tungsten.common.csv.CsvWriter.put(CsvWriter.java:421)
INFO | jvm 1 | 2014/08/15 10:51:07 | at
com.continuent.tungsten.replicator.applier.batch.SimpleBatchApplier.writeValues(
SimpleBatchApplier.java:956)
INFO | jvm 1 | 2014/08/15 10:51:07 | ... 6 more
Original comment by disqkk
on 15 Aug 2014 at 11:00
Attachments:
The issue is that the javascript filter drops the column data, but the column
spec still contains the original column index which is used as the csv column
position. Attached is a patch that uses a simple incrementing column index
instead of the now erroneous column spec.
Original comment by hellosi...@gmail.com
on 4 Nov 2014 at 1:59
Attachments:
Original comment by linas.vi...@continuent.com
on 19 Dec 2014 at 7:03
Original comment by linas.vi...@continuent.com
on 19 Jan 2015 at 2:18
Original issue reported on code.google.com by
disqkk
on 22 Jul 2014 at 7:50Attachments: