yugabyte / yb-voyager

Data migration Engine for YugabyteDB database
38 stars 10 forks source link

[Voyager] Export data from target fails with log-level debug #1786

Open makalaaneesh opened 2 days ago

makalaaneesh commented 2 days ago

Jira Link: DB-13648

Description

[2024-10-24T09:02:28.405Z] 2024-10-24 09:02:21.073858 ERROR exportData.go:392 Export Data using debezium failed: failed to check if snapshot is complete: failed to poll for message in log file: error scanning file /home/ubuntu/workspace/users/yb-voyager-testing/yb-voyager-testing-pipeline/code/yb-voyager/migtests/tests/pg/basic-non-public-live-test/export-dir/logs/debezium-target_db_exporter_ff.log: bufio.Scanner: token too long

Possible solution - https://stackoverflow.com/a/21124415

Issue Type

kind/bug

Warning: Please confirm that this issue does not contain any sensitive information

makalaaneesh commented 2 days ago

Culprit line with a huge token: Note: it's the token that is too long, not the line.

2024-10-24 16:06:02,340 DEBUG [io.deb.con.yug.YugabyteDBConnector] (pool-7-thread-1) The serializedNameToType H4sIAAAAAAAA/5U9CZRkRZHVXUf33CfMcM2ACC0oXSNTrKAoIzcyKgoLIkfxq+p394c6kjp6ukcBD1BUBFzxYFXEc92nK6iIFyqeiCsrngirK7LognKJoFziZkRk/Po/ I/P3wHt0T/8fEZkZGRkZGRkR/zP354q9bm7V2cFsMDnoR83JY4PezMsDVRy741vf2fmsn+Rzo0fnFjc7QePooN7vdI/LLerPdMPeTKfZmFOHbcnp//K5beO5XEH/a/Tifm5RN5yqD7q9TlcTLkedyUZYC7dHg9ZkvdNuh0Bkcn4wHdTm+2GjNnmq+eeRh580r8J9Tvj+A9fduOqg0dzYcbnS2Y1a/biGbrLVaURTUdjtHZ fLd6LG1tySsBm2wnYfcPq552+NOmVuphw3Ux42U04386KtucVhe9A6OWgOwl4/t3IrMKAMDChvjXp9/b7QDlqa9Gp60wza0+UT+92oPQ24Kuiaxs/NnZ8rzKlcbuzX/9D/5XKlp5VKMkH/sbTaDac7KuwGulM9wMhr+J8R/PhH+EnhFPPkg0BhSQJHKQBZpJ+unq9VtwVRvxrO6g5UG2GvHhP8KaFv2l25AfXTZVU1Xe31 g36vGs717a6UV9m0yquB1tIkEvVlJRDTj3UrqtuZipqhjbpxoASMfrBnNWpPdbqtoB912tVefSZsBdV60A+anekqsNzu1OZ32JQ3XwKUNy5Ah/q5TkOO93uzKA82o5dvUMnX+t8rqppmGE23q/2gpsdkd6Zyud2ZyruAxvI0GrW9Qb8oqKA/Y7c7+lrFr/TvlZpFg17YrbYCpbR89cSEFpQLDKSsag+NO7r8Ra7BwqPd6N dzQEZAGmZqQRXmptodOAZcPkKIxJHQm1UCk8g+F8jORuG2arejV1M71H0OpoVwVP5ZuQH10/xcqxnD307wuUuVeaN/lbphvdNtiGVzM3XhIOgejIwkX6/Z6elQMGjin+w+TbyA2ZxCJKIvwMXT77UGzX7U1cpAyOn6cbtDq76IiyeJRMRepB/vxCtRr9Km1g/1MJqVvSx/QbD/OiC61oVMxA/TrxcH7XmjIAWX/kRgR4D4 aCqq04zq84IXDZV6r/8o6oUbCpVRWGU3kA9RuAGYWjoWkZu9cNpGzj8hVsapiAzAhLwVFhewyiysoC4YP3GM6P2xrHqGWETuBJQNvYD0oOCVFj6H0G++Qqic96Bs2IhE9CRUIkbMhKQfopKvTb/0FgWzrVWX6PtLlYCJFXdYbwa1sClX6UFCTP4pVtyMRJ09Uz9ez9Kj1fK03st71Xpz0OsnxI+pPKKywM1ywXfaOIhmo7 6QpPKnlAtMP9u5SnsDK22bITy9bxY7y/FAcicnNg1yBnWjUSxSiY+LSVqEk8QIRARUzRLdSEdNBa2oKdfIbsqCwK0e/3Zv9RPrBY1 ...................