Parsing of the history file contents needs dynamic memory management

[hariramt]

One or more errors occurred while migrating 'cloud_volumes_telemetry' : pgcopydb failed with unknown errors. Please contact Microsoft support. Logs from the migration:

 2024-07-03 03:36:55.649 76 **ERROR pgsql.c:3553 history file "00000307.history" contains 1547 lines, pgcopydb only supports up to 1023 lines**
2024-07-03 03:36:55.739 75 ERROR follow.c:1058 Subprocess prefetch with pid 76 has exited with error code 12
2024-07-03 03:36:55.744 77 ERROR ld_stream.c:2781 Failed to read stream context file: retry policy expired 
2024-07-03 03:36:56.053 75 ERROR follow.c:655 Some sub-process exited with errors, see above for details 
2024-07-03 03:36:56.053 75 ERROR follow.c:294 Failed to follow changes from source, see above for details 
2024-07-03 03:37:12.599 51 ERROR cli_clone_follow.c:763 follow process 75 has terminated [12]
One or more errors occurred while migrating 'metrics_collector' : pgcopydb failed with unknown errors. Please contact Microsoft support.

Logs from the migration:

2024-07-03 03:36:55.666 70 ERROR follow.c:1058 Subprocess prefetch with pid 71 has exited with error code 12 
2024-07-03 03:36:55.671 72 ERROR ld_stream.c:2781 Failed to read stream context file: retry policy expired 
2024-07-03 03:36:55.983 70 ERROR follow.c:655 Some sub-process exited with errors, see above for details 
2024-07-03 03:36:55.983 70 ERROR follow.c:294 Failed to follow changes from source, see above for details 
2024-07-03 03:37:03.492 32 ERROR cli_clone_follow.c:763 follow process 70 has terminated [12]

EDIT NOTES: please use proper formatting and split lines. Also, is it on purpose that you submitted the same logs twice?

[sharonl1970]

00000307.zip

File uploaded

[sharonl1970]

This is the history file that is compressed.

[kaman05010]

Do we have an update on the GitHub bug?

[hanefi]

Completed in #848