[destination-kafka] Json Expected space separating root-level values

[techtug-a]

Connector Name

destination-kafka

Connector Version

0.1.10

What step the error happened?

Other

Relevant information

Hi Community, First of all thank you very much for this great Software.

Airbyte = 0.50.49 Source Connector: Postgres = 3.3.13 Destination Connector: Kafka = 0.1.10 Kafka Version = 3.5.1

Issue: Mar 22 12:39:39 fraubuntxkfk01-int connect-standalone[1730541]: Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('d' (code 100)): Expected space separating root-level values Mar 22 12:39:39 fraubuntxkfk01-int connect-standalone[1730541]: at [Source: (byte[])"0de3cc9c-c90b-491a-a505-76ba0c2cc01f"; line: 1, column: 3]

At the end of the JSON string seems that the airbyte_ad_id is appended for some reason, causing the export from Kafka to HDFS to fail because of unexpected character. Any clues why this could be happening ?

> cat 00000000000000000000.log | grep -a '0de3cc9c-c90b-491a-a505-76ba0c2cc01f' �a���f,���f,�����������������H0de3cc9c-c90b-491a-a505-76ba0c2cc01f�{"_airbyte_ab_id":"0de3cc9c-c90b-491a-a505-76ba0c2cc01f","_airbyte_stream":"project_containers","_airbyte_emitted_at":1711111176700,"_airbyte_data":{"id":"907fe8ba-968f-413c-bf09-217bbdf2363c","name":"","name_token":"DAMPEOXX","status":1,"storage_location":"de","language":"eng","team_id":null,"creator_id":"ca3bf732-a8ce-464d-8944-12b7be1989c3","tenant_id":"73844545-1e8c-43fb-9862-1ca0246f4353","ip_filter":false,"portfolio":false,"require_2fa":false,"reports_service_schema":true,"hide_index":false,"invoice_unpaid":false,"ocr_quality":false,"print_cover_page":true,"unpaid":false,"canceled":false,"total_users_limit":null,"per_file_size_limit":500000,"project_type":"custom_room","watermark_lines":null,"tc":"{\"pages\": \"2\", \"status\": \"converted\", \"version\": \"0864e35b-5344-40e7-8501-0806ffe79124\", \"extension\": \"pdf\", \"file_name\": \"terms_conditions.pdf\", \"created_at\": \"2017-12-12T14:31:53.588Z\", \"encryption_key\": \"", \"encryption_ivector\": \"LFS2F6vdAAj_H05Z6rzdnA==\"}","enterprise_since":null,"deleted_at":"2019-03-28T15:17:27.060700","created_at":"2019-03-14T13:44:48.388990","updated_at":"2019-03-28T15:17:27.060821","skip_watermark_non_convertible":false,"kms_experimental_features_enabled":false,"enable_special_settings":false,"excel_viewer_enabled":false,"project_manager_id":null,"erp_project_id":null,"hard_watermarks":false,"comment":null,"contact_email":"","show_contact_email":false,"enable_document_entities":false,"customer_id":null,"bundle":null,"origin":null,"bundle_since":null,"contract_id":null,"dcc_document_number":null}}*���5�f,���f,����������������Haa70d6c3-4b94-481d-a2a0-7d0f12a1f638�{"_airbyte_ab_id":"aa70d6c3-4b94-481d-a2a0-7d0f12a1f638","_airbyte_stream":"project_containers","_airbyte_emitted_at":1711111176700,"_airbyte_data":{"id":"14bb579f-6267-479b-b97a-3a77674a3d30","name":"","name_token":"UQGMDRGL","status":1,"storage_location":"de","language":"eng","team_id":null,"creator_id":"ca3bf732-a8ce-464d-8944-12b7be1989c3","tenant_id":"73844545-1e8c-43fb-9862-1ca0246f4353","ip_filter":false,"portfolio":false,"require_2fa":false,"reports_service_schema":true,"hide_index":false,"invoice_unpaid":false,"ocr_quality":false,"print_cover_page":false,"unpaid":false,"canceled":false,"total_users_limit":null,"per_file_size_limit":500000,"project_type":"custom_room","watermark_lines":"020","tc":"{\"pages\": \"2\", \"status\": \"converted\", \"version\": \"c50bc603-2a3c-437d-a33a-dddc649e651c\", \"extension\": \"pdf\", \"file_name\": \"terms_conditions.pdf\", \"created_at\": \"2017-12-04T12:09:52.264Z\", \"encryption_key\": \"", \"encryption_ivector\": \"j45ujxHgsErbva1ebspbVg==\"}","enterprise_since":null,"deleted_at":"2019-03-28T15:17:47.585652","created_at":"2019-03-14T13:44:48.388990","updated_at":"2019-03-28T15:17:47.585722","skip_watermark_non_convertible":false,"kms_experimental_features_enabled":false,"enable_special_settings":false,"excel_viewer_enabled":false,"project_manager_id":null,"erp_project_id":null,"hard_watermarks":false,"comment":null,"contact_email":"","show_contact_email":false,"enable_document_entities":false,"customer_id":null,"bundle":null,"origin":null,"bundle_since":null,"contract_id":null,"dcc_document_number":null}}�

Relevant log output

No response

Contribute

• [ ] Yes, I want to contribute

[marcosmarxm]

Thanks for reporting the issue @techtug-a Kafka is a community connector and it isn't in the current roadmap for improvements. If you want to contribute fixing the issue please reach me out in Slack so I can provide you instructions to make the contribution 🎖️

[techtug-a]

marcosmarxm

Hi Marcos, Sorry for the late reply, i was OoO. Couldn't find @marcosmarxm in Slack, can you provide me your nickname there please or contact me under @techtuga. Thank you

[octavia-squidington-iii]

At Airbyte, we seek to be clear about the project priorities and roadmap. This issue has not had any activity for 180 days, suggesting that it's not as critical as others. It's possible it has already been fixed. It is being marked as stale and will be closed in 20 days if there is no activity. To keep it open, please comment to let us know why it is important to you and if it is still reproducible on recent versions of Airbyte.

[octavia-squidington-iii]

This issue was closed because it has been inactive for 20 days since being marked as stale.