pingcap / tiflow

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
Apache License 2.0
430 stars 286 forks source link

Bug in TICDC v7.5.4 version related to binary fields #11771

Open lee1988well opened 1 week ago

lee1988well commented 1 week ago

What did you do?

TIDB upgraded from v7.5.3 to v7.5.4 TIDB从v7.5.3升级到v7.5.4

What did you expect to see?

The content saved in the blob field is information that has been compressed and then converted into binary. When this data is sent to Kafka, when consuming Kafka messages, it is decoded through ISO/IEC 8859-1 in version v7.5.3, but it needs to be decoded through UTF-8 in version v7.5.4. There is no explanation for this in the documentation.

blob字段保存的内容是压缩过后再转成二进制的信息,这个数据发到kafka中,消费kafka消息时,在v7.5.3版本中是通过ISO/IEC 8859-1解码,但是到了v7.5.4版本需要通过UTF-8进行解码,这个文档中没有任何说明

What did you see instead?

Do not upgrade for the time being. 暂时不进行升级

Versions of the cluster

The current version is v7.5.3 and there is a plan to upgrade it to v7.5.4. 目前的版本是v7.5.3,计划升级到v7.5.4

wk989898 commented 5 days ago

Which protocol do you use to send to Kafka? Canal-JSON uses these two character encodings both. https://docs.pingcap.com/tidb/stable/ticdc-canal-json#binary-and-blob-types

lee1988well commented 5 days ago

I am using the Canal-JSON protocol. The problem is that the same data is decoded using ISO/IEC 8859-1 in version v7.5.3, but it needs to be decoded with UTF-8 in version v7.5.4.

wk989898 commented 5 days ago

Could you provide the data?

lee1988well commented 5 days ago

create table tab_test3( source_id varchar(300) primary key, api_data longblob ); test.txt

wk989898 commented 4 days ago

I can't reproduce this. Messages encoded through Canal-JSON are the same in these two TICDC versions.

{"id":0,"database":"test","table":"tab_test3","pkNames":["source_id"],"isDdl":false,"type":"INSERT","es":1732180083113,"ts":1732180103973,"sql":"","sqlType":{"source_id":12,"api_data":2004},"mysqlType":{"source_id":"varchar","api_data":"longblob"},"old":null,"data":[{"source_id":"0e9c92434c54f4a3f2bb860d37835dc4:7ce6bdfc1d5f5f490b6033af263c4a91:0","api_data":"H4sIAC7mImcC/02c25EsuQ1EXVkDdjf4ftii0Kf8d0HnsAj2XUkhTU9PFQkCiUQC1H/+Sf+mnPIYtayWUp219f33X35cZt279Fzq7DmP2v/+yy+3MWerM5XCn9Q5z6el5jFHH/756nOU8ylPm2mNVlPeee92n9sKz1h1F37Jr77n1p7m2KmnlnetaXwvm3ntNnZeq/U8x33ZGPxnlpbL3rmX+9w69ho5rTV2zTyl3eey0NRWXqm2PMv33dzYE/sanW3vMe8j2mw+dtbONur8npDZW+o8Y042xj/3EaPxmzVHWrmUVb4VY72xclsYoXZsd+1Q8kx1j9xY7+rfA9Lco/c9a2lp1prvx9p7rJLG4Bk+6u65lZ4SR9RbLbmeD1OffS0stHru/DCuIVLZBUtu7MOKx2fgtLHPbMkn81ff3oZbGKXN0cbiqL4PsUodM/PMkmaP/U5elMZivSxspmuczJ588qplVH66S6hpld5y4pzLPg/245l7wxd2KYnz6PlbWF2jrtk72+Ksyz3l3GeptS4cY/R6N5FLXrU2HBOH5PfX+TYHO1eZbe0aVtAT8JmdWll55OuSHT/eo2L8lebkZL8nrMFPuSYOh9XeAGCxPI1Tcwd11Gv01obb233gLhjr+zRVDDt384V97nrN01diS2UsHpHCUxceV1jpXrvUtss9H76L97PapanX992u72x8e+Cp5Tp1bvgLsYe9ceJa44iweZ6sumG0z6t1Sf6eJWQfS8DM6329sbSaOSWcAIN+Bu6tVF45+mZdbX9briOvNvDo0TXEC+S0Wegui/Aiiu7RYxbiBQ8uI+3NUj8L8yw+bpzG4Mn3iHUHXLXx5NpzLK1iAUKZB+GvfPvbBWHGw0AE8GPep9bBhkEGwiXXiDY8gefNRlQNP46n4nh4bl3L41zPq3kd/geMsOl+Y7AVcANPxDB1tzg2PApXwxJgQcJPPuOw1s1xJ3xzDJwiPi0gCO4BJh4o+D5lqyAJR1Fd2/Udnpv0DmFjElsBRg1U1qfSTJzGfQQHIHid8NhG8rfnjrVx3yQ2sLiIAZ7Av/YkRjHWCqAkeNggIQAut+t+hFbS2nMTiBsMuQ/uhI6wTiSC8TfiCrG2Z3Y1htJ1qSHGEoTdHLFvbOWx2gI2BAQsH4vwY/yao+RAq1b7wG+JGSuDwXjUBb/kVpfmTXg2LtPvQbMFPA/zTl98PjyIONMBnl7m3Zw/gd2ZE27zbPnLREBz18CtC0tvZYQ88UMOMKF9a2h4ZNqVjLEK0B8o03S0Mj13PDs8GCwDpkbF0dhzCbtnjDgT5jTXvizAd/GV3ckD7DmSGaC6To5K2uwzO6hBdBLQq5ttbzYEDQ1KtjXynNeQY7AHPJNzxrrl2wMQxbkuIgMP4qy/jQH/JFTwBJwjydysCcoSk70ABDkyVjHMCfbO6kxmdwGgFsDAyrLJcNwd8AELByyILpJLy3HCJHrPEQvz+HmdRGDAp8EozFnT3QUY1oVpcJ0Vl4jO6imDfaQkbHTjrZLCQAjMA3DcIJwcTRUM8NaSv4VlHIzEBBno5tqXM4lSnoeXktp6u5sADk1Mk5whSMXp8DIoCGQBU5KivjyWcQKOnIWR6TsZMdxJikJwsXPS6b5JhH/Xs2U9M9yfjXGO4Pn5pz7H4btYkQXggeDCC5ZGHMLEOHectdytkLwhKoDfrC89kWcO1JFxJAqRYaEI4AvYUOAlN6rwdKKhsTPZxW9zOK/cBkRsZtr7XbK1ryETzIJb3CSNsXXLhJE4pRtAVe/HRON4702bOB2gug6b5LS+cyPclx6YTfQz73Ao/4Uv823yUL74koQM1sVDZZDl8smiRxZxj/jLERZsjocfFsaiS8QrJ4OLwWQAEnz58hKiuuETWXPwmwsl5OzuoWXfOG+ex3fkCQAqzrV/yaUKIrwPR5mRCnnb1EPEOHaZ93XrCt3hfDh13rhXkCMWyQJMth5+sFoOj6cAlF221u7RceTgjSdcDJ3Pml1EJrEAVd3nRjbLUjDWSgyxvDAyzxWcNmfIa3ubgXPys6Gr4Rr7ejFrGMYmi+ZELh7IVfnDfQghf3WJFz4JsS+m8bkvqOJVWS4EteZtl2AVUz1n51mTiCJhWI8sUC3jKEAmZxNGlvZNrM/rOJa7Mj7CmBhq61ffgyFCZCDYjXG+8yP9bAP4xcz5lBXferUPxjfnCY9BeWBeEhme0mVD4fBi5za3QHF37MOzk5sAjaWXd3L+adOPMH6QfgINrsNDYIVwwojwk7PkOK4xArxIjUoDl4nfGXTBuACdyWe8SqNGpdNEcHkExilr34qEwsDgIpzGWkEigM4KrTbF7XgAXJc45EBgZBnTX8aMM4lFhB6767ca0FYJd9pauYwRvKBakOxDp3HtIIrtnAZLAGDb40KEBQUfa8ZZX1EEcCaJHnhHrEeiJj+aX0AQzHwfIJPDQ8zgTaYY7mupWDkeGWwgB4dpxlsHsNu+sYXznMTAf1On9BEOLLvbxD/xZEAFoAgp1muEIyAfxBYcyqLbwnQrXLVjLR2HXzTP7hZFRCxpVmStxOkItCQKTCZF6hyHDARM2McQteu8RZz1MG6un5BmewubHYpGCq4yvh48mCIiERnToivINavFOoBow136LUh4DxFjusSgAONdGDmA8wbpSD0S/cA00hJc0RpqC+mXhmRFAiGQj9LbhWC5SQ44Mbyt1gg5i7OsO0ExgmpSTZEczJJG7o0tKDs1IeihBNBf6VypG4okEvuYuL8VTzkir6G2ozS4B4RfN4kA5GfXFXmAP8UwOnDzMRGG5yfQvZMDiaOXrZOQBgZPEkHK6+kbPB6eqEqS6y0IWL7KAq/YLjJqiqY8cbZMIQ2A3YWQvwlPznWaEu6i8RrWK5s/ma1dVoj7TCv7w505qfFqGEEfgJAGjutsxRKIHAyugZo3lnkgzAIfYgly7PC1NiQOYD77DxpsEFDCEBaAU0BwpwoEugCNr4S59MJgt2Lbru1CRDriDSWix5meXiAAGFj+ckXtYS5lP0S+hVfgtRwJpMFABO6M3IcD8g6iqp4yPihrNWWZMeBvuNctn6dZj8AHJYSZOOVtqY5nwYvC5kCnlALcwWX73QKHjZ0sYKQhNwrBWDg5LyRcYULHXNSrvGOZdlXWrmxj1U05jwVlFjcvQDyXRKxZVREFEa2AM5tqxmAJyg76qNZgclCHvB6GPfLMwR5iJkoRSb8qnu4M2/hAUgfEnbC/VcqtDrLqiHV4dyVBguRMpJMhUwy8sKggvARwU/0lTJjV8CCwYQumjKc0yMQrQWH83pxJymdZlgEHO+7ZElx4JRFkQl8Rllism2UgsKpS39twC7wZfMO792Mk7HXIoXV/wvjoXN8jyAA+Mqv0UFQ9sY1qYnPIBCbg20Iqs8DQOu4x5BWLeRAOhNqrp3DHcyzElzrLwgd/SRoHW0fogTe/RMQBQxaElMN9XsYBL6AnwyX3sGe22MPRpP7KJN8xaXJRqh5IvJXOVheRNxYLoGAP5OhtjobZwtBjweAbFlV6Fcvni5Stk2EIVvPA7BQZvnJTrUjMvtOb/kPyHaRCAeI7UkgZDgFgD3XGEXkIIAB5RQxr5Jumcf+uuwtp7aZYIoXtYyFe2C1mA1Ct/vki/svZ7qBtgIDkQ7mhRHabCkqYkgDJLvB+yvvWUX+SsPUHs0lHxYOdl+AwTe0oHVkoYeXgxVsJQhkNngtF2TdjlQn8E24SixudqsWYrB6dasRydQbMJRzJm4IbcXCWT5wwhW57iUjhW51KMWeqX1/uKLhAlJWYx4Hvy4xNxpJ511lW1OVwT+p86n1XEqyLOh8s5Y34T//RmAFBwydFENDiHqikfyqoKf9c0a4qDgJ2/AUcqUbSW82K3L9Qy74vU45iw6RC4mn2FQCKKxiqR5anrnwxqijLt/gdbC2qKDO1uiyRsKymguF3jGRZjNGsbIPuYiAxIrv5yER1yWxxL4lmyo8tcDykZJVgQPNqnbIBJS9SmSV7+zkxIAPwUi6TvWIjljWUMxAl6u+7NFzSbE5mIiJn7K7qeYpopJaoqttJz7A3Hr8VaEMWldV4kBDqW5azVPNFNjvhxRHiQH6WC4kcTxIiwUPwYHlkWBBihiKpEqeWobibZwg9lLEya00ZkYH7C+BwKaOxBZsDLP0U59Hbcn9a1RQcoHLjLObyNha85MusQRYaVIFST2muW4ym/D1ZTQh8OOo37vVsDh9qqpFKSdGH4AyJJEJbQWjPW7oAIafYmhbx5VaiHPo2KzcWteZrFFmmQIqqUS+PjjQl/4SBwCpWyS9ui7SzqVjs0ymLj/keFsYecPmb0k6Rq+ZFKs7Bog+ECmhKIbPkVzcARx5xlz1dPAGOOB1S7bDpFjL5V4ob8Muq6ip02KAf/VXSUXY0zNRpCW8wgqWk0AW6monCyyYpPta2bD4Nw4hC4/JUrGAL0FYNNn7Bpgk4HSrR3J+mn+VJ9UiflF0jhHYeaWzL0EkGUSDYOCknNi1ILn7Kj7AteaUqqsVyk+Q5WbJZn0YQNxWmrbKgd0bAZ4sxIxBIw/9CT5yqr5i3qK1H9sX35Ayf5Bsu2Y/KZw63f5ne63CYbWPC4mE/+XIdocigkJqFxK1AZKMJ4EqvHdMgU7zmIESNfg7W5hDBZJzCYuqRpNOJpIKzkXHJjPLiEfZXcw+3dGereDuckB1Hj8f6uinOQcFUhS48kWpsw3EIyv1PiGa3BBl4ZeaUVL2DG1JECXexAxO1d1dlwPNshEWLJJ+mLKUA66ZQvFbjVZRkSk1boaj8Ysgu6mI1uERYWHm2bJUGAv9yYzuqBDE2UHrMT6jvpKtp3QRHbxfRxrJbBxIRXT8Fi5VPe2M2WGwfP+EGrMfs6n7tcaFM0bplaQYIGSaHOsIpKu9MJdK3Zer3rfoFjlp9BKTV093rhxfYjb3SqJWSPSgQl0Po0RlgSVW5UQgMXO1yUJ5eT4ba0UjLpw8i0cqXo0szDpyaSMpTR07zy9aGZGaGT+G1dhTIb/U0ta92LXHnR/IIkbjy44rk/iaJ8H/VaMFaFU5FBSuQ/svTlmMECC7cA66p9vBHE5Q6+nwqI45C0rMXRYyU6NjK0+08bzvoL9NbrPM9i60LEbZVwb9phuT77ygs4Zu99yle37cBR1I3MR/PXBFGeI59buxtk7wHUzQNDlkk1nng1UUIDOEUw+WqpDZp1JAeUc7t+CbJolgWycLTDUTeqr1NhRUb5ec5dR2+cmB7Bd0F9KbFMcm/9Rg3yHZki41qIOX1uMkGRhDBNvSK6ICpBvAn0Kxu1/M1SJaxBXLhDq8PAcRZAqnkU360X7iYq5vMqwXyVLNuX19sWE5fPKkafVq32SW5hRhJOFszLOX+iHlVZIy47Nli4gh5JweG4Wk/+TabysndgDcnh5GuhlbtQ9ZPsjU0b9ozWJxNsEYb9TFg/pqiTCHM7vzNprgDXlZtkqz5K2lOR9XGYT91xU1Qu1i3cpQWABdhKBgECKsJRfL8OslqyZzNdsjg0UnljHp8qZjUI9HbsuPt2yfUeuPYWLC/UKyh3siCZuFsYJjVHnMkKPKweL+pEtYfuIxtTG9THWPfyh7eoObo1ENXlZyPiNvp7aq1Sm4r6k6p7rbNYmVyHZAU049fle0Ix+t7OD/iseAYrycOoOL/nqidlqfEWT8RaeqZh/aH5Q4xMEcu51sei5YWaDpbtsEN1E4ogZyacFOhO0/3Suqt9mHi/HuzpFALyAZSGK6ZYtVNuqVjaLPmAugGGAaNzekpUFXfghg7f9NCBGuKtsXe+SYjBNvc9ubNZu0Y9DqsjVHVnq3i/3qm0H4V/318e716CYgk4oVBUTq+TAXYsDpEZL1+kbmpC7N2ajnH23IoLAj3wz1V/Gc0gCx7THUyqLGi72EH/vBz67AQJLEvzGmoDuUYqOAtrFQjO3v0Jj26zfeTr5vs+NlXSUTV1EmvWoO+1X1aOqcKancqo7dDB8HyJQd9vYHTIVoSGRh1b8FFyhGTFZjwebz3Enr1gk9rreP102wLHD3UpL2f/FEPFS52G/O8Fa1TFnzHthVO+aYO8AO/XM8IxJVVq6ozZITUbMfoeTbnQ33LYQO5hHMkdmWe5DjYoRElUo/xbXwSNikWfIo1TM8Lu4T6xqJMwZkwnjvtJD3CmU7pql3lsjeL2xLetsf0/fQovdLAsEzcRl30VHx/8kzNt9/SlF8kgM3Rtnk7wucFovCZ3+mBNDbLz2ygInM9UPNF3Rnrs7gDafbVQakEHAmzEeo80455BMFKaZLv1ju1AkiyCx3iMNU4DhdFYCpNqc8EhC1lpCyjBjD3zaHT4S6VU2d11rNDGfIofE68iIyfBP0t8Gf7lS2Q34GSM3TQK3kkuAjWLVZXivP1j9qREC/lEOShCh4lMI6w1KP4RYm+DK85Lmj81NAXTndBlQZLwrZ+6sBSqYU6lxxPtWK0KdznaUaGq7nRznNx69MBvgWWYhgpFG6gt94TtZdVTew200gu5bUdeC7IvaUeIZKqnDv54vSJPvswMDliJd9hw70+Raw7vOYMDnj5COpSDsWnlFxu43UeJM5n4HOHSuLsA76bTi9SUeNygW3QOQOxraMD4OU8QIEjT/Z+o2iCeDjVpolKaj/Ncip02Mhp4xO9Pz5MEUpBZ0fJiYeb19RW7V7ZXo4ZICdkBBXwcMqa4n2QCVsvpuQnpttrTvbuMLF93RugDi4a9pxU7lF5WSXjHrJQW2LRgGlnGHVZrgxVwKu+2Z+Tvi5dd8agF34J1ipQ9iviJMMQ7CRCkjAfX1XiIjFDiNRd73eztZYyHfSDIK0j5jjtKgjlmvg+WH0M1Fl6d24x2XPEIbsZhuyru2ySYIHG+6SPd2oPt7YcU2OCkbdXMjkziKfa2pM+vIljaSjJSiL36lI2T4Gu8+C3FoglGqeOck1nAmx9xyFtW3/OfjbnokJyrOrFyZESDRIKkfIv52Sry8DroeA6gdyUqIcDM9FKEQLt+ODkpNMIffnbPhOpw17pqzkA4zK/UaXHBdMRnXEBEHpdI6u09FMPkWFHNBeLmdI+z7L0TU8uTk6OyDlgrzO0q5PM8lEBxYbyuD17Whqo2LGL2VG4tkMxamYpJMNsM8EGCw5vYrizrtgv68KOcBG7AWwESjb7z2kTeL0B7NMmte6RIcXgMuXUGVVtHx+M7eE58DtJnydy7e6XHPGQVr+wtc5ir+206GMs8YwzF3X33J4KTQ49TiXnM3XnN3VZdZVs/zzdEREHOxwvVYCe74jgQhTt9ehP2XGOyzpNzLqEdVWLB2wHEPEd088ZGTu2EZVxaYJ8zXcS2VWSu9xGjWBuzjJOyYiq81Oe0lGP7WGx7sfMTERZH1ZI30HBbCVS/hZRo7W9fuN09YC8c0Or/Nn0lnNSjLyhIYoB63KLzn3aofd1oocSuALda/QOm8qlnjG90a/UUQQC206nJn9pqpm5sjWBXcXLqiCscLDpNKhz7z9Fyj4pR+rQVonGj6MoZOqq/kGY/Pod9YysSVTlbq+DZWE6lbugRrPN51T+ufC+neUL+dSJNruQQ6YaRnaa1SkE80GK0uAUIF38cH7gJrp9ZmGyQ2SnI39J1emB2RQbK0V9S2w5EacuYoRE41DZyn6tNbXELBqEngzU58xQ15io8soFwaHGv58IXZ0+YEeyhtFeNXT6cg6FupD9KMbQRZTRlL4ftTOjYn4AzNm5X6rDsI6OOMevLY9EM/6tipzTKkMvHf/75yrMcNwzH2M4vuaqo9FOhFgnLXXTd3OCCmva98UuLQCaLTuUspxAccz/LhqvVjEdKlbtJ3htB+6AN1KuS+v/wpqqfzqrufktzGE752uc4wcd8z2SD6DnUbUcWHmp5nTwjVtLjBpcZ1qhEBJOavxG6G2k2pQWHq2AblHt0BBRY2u+9m/08FMd7GKBViDb06mtAfsZd1O7itKX35PvhvTTzkqPvq8sQX3UquN1zIklx/SkMfNVnc4NJ5s8TQnzIZ5DiCza2qM8EgU1cOjPyUxTZg9R5jDJ5IB/j3FNCxHnZXBQ70XEWHxVIfEJLLHnd90k2WPmgTp34BUbc/yo6Oa5XLhqx9e2qcCZ+RiBav4sh1cEvGWLLSjW0M+oUc0x7ALqimzmHfLNG2mvZzygqMo7G5Tj0oCGLTZy1wpKYtfXvlzaX36PyseTkLg4jj53DAicWR5ciJpVbvKKlNOAch4coOc821MVs4NJU92ARUcPXUXP3kC3L3ezs8Nw+4x+dYvxJ+UWq2Z1Fxl7oOZQ3ddjkxPOr7Fj78dGlrcj1oyUWx3ikzSSYMfT6fIpJYrTetuSOmRMh/ApfPK8rbevdbGVR7xq43zSax0rDWMIxxri9o7hSQHpDZH1686mk31OiKibvqizV0lu8d6AFzSCfIDDB33sZz5lwIaiVdZ20NUhkqi/5d4+gpTxWpOmPDLScgg/r6sAbS8y9dO79VDHnU89M3LLjqPt8V+9Z2PWvOBUWo7pBSLJz2T8M6JDtJXD932U2xjLsbkvitn6OPLNnTev586Bl9KiiWN31Vac/R7cNZggMeAIUXYsgpMLhumclMMoNkdKDKieBqsD3EZUajEef3rP7bAlBw+jNQnRGnaIxhn7+rFGr7KAmKandWfpFbeUspb1NM+4gOBlLgmFwz1/JJWv3dhObZbSgxpOwaaYwpPHv56ymOX89dzvqbFi+V4vysTeNllvGnA6KXs04RgmcfUkCFEG8ptfR81az66wgfKuZrRzb+QoVGuFxH+aUEddc1IoCowzcZItic+FtRYXkewPd/WcdytSgJkOcHoPjsN6w7cYUU7vjR1v1V0Q3N786mpnypvXp/RAauRmLf1uBHBmDmxkLyf8pk6zWr243bKkPbc3Ye+VtKUu0d/9G6nsEsGc5stxRlY9Xrw5XUxc6X65pHMeJwWpBMbIhxqcQgGYFkn4DGo4dEQyycG1hxPz0tyu/XcMC1XnyLzA8Mo0RzemX5822EaUoY7eeWxKWeXlTl5SzoWAfKYPVhBM6qZxZo26I1FBA5uVhY0zuWT6qf5WZF1V1Cs1NeD25ClIS3ZaK/jWaazI0ECaFJLruQo2zO2c0xtj2zbNjjJF9RdTXlle73w9B5mDDzlsX51ZyNm7ZuPdMSFnmOiKhW7c+lteB7Q3JIUJbzCcmu2/M2iV3yTUmUc8uro0JaArOf5JiFvu51JiCD47TG1vaIkzIXcVp7wOcnTvNpanCBUnhhxtBIfvJVeHnZXUTbazxmSn1+OcF+WYs4V2ALPRtpUohLweVxUUqb15h6mIhTdt6ADduQ1nQ/u5ez3Nccduqj3OuBHoBS1qsq2U3t+dN2dZ1QNUC0iQL/UoYeE76mzNidCIOmclTRJe+Hv80kFbh4G/JPQGPJfKmHcpKcGepOPFWSvLUo+k+uqn5o0xJ3jmmyLjE9lFc0CJhLXigvFyQhsnbEchjQj1As13X8f+wet1eN2AXzT7tTk6onZfiiqiNdGbOZ7nnqoL7zGzVvfppuj5p3qM9tcZxFcn7vbV3jWyqu1PxZhvJjg67jI9HME7Ln0AtBq9q3TPG/mOJZxCUliR+3wPGA7uH2i3Z7d/AwXJzod0HDrkCsq/0xuCKr7ynz7h9S/HaKxz88k7GvN37dcrBQ5OOQVYoyB2qtIZgellu3f3zkEr68czdDpi0t+LJN4ykBC6/Uc8MIYT3KTWlaJbVl23KrNemmIkP8suh4MTQkmL5OP9FMWEfsbp3qyoc+H8sTcyd4reAZFuc88UTOik9iO6WWZfHN8PgfUoCY5DVjN8+amY9vwsDuzm9N9lp3yuga0jRcRYwDq3RDwt7/jUN34swmMbp3Re0xgfclrB2Wfd+DUZP8Jmbys5iPVmmCkDJet2WHN6d1vw9aOJQJdajGZ7rE6ZYniHOnd0xuTl9pLtgKt4xP/rQFWw2kpc9df4cZCbmMn63Br5XbLV55SX1VUeOxNim6xfErL7j8dbkqxzxTRcVA1GoDzz92/k1M6TkPAJjDH+MU4R6M04TrYH1UlnmN0rUFVfvKugHLYk9gKHVWaUrukMQcs8h02DqO2ajfkzDbGc8HmSJXY3q5hVn6rnrCDliIWo87ABhfM8wQ47hW6seHpTgPec+0NO+rxvOw8AuOTTey0xIWB36yBhd2i7/vf/PI+jw0xCAAA="}],"_tidb":{"commitTs":454080615707574279}}
lee1988well commented 4 days ago

The data is compressed using gzip and then converted into binary to be stored in longblob. When consuming, in version v7.5.3, the data is first converted from iso8859-1 to utf-8 before decompression. However, in version v7.5.4, no such conversion to utf-8 is necessary, the data can be decompressed directly.