Korean is not included in metadata

[rlatjgml38]

Describe the bug When I try to input Korean in description an error occurs. I think I need utf8 encoding to input Korean. What should I do?

To Reproduce

1. Made the json file (test3.json)

   [
   {
   "auditHeader": null,
   "entityType": "dataset",
   "entityUrn": "urn:li:dataset:(urn:li:dataPlatform:oracle,한글테스트2,PROD)",
   "entityKeyAspect": null,
   "changeType": "UPSERT",
   "aspectName": "datasetProperties",
   "aspect": {
       "value": "{\"description\": \"한글 설명\"}",
       "contentType": "application/json"
   },
   "systemMetadata": null
   }
   ]

2. Made the yml file (file_to_datahub.yml)

source:
        type: "file"
        config:
                filename: "./test3.json"
sink:
        type: "datahub-rest"
        config:
                server: "http://localhost:8080"
reporting:
        - type: "datahub"
          config:
                  datahub_api:
                          server: "http://localhost:8080"

3. Run datahub ingest -c file_to_datahub.yml

Screenshots

Desktop (please complete the following information):

• OS: Ubuntu 18.04
• Datahub Version: 0.8.32

Additional context I succeeded in putting Korean in urn. When there is no Korean in the description. However, Korean is not included in metadata. (e.g. description, column name, subtype's typeName, etc.) And I tried to install v0.8.36 and v0.8.39, but I couldn't use it with a red error window saying "Oops, an error occurred".

[rlatjgml38]

5306

[github-actions[bot]]

This issue is stale because it has been open for 30 days with no activity. If you believe this is still an issue on the latest DataHub release please leave a comment with the version that you tested it with. If this is a question/discussion please head to https://slack.datahubproject.io. For feature requests please use https://feature-requests.datahubproject.io

[aditya-radhakrishnan]

Hi is this still an issue? From our side it looks like Python ingestion does support non utf-8 characters