refactor: Overwrite the Japanese parts of the llava-bench-ja JSON/JSONL files with ensure_ascii=False - Githubissues

turingmotors / heron

Apache License 2.0

163 stars 25 forks source link

refactor: Overwrite the Japanese parts of the llava-bench-ja JSON/JSONL files with ensure_ascii=False #36

Closed ymgaq closed 7 months ago

ymgaq commented 7 months ago

Overwrite the Japanese parts of the llava-bench-ja JSON/JSONL files with ensure_ascii=False

Description

Purpose of the PR

The Japanese text in the data files of llava-bench-ja was encoded in character codes, making it less readable. Therefore, it has been overwritten with ensure_ascii=False to improve readability.
This pull request is intended to make the differences clear before fixing the Japanese descriptions, and there are no changes to the content described other than the change in character encoding.

Changes

Correct the character format of the Japanese parts in the JSON/JSONL files under playground/data/llava-bench-ja.
- qa90_questions_ja.jsonl
- sample_answers.jsonl
- sample_reviews.json