mangiucugna
commented
6 months ago that's a super weird return value with those double double quotes, I will look into it. Do you know by any chance why the output is formatted like that?
Closed pd2871 closed 6 months ago
mangiucugna
commented
6 months ago that's a super weird return value with those double double quotes, I will look into it. Do you know by any chance why the output is formatted like that?
pd2871
commented
6 months ago that's a super weird return value with those double double quotes, I will look into it. Do you know by any chance why the output is formatted like that?
This is extracted from AIMessage returned from Langchain. I tried to use my custom parser instead of parsers provided by Langchain because they were not able to handle broken JSONs.
mangiucugna
commented
6 months ago I have released 0.12.0 to support this format, let me know if it works for you as it passed all tests for me
pd2871
commented
6 months ago I have released 0.12.0 to support this format, let me know if it works for you as it passed all tests for me
Thank you for this quick fix. I will check it and let you know in any case of failure with new similar data.
nikolaysm
commented
5 months ago Hi @mangiucugna,
Thank you for your efforts on this. I've encountered a similar issue with the output from the LLM. It seems that the repair_json function isn't handling certain cases correctly.
For instance, when trying to repair the following JSON string:
json_str = '{\n"html": "<h3 id="title">Waarom meer dan 200 Technical Experts - "Passie voor techniek"?</h3>"}'
data = repair_json(json_str, return_objects=True)The current output is:
{
'html': '<h3 id=',
'techniek': 'h3>',
'title': u'Waarom meer dan 200 Technical Experts - '
}However, the expected output should be:
{
'html': '<h3 id="title">Waarom meer dan 200 Technical Experts - "Passie voor techniek"?</h3>'
}It seems like the function is having trouble handling certain characters or nested structures properly. Would you mind looking into this further?
Thank you again for your attention to this matter.
mangiucugna
commented
5 months ago Hi @nikolaysm can you open a new issue for that? The issue is with the fact that the right format is <h3 id='title'> so I am not 100% sure I can support this use case but is definitely a distinct use case from this issue
Describe the bug Returned json by
json_repairis not in correct format which was expected.To Reproduce Steps to reproduce the behavior: Run the file in python environment with
langchainandjson_repairinstalledExpected behavior I expected the
repair_jsonto repair the output json.Screenshots If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
Additional context OpenAI has returned incomplete json due to limit in completion prompt. The json is missing
":"after'answer40'at the end of the response. I expectedjson_repairto fix the issue but it has created unexpected json.Code to get the json:
JSON return by json_repair: