🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
Hi ! I succesfully run the train code on other datasets, but there is key error in SN dataset,
When i check SN_instructions.json and SN.json ,I found that their keys do not match
I download SN_train and SN_instructions here
and I download SN here
samples of SN_instructions.json
"SN_INS_scene0000_activity2_round0": {"instruction": "Are there any specific activities that you think I could engage in within this room?", "answer": "Home Repair Project stands out to me as a stellar indoor activity. The room has a spacious layout with enough floor space to accommodate a home repair project.", "image_ids": ["SN_IMG_scene0000_color_000000", "SN_IMG_scene0000_color_000100", "SN_IMG_scene0000_color_000200", "SN_IMG_scene0000_color_000300", "SN_IMG_scene0000_color_000400", "SN_IMG_scene0000_color_000500", "SN_IMG_scene0000_color_000600", "SN_IMG_scene0000_color_000700", "SN_IMG_scene0000_color_000800", "SN_IMG_scene0000_color_000900", "SN_IMG_scene0000_color_001000", "SN_IMG_scene0000_color_001100", "SN_IMG_scene0000_color_001200", "SN_IMG_scene0000_color_001300", "SN_IMG_scene0000_color_001400", "SN_IMG_scene0000_color_001500", "SN_IMG_scene0000_color_001600", "SN_IMG_scene0000_color_001700", "SN_IMG_scene0000_color_001800", "SN_IMG_scene0000_color_001900", "SN_IMG_scene0000_color_002000", "SN_IMG_scene0000_color_002100", "SN_IMG_scene0000_color_002200", "SN_IMG_scene0000_color_002300", "SN_IMG_scene0000_color_002400", "SN_IMG_scene0000_color_002500", "SN_IMG_scene0000_color_002600", "SN_IMG_scene0000_color_002700", "SN_IMG_scene0000_color_002800", "SN_IMG_scene0000_color_002900", "SN_IMG_scene0000_color_003000", "SN_IMG_scene0000_color_003100", "SN_IMG_scene0000_color_003200", "SN_IMG_scene0000_color_003300", "SN_IMG_scene0000_color_003400", "SN_IMG_scene0000_color_003500", "SN_IMG_scene0000_color_003600", "SN_IMG_scene0000_color_003700", "SN_IMG_scene0000_color_003800", "SN_IMG_scene0000_color_003900", "SN_IMG_scene0000_color_004000", "SN_IMG_scene0000_color_004100", "SN_IMG_scene0000_color_004200", "SN_IMG_scene0000_color_004300", "SN_IMG_scene0000_color_004400", "SN_IMG_scene0000_color_004500", "SN_IMG_scene0000_color_004600", "SN_IMG_scene0000_color_004700", "SN_IMG_scene0000_color_004800", "SN_IMG_scene0000_color_004900", "SN_IMG_scene0000_color_005000", "SN_IMG_scene0000_color_005100", "SN_IMG_scene0000_color_005200", "SN_IMG_scene0000_color_005300", "SN_IMG_scene0000_color_005400", "SN_IMG_scene0000_color_005500"], "rel_ins_ids": []}
Hi ! I succesfully run the train code on other datasets, but there is key error in SN dataset, When i check SN_instructions.json and SN.json ,I found that their keys do not match I download SN_train and SN_instructions here and I download SN here
samples of SN_instructions.json
examples of SN.json: