Luodian / Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
https://otter-ntu.github.io/
MIT License
3.55k stars 242 forks source link

key error in SN(ScanNet) Datasets #228

Closed Darren-greenhand closed 1 year ago

Darren-greenhand commented 1 year ago

Hi ! I succesfully run the train code on other datasets, but there is key error in SN dataset, When i check SN_instructions.json and SN.json ,I found that their keys do not match I download SN_train and SN_instructions here and I download SN here

samples of SN_instructions.json

"SN_INS_scene0000_activity2_round0": {"instruction": "Are there any specific activities that you think I could engage in within this room?", "answer": "Home Repair Project stands out to me as a stellar indoor activity. The room has a spacious layout with enough floor space to accommodate a home repair project.", "image_ids": ["SN_IMG_scene0000_color_000000", "SN_IMG_scene0000_color_000100", "SN_IMG_scene0000_color_000200", "SN_IMG_scene0000_color_000300", "SN_IMG_scene0000_color_000400", "SN_IMG_scene0000_color_000500", "SN_IMG_scene0000_color_000600", "SN_IMG_scene0000_color_000700", "SN_IMG_scene0000_color_000800", "SN_IMG_scene0000_color_000900", "SN_IMG_scene0000_color_001000", "SN_IMG_scene0000_color_001100", "SN_IMG_scene0000_color_001200", "SN_IMG_scene0000_color_001300", "SN_IMG_scene0000_color_001400", "SN_IMG_scene0000_color_001500", "SN_IMG_scene0000_color_001600", "SN_IMG_scene0000_color_001700", "SN_IMG_scene0000_color_001800", "SN_IMG_scene0000_color_001900", "SN_IMG_scene0000_color_002000", "SN_IMG_scene0000_color_002100", "SN_IMG_scene0000_color_002200", "SN_IMG_scene0000_color_002300", "SN_IMG_scene0000_color_002400", "SN_IMG_scene0000_color_002500", "SN_IMG_scene0000_color_002600", "SN_IMG_scene0000_color_002700", "SN_IMG_scene0000_color_002800", "SN_IMG_scene0000_color_002900", "SN_IMG_scene0000_color_003000", "SN_IMG_scene0000_color_003100", "SN_IMG_scene0000_color_003200", "SN_IMG_scene0000_color_003300", "SN_IMG_scene0000_color_003400", "SN_IMG_scene0000_color_003500", "SN_IMG_scene0000_color_003600", "SN_IMG_scene0000_color_003700", "SN_IMG_scene0000_color_003800", "SN_IMG_scene0000_color_003900", "SN_IMG_scene0000_color_004000", "SN_IMG_scene0000_color_004100", "SN_IMG_scene0000_color_004200", "SN_IMG_scene0000_color_004300", "SN_IMG_scene0000_color_004400", "SN_IMG_scene0000_color_004500", "SN_IMG_scene0000_color_004600", "SN_IMG_scene0000_color_004700", "SN_IMG_scene0000_color_004800", "SN_IMG_scene0000_color_004900", "SN_IMG_scene0000_color_005000", "SN_IMG_scene0000_color_005100", "SN_IMG_scene0000_color_005200", "SN_IMG_scene0000_color_005300", "SN_IMG_scene0000_color_005400", "SN_IMG_scene0000_color_005500"], "rel_ins_ids": []}

examples of SN.json:

[......, 'SN_00_IMG_scene0663_00_color_000100', 'SN_00_IMG_scene0663_00_color_000200', 'SN_00_IMG_scene0663_00_color_001800', 'SN_00_IMG_scene0663_00_color_000000', 'SN_00_IMG_scene0663_00_color_000700', 'SN_00_IMG_scene0663_00_color_000300', 'SN_00_IMG_scene0663_00_color_000500', 'SN_00_IMG_scene0663_00_color_002800', 'SN_00_IMG_scene0663_00_color_002400', 'SN_00_IMG_scene0663_00_color_002600', 'SN_00_IMG_scene0663_00_color_002300', 'SN_00_IMG_scene0663_00_color_002000', 'SN_00_IMG_scene0663_00_color_002900', 'SN_00_IMG_scene0663_00_color_001600', 'SN_00_IMG_scene0663_00_color_001000', 'SN_00_IMG_scene0663_00_color_000900', 'SN_00_IMG_scene0663_00_color_001900', 'SN_00_IMG_scene0663_00_color_000600', 'SN_00_IMG_scene0663_00_color_001700', 'SN_00_IMG_scene0663_00_color_002200', 'SN_00_IMG_scene0663_00_color_001500', 'SN_00_IMG_scene0663_00_color_000400', 'SN_00_IMG_scene0663_00_color_001200', 'SN_00_IMG_scene0663_00_color_001100', 'SN_00_IMG_scene0663_00_color_002700'])
Luodian commented 1 year ago

Hi You may need to manually remove the '00' in 'SN.json'.

It's a small naming issue, you can fix it your side and also we will update it later.

Darren-greenhand commented 1 year ago

ok!thx a lot!