Load schema from directory & lazy load the schema per table
Generate schema into directory, each table schema will have a json file
SchemaUtils will have methods to load and write to directory or a single file:
public static LogicSchema fromLocalJsonPath(String path, Class<? extends LogicSchema> clazz);
public static LogicSchema fromRemoteJsonPath(FileSystem fs, String path, Class<? extends LogicSchema> clazz);
public static void toLocalJsonPath(String path, boolean directory, LogicSchema schema, Map<String, List> attrIdMap);
public static void toRemoteJsonPath(FileSystem fs, String path, boolean directory, LogicSchema schema, Map<String, List> attrIdMap);
SchemaUtils will have methods to load and write to directory or a single file: public static LogicSchema fromLocalJsonPath(String path, Class<? extends LogicSchema> clazz); public static LogicSchema fromRemoteJsonPath(FileSystem fs, String path, Class<? extends LogicSchema> clazz); public static void toLocalJsonPath(String path, boolean directory, LogicSchema schema, Map<String, List> attrIdMap);
public static void toRemoteJsonPath(FileSystem fs, String path, boolean directory, LogicSchema schema, Map<String, List> attrIdMap);