Open rburghol opened 1 year ago
state
op_tokens
model_object_cache
om
.json
model_path_loader()
model_tokenizer_recursive
state
branchop_tokens
andmodel_object_cache
and put inom
state
Dict can hold all module Dicts likeom
om
branch (should inherit state branch)op_tokens
is set early in process, should it be part of defaultstate
setup, or established in OM?model_object_cache
.json
filesmodel_path_loader()
aftermodel_object_cache
is set upmodel_tokenizer_recursive
to finalize the token process and be ready for loading.