Lora create model

[martinsbruveris]

Adding create_model function and setting up some form of registry. To create a LoRA model for a supported architecture, use

from tfimm.architectures import lora

model = lora.create_model("convnext_tiny", pretrained=True, lora_rank=4)
lora.mark_only_lora_as_trainable(model, train_bias="none")