ValueError: can not determine the backend of 'openai/clip-vit-base-patch32'

[TEnsorTHiru]

I'm trying to finetune openai-clip model using my own dataset but when I tried finetuner.fit, it raised an error like this

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Cell In[4], line 5
      1 import finetuner
      2 from finetuner.callback import EvaluationCallback
----> 5 run = finetuner.fit(
      6     model='openai/clip-vit-base-patch32',
      7     train_data='blend-train',
      8     eval_data='blend-val',
      9     epochs=5,
     10     learning_rate= 1e-7,
     11     loss='CLIPLoss',
     12     device='cuda',
     13     callbacks=[
     14         EvaluationCallback(
     15             model='clip-text',
     16             index_model='clip-vision',
     17             query_data='finetuner/fashion-eval-data-queries',
     18             index_data='finetuner/fashion-eval-data-index',
     19             gather_examples=True,
     20         )
     21     ],
     22 )

File /usr/local/lib/python3.10/dist-packages/finetuner/__init__.py:103, in fit(model, train_data, *args, **kwargs)
     94 def describe_models(task: Optional[str] = None) -> None:
     95     """Print model information, such as name, task, output dimension, architecture
     96     and description as a table.
     97 
   (...)
    101 
    102     """
--> 103     print_model_table(model, task=task)

File /usr/local/lib/python3.10/dist-packages/finetuner/tuner/__init__.py:94, in fit(embed_model, train_data, eval_data, preprocess_fn, collate_fn, epochs, batch_size, num_items_per_class, loss, configure_optimizer, learning_rate, scheduler_step, device, callbacks, num_workers, **kwargs)

File /usr/local/lib/python3.10/dist-packages/finetuner/tuner/__init__.py:20, in _get_tuner_class(dnn_model)

File /usr/local/lib/python3.10/dist-packages/finetuner/helper.py:68, in get_framework(dnn_model)

ValueError: can not determine the backend of 'openai/clip-vit-base-patch32'

Can someone tell me or guide me in fixing this issue

[bwanglzu]

hi @TEnsorTHiru sorry for the late reply, can you tell me which version of finetuner are you using?