search

hassonlab / 247-pickling

Contains code to create pickles from raw/processed data
1 stars 9 forks source link

Clean-up models #36

Closed hvgazula closed 2 years ago

hvgazula commented 2 years ago

@zkokaja Should I go ahead and clean this https://github.com/hassonlab/247-pickling/blob/main/code/tfsemb_main.py#L397-L417 up (by removing bert and bart models) as it looks like we are not going to use them at all? Also, does blender-bot have a different codebase? Can't it be integrated here?

zkokaja commented 2 years ago

Yea, I added lines for blenderbot in my branch. I think this is a place it makes sense to use the AutoTokenizer and AutoModels. Though I suspect we may still need some special cases for some models.