update openai, pydantic, and chromadb versions and examples to work with uniflow

CambioML / pykoi-rlhf-finetuned-transformers

pykoi: Active learning in one unified interface

https://www.cambioml.com

Apache License 2.0

407 stars 43 forks source link

Closed jojortz closed 8 months ago

jojortz commented 8 months ago

Update openai version to 1.2.4 to match uniflow
- change to use OpenAI client.chat.completions instead of ChatCompletion reference
Update pydantic to 2.5.2 to match uniflow
- required chromadb update as well to get around BaseSettings error
Tested and updated notebooks in these example folders
- chatbot
- comparator
- data_generation
- retrieval_qa
- rlhf

jojortz commented 8 months ago

Further updated datasets, transformers, peft, and trl

For datasets, updated to address this issue
- Datasets upgrade required transformers upgrade to avoid conflicts
With updated torch, got use_reentrant ValueError ref
- added gradient_checkpointing_kwargs to config and TrainingArguments
- updated peft and trl
With updated trl, got CUDA out of memory, so updated per_device_train_batch_size to default to 1. Above 1, get out of memory error on 24GB GPU