foundation-model-stack / fms-hf-tuning

🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
Apache License 2.0
22 stars 41 forks source link

feat: Need to support aync logging in the library to record metadata and logs from execution. #215

Closed dushyantbehl closed 1 month ago

dushyantbehl commented 3 months ago

Is your feature request related to a problem? Please describe.

Currently fms-hf-tuning uses transformer logging which can be replaced by async logging library which supports logging metadata and logs without being tied to upstream modules like tranformers.

Describe the solution you'd like

Replace tranformer logging with asyn logger.

cc @ashokponkumar

kmehant commented 2 months ago

related and possibly duplicate of - https://github.com/foundation-model-stack/fms-hf-tuning/issues/195 and https://github.com/foundation-model-stack/fms-hf-tuning/issues/194