Open zhangbaijin opened 6 months ago
Hi, @zhangbaijin
To train TAP models, you should implement the following components:
tokenize_anything/config/...
(YAML Configuration System)tokenize_anything/data/...
(data loader, transforms)tokenize_anything/engine/train_engine.py
(train loop, optimizer, LR scheduler, mixed precision and DDP wrapper)tokenize_anything/models/<my_model>.py
(custom TAP builder, losses/targets getter and forward impl. for training)scripts/train.py
(argument parser, DDP initialization and dispatcher for your train engine)You can follow detectron2
to complete the above components.
Currently, we have no plan to release the full code.
Thanks for your contribution, it is a great work, how to fintune my dataset? like mural dataset, can you give the command or script?