Open JACKHAHA363 opened 1 year ago
Use the transformer version from https://github.com/JACKHAHA363/transformers/tree/robin_v4.32.1. This is based on the version 4.32.1 and it adds a Robin class here.
https://github.com/JACKHAHA363/transformers/tree/robin_v4.32.1
python tools/convert_module_to_hf.py \ --input_dir checkpoints/robin_ckpt \ --config_file checkpoints/robin_ckpt/configs/big_run_grid_8e-5_2208.yml \ checkpoints/robin_ckpt/configs/magma_pythia_410M.yml \ --output_dir checkpoints/robin_hf
See python test_hf_robin.py for a sample inference In the --config_file you can input a list of config file names.
python test_hf_robin.py
--config_file
Requirement
Use the transformer version from
https://github.com/JACKHAHA363/transformers/tree/robin_v4.32.1. This is based on the version 4.32.1 and it adds a Robin class here.Usage
Test
See
python test_hf_robin.pyfor a sample inference In the--config_fileyou can input a list of config file names.