Describe the bug
I am currently finetuning the Moirai model, and it works as expected when using a single dataset. However, when I attempt to finetune using two datasets, I encounter an error. I have created a YAML file located at finetune/data/combined.yaml with the following contents:
Next use the above combined.yaml file to provide datapath during finetuning as follows:
python -m cli.train -cp conf/finetune run_name=test model="moirai_1.0_R_large" data=combined.yaml
Expected behavior
To finetune without giving errors
Error message or code output
Error in call to target 'uni2ts.data.builder._base.ConcatDatasetBuilder':
AssertionError ('All builders must be instances of DatasetBuilder')
full key: data
Environment
Operating system: ubuntu 20.04
Python version: 3.10
PyTorch version: '2.3.1+cu121'
uni2ts version (have you pulled the latest version?): yes
Could you please help me with this @gorold @liu-jc @chenghaoliu89 ? Thanks
Describe the bug I am currently finetuning the Moirai model, and it works as expected when using a single dataset. However, when I attempt to finetune using two datasets, I encounter an error. I have created a YAML file located at finetune/data/combined.yaml with the following contents:
Individual finetuning with dataset1 and dataset2 works without issues.
To Reproduce Take any two CSV files and execute:
Next use the above combined.yaml file to provide datapath during finetuning as follows:
python -m cli.train -cp conf/finetune run_name=test model="moirai_1.0_R_large" data=combined.yaml
Expected behavior To finetune without giving errors
Error message or code output
Environment
Could you please help me with this @gorold @liu-jc @chenghaoliu89 ? Thanks