search

brandontrabucco / design-bench

Benchmarks for Model-Based Optimization
MIT License
80 stars 19 forks source link

New task registration failed #20

Open ksr157 opened 6 months ago

ksr157 commented 6 months ago

I have defined a new task, and the entire data collection for 'Defining New MBO Tasks' ran successfully. However, when I used design_bench.make to set up the new task, it failed to download the data. The error message displayed is: 'ValueError: No registered task with the name: NEW-TASK-v0'. I'm wondering why the data collection ran smoothly, but the new task seems to fail during registration with design_bench. Could you help me fix this? Also, could you please explain how to verify if the task was successfully registered?

christopher-beckham commented 6 months ago

Hi @ksr157

All of the tasks are actually registered in design_bench/__init__.py, I suppose you could use the register() function in design_bench.registration but I feel like it would be easier to just instantiate the task manually. I'm not sure if there's functionally a difference between using design_bench.make or not in terms of whether it's just syntactic sugar or if it's needed to fulfil a specific purpose (I've never implemented a new task ever in this lib*).

(* n.b: take everything I say with a grain of salt, I'm just a maintainer of the lib, not the originating author, so I'm ccing @brandontrabucco here)