search

huawei-noah / vega

AutoML tools chain
http://www.noahlab.com.hk/opensource/vega/
Other
842 stars 175 forks source link

The requested array has an inhomogeneous shape after 2 dimensions #292

Closed Isaspinach closed 5 months ago

Isaspinach commented 5 months ago

Hi, I'm trying to run CARS on my computer, after it gets to the first GA epoch, the algorithm gets interrupted and I get the following error:

2024-05-01 16:14:13,801 ERROR Failed to run worker, id: 0, message: setting an array element with a sequence. The requested array has an inhomogeneous shape after 2 dimensions. The detected shape was (14, 3) + inhomogeneous part. 2024-05-01 16:14:13,810 INFO Update Success. step_name=nas, worker_id=0 2024-05-01 16:14:13,810 INFO waiting for the workers [0] to finish 2024-05-01 16:14:13,810 INFO Best values: [] 2024-05-01 16:14:13,811 WARNING Failed to dump pareto front records, report is emplty. 2024-05-01 16:14:13,813 INFO Clean worker folder /root/vega2/vega-1.8.5/examples/nas/cars/tasks/0501.160634.343/workers/nas. 2024-05-01 16:14:13,815 INFO ------------------------------------------------ 2024-05-01 16:14:13,815 INFO Step: fully_train 2024-05-01 16:14:13,815 INFO ------------------------------------------------ 2024-05-01 16:14:13,818 INFO init TrainPipeStep... 2024-05-01 16:14:13,818 INFO TrainPipeStep started... 2024-05-01 16:14:13,819 WARNING Failed to dump records, report is emplty. 2024-05-01 16:14:15,821 INFO ------------------------------------------------ 2024-05-01 16:14:15,821 INFO Pipeline end. 2024-05-01 16:14:15,822 INFO 2024-05-01 16:14:15,822 INFO task id: 0501.160634.343 2024-05-01 16:14:15,822 INFO output folder: /root/vega2/vega-1.8.5/examples/nas/cars/tasks/0501.160634.343/output 2024-05-01 16:14:15,822 INFO 2024-05-01 16:14:15,822 INFO running time: 2024-05-01 16:14:15,822 INFO nas: 0:07:38 [2024-05-01 16:06:35.598430 - 2024-05-01 16:14:13.813926] 2024-05-01 16:14:15,822 INFO fully_train: 0:00:00 [2024-05-01 16:14:13.818454 - 2024-05-01 16:14:13.819698] 2024-05-01 16:14:15,822 INFO 2024-05-01 16:14:15,823 INFO result file output.csv is not existed or empty 2024-05-01 16:14:15,823 INFO ------------------------------------------------

Isaspinach commented 5 months ago

It was my torch version, thanks