naszilla / tabzilla

Apache License 2.0
123 stars 28 forks source link

VIME memory issue (DefaultCPUAllocator) #39

Closed duncanmcelfresh closed 1 year ago

duncanmcelfresh commented 2 years ago

This occurred with alg VIME, on dataset openml__CIFAR_10__167124, this occurs on all hparam samples tested

Traceback (most recent call last):
  File "/home/shared/tabzilla/TabSurvey/tabzilla_experiment.py", line 136, in __call__
    result = cross_validation(model, self.dataset, self.time_limit)
  File "/home/shared/tabzilla/TabSurvey/tabzilla_utils.py", line 237, in cross_validation
    loss_history, val_loss_history = curr_model.fit(
  File "/home/shared/tabzilla/TabSurvey/models/vime.py", line 47, in fit
    self.fit_self(X_unlab, p_m=self.params["p_m"], alpha=self.params["alpha"])
  File "/home/shared/tabzilla/TabSurvey/models/vime.py", line 136, in fit_self
    x_tilde = torch.tensor(x_tilde).float()
RuntimeError: [enforce fail at alloc_cpu.cpp:73] . DefaultCPUAllocator: can't allocate memory: you tried to allocate 663552000 bytes. Error code 12 (Cannot allocate memory)
duncanmcelfresh commented 1 year ago

this is a memory error, which we will ignore for these experiments