Generated Data Shape always 0

[iamamiramine]

I am facing an issue when generating data using Tabula.

I trained Tabula on the following datasets:

1. Census
2. Fake Hotel Guests
3. Adult
4. Health
5. News

However, when generating, the generation loop is stuck because generated data shape is always 0 (num_samples is always greater than gen_data.shape[0]).

I tried re-training, and tried changing the max_length parameter in the sampling function, but it was of no help.

Can you please help me figure out how to fix this issue?

[zhao-zilong]

Hi @iamamiramine sorry that I just saw your message. Did you solve it? The reason can be that your max_length is too small so that the generation cannot successfully generate one complete row of data.

[iamamiramine]

Hello, I tried changing the max_length parameter and it did not work. Another thing to note is that Fake Hotel Guests dataset consists of 9 columns, so one row from this dataset is relatively short.

[omaralvarez]

I am also having problems with this, I am using max_length=1024 the maximum, if use more I get a CUDA error, in this dataset I can not get a single sample:

from imblearn.datasets import fetch_datasets

sick = fetch_datasets()['sick']
sick.data.shape

[zhao-zilong]

Hi @omaralvarez @iamamiramine

You do not need to set the max_length to 1024 that big, you can uncomment this part of code to see what is the length of your encoded row:

https://github.com/zhao-zilong/Tabula/blob/3869567c681b6c7cb1051bed75b5cb9ccfd2fa3a/tabula/tabula_dataset.py#L64

Let me know if that helps.

[omaralvarez]

Yes, I don't think it has to do with max_length, the issue in this case is that some numbers always are outside of the requested ranges in the predicted dataframe, so they are always filtered out. I have tried to switch temperature, k, and training epochs to no avail.