Open scauzhaos opened 1 year ago
This indicates numerical instability. When does this problem occur? If during later epochs (20k+) you can consider stopping earlier before this problem occurs. If in the middle of training (not the first few epochs) you can try more stringent gene filtering. If this happens during the first epoch - something is wrong with the data - possibly with reference cell type signatures.
Hi, when I ran mod.train, I encountered this problem, as follows: ValueError: Expected parameter rate (Tensor of shape (1, 1)) of distribution Gamma(concentration: tensor([[10.]]), rate: tensor([[nan]])) to satisfy the constraint GreaterThan(lower_bound=0.0), but found invalid values: tensor([[nan]])
My code: mod.train(max_epochs=30000,
train using full data (batch_size=None)
Please help me to fix this issue. Thanks!