skadio
commented
2 years ago Hi @qxzhou1010 --thank you for your interest in our library!
In terms of rows, having 1541 sequences is not that large. That should be fine. How about the number of columns? For instance, what is the length of the largest sequence? the max(|sequence|) dictates the memory allocation of the decision diagram, and most likely, that's what you are facing.
Here is what I would suggest:
- Check the max column length. If too large (>100?), then down-sample to see what size of the problem instance, you can solve practically.
- What happens when you run it without any constraints. You can try sequential pattern mining with the
min_frequencyparameter before trying constraint-based SPM on the time attribute. - Out of curiosity, do your attributes have any negative values?
qxzhou1010
takojunior
GF-Huang
I encountered a strange problem while using it. I have a total of 1541 sequences, and the items in each sequence have time attributes (in milliseconds). When mining, I added span and gap constraints. When I reduce the constraint, the mining result is 0. When I increase the constraint a little bit, my jupyter will directly hang.This makes me feel puzzling. I guess the reason why Jupyter crashed was because there were too many results, which caused memory overflow, but I only increased the constraint a little bit, and logically, it won’t increase the result too much.
Please tell me how to solve this problem, thank you very much!