search

eugeneyan / applied-ml

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
MIT License
27.4k stars 3.69k forks source link

Is there any resource on market basket analysis? #145

Closed KaziAmitHasan closed 1 year ago

KaziAmitHasan commented 3 years ago

There's no doubt this is one of the best resources on applied ML. Market basket analysis is one of the key things in business. But using association rules on the datasets fails due to huge frequent itemset generations. Are there any resource here or your suggestions on it?

chauhankaranraj commented 3 years ago

Hey @AmitHasanShuvo, at Red Hat our team was looking into a problem which I think was fairly similar to a market basket analysis. Basically, we were trying to understand which kubernetes issues tend to co-occur frequently (i.e. frequent pattern and association rule mining applied to k8s clusters' health data).

For this, our initial approach was to perform clustering + fpgrowth on the "symptoms" seen in problematic clusters, and then prune the resulting itemsets using some heuristics. Based on the outputs of this approach, we were able to write "rules" to concretely define some failure modes in k8s clusters. Feel free to read about it here or watch the talk.

disclaimer: I am not a contributor to this repo (not yet, at least :)) or affiliated with it in any other way

KaziAmitHasan commented 3 years ago

I really appreciated your response. Thanks a lot.