search

thuiar / DeepAligned-Clustering

Discovering New Intents with Deep Aligned Clustering (AAAI 2021)
https://github.com/thuiar/DeepAligned-Clustering
120 stars 18 forks source link

Different Values of Kpred for Different Seeds? #8

Open rajat-tech-002 opened 3 years ago

rajat-tech-002 commented 3 years ago

Hi @HanleiZhang In file : https://github.com/thuiar/DeepAligned-Clustering/blob/main/results/k_results.csv The second CSV file (Varying value of K) that you have shared, contains ACC wrt different approaches but the predicted value of K is not there. Did you run it for 10 seeds? And if so, then there will be 10 different values of K predicted. Can you please also share the Kpred value for each approach. Especially, Deep Aligned.

rajat-tech-002 commented 3 years ago

@HanleiZhang Any update? Thanks

mrFocusXin commented 3 years ago

Hi,@rajat-tech-002 here is the result of the predicted value of K when cluster_num_factor is 2.When cluster_num_factor is greater than 1, different seeds will have different predicted value of K.

ACC,ARI,NMI,dataset,method,known_cls_ratio,labeled_ratio,cluster_num_factor,seed,K 60.65 50.05 78.57 banking DeepAligned 0.75 0.1 2 0 70 63.64 53.32 79.71 banking DeepAligned 0.75 0.1 2 1 69 62.56 51.04 78.94 banking DeepAligned 0.75 0.1 2 2 62 60.26 50.73 78.61 banking DeepAligned 0.75 0.1 2 3 64 60.81 49.91 78.28 banking DeepAligned 0.75 0.1 2 4 63 62.50 52.48 79.16 banking DeepAligned 0.75 0.1 2 5 64 57.89 49.12 77.99 banking DeepAligned 0.75 0.1 2 6 56 61.27 49.74 78.14 banking DeepAligned 0.75 0.1 2 7 61 62.66 51.56 78.13 banking DeepAligned 0.75 0.1 2 8 67 66.27 55.25 81.03 banking DeepAligned 0.75 0.1 2 9 69

rajat-tech-002 commented 3 years ago

Hi,@rajat-tech-002 here is the result of the predicted value of K when cluster_num_factor is 2.When cluster_num_factor is greater than 1, different seeds will have different predicted value of K.

ACC,ARI,NMI,dataset,method,known_cls_ratio,labeled_ratio,cluster_num_factor,seed,K 60.65 50.05 78.57 banking DeepAligned 0.75 0.1 2 0 70 63.64 53.32 79.71 banking DeepAligned 0.75 0.1 2 1 69 62.56 51.04 78.94 banking DeepAligned 0.75 0.1 2 2 62 60.26 50.73 78.61 banking DeepAligned 0.75 0.1 2 3 64 60.81 49.91 78.28 banking DeepAligned 0.75 0.1 2 4 63 62.50 52.48 79.16 banking DeepAligned 0.75 0.1 2 5 64 57.89 49.12 77.99 banking DeepAligned 0.75 0.1 2 6 56 61.27 49.74 78.14 banking DeepAligned 0.75 0.1 2 7 61 62.66 51.56 78.13 banking DeepAligned 0.75 0.1 2 8 67 66.27 55.25 81.03 banking DeepAligned 0.75 0.1 2 9 69

Can you please also share same results for Clinc (num_cluster_factor 2, 3, 4) and Banking (num_cluster_factor 3, 4)? Thanks