Open mariadorofeikova opened 1 year ago
Hi! I have preprocessed data in a standard way that worked before, but not I am getting the following:
Extracting waveforms : 100%|###################################| 2525/2525 [00:39<00:00, 63.55it/s] Performing PCA : 100%|#########################################| 1/1 [00:00<00:00, 16.14it/s] Computing features : 100%|#################################| 2525/2525 [1:13:14<00:00, 1.74s/it] 17:36:33 [I] launch:218 Spike detection done! 5767580 spikes found in shank 0 17:36:34 [I] launch:249 Starting clustering on shank 0/1. 17:36:35 [I] launch:252 Clustering group 0 (5767580 spikes). 17:36:35 [I] launch:123 Starting KK... 17:36:35 [I] klustakwik KlustaKwik2 version 0.2.6 17:41:52 [I] klustakwik.initial_parameters num_changed_threshold = 0.05 17:41:52 [I] klustakwik.initial_parameters split_every = 40 17:41:52 [I] klustakwik.initial_parameters max_quick_step_candidates = 100000000 17:41:52 [I] klustakwik.initial_parameters break_fraction = 0.0 17:41:52 [I] klustakwik.initial_parameters max_split_iterations = None 17:41:52 [I] klustakwik.initial_parameters mua_point = 2 17:41:52 [I] klustakwik.initial_parameters subset_break_fraction = 0.01 17:41:52 [I] klustakwik.initial_parameters fast_split = False 17:41:52 [I] klustakwik.initial_parameters num_starting_clusters = 100 17:41:52 [I] klustakwik.initial_parameters always_split_bimodal = False 17:41:52 [I] klustakwik.initial_parameters prior_point = 1 17:41:52 [I] klustakwik.initial_parameters use_mua_cluster = True 17:41:52 [I] klustakwik.initial_parameters dist_thresh = 9.210340371976184 17:41:52 [I] klustakwik.initial_parameters points_for_cluster_mask = 100 17:41:52 [I] klustakwik.initial_parameters consider_cluster_deletion = True 17:41:52 [I] klustakwik.initial_parameters max_iterations = 1000 17:41:52 [I] klustakwik.initial_parameters num_cpus = None 17:41:52 [I] klustakwik.initial_parameters use_noise_cluster = True 17:41:52 [I] klustakwik.initial_parameters max_possible_clusters = 1000 17:41:52 [I] klustakwik.initial_parameters split_first = 20 17:41:52 [I] klustakwik.initial_parameters max_quick_step_candidates_fraction = 0.4 17:41:52 [I] klustakwik.initial_parameters noise_point = 1 17:41:52 [I] klustakwik.initial_parameters penalty_k = 0.0 17:41:52 [I] klustakwik.initial_parameters penalty_k_log_n = 1.0 17:41:52 [I] klustakwik.initial_parameters full_step_every = 1 17:41:52 [I] klustakwik Using mask starts with 100 clusters, data has 96 unique masks 17:41:52 [W] klustakwik Not enough masks (96) for specified number of starting clusters (100) 17:42:01 [I] klustakwik Clustering data set of 5767580 points, 48 features 17:42:01 [I] klustakwik Starting iteration 0 with 98 clusters 17:42:14 [W] klustakwik Linear algebra error on cluster 2 17:42:19 [W] klustakwik Linear algebra error on cluster 3 17:42:30 [W] klustakwik Linear algebra error on cluster 4 17:42:30 [W] klustakwik Linear algebra error on cluster 5 17:42:30 [W] klustakwik Linear algebra error on cluster 6 17:42:31 [W] klustakwik Linear algebra error on cluster 7 17:42:32 [W] klustakwik Linear algebra error on cluster 8 17:42:32 [W] klustakwik Linear algebra error on cluster 9 17:42:33 [W] klustakwik Linear algebra error on cluster 10 17:42:33 [W] klustakwik Linear algebra error on cluster 11 17:42:33 [W] klustakwik Linear algebra error on cluster 12 17:42:33 [W] klustakwik Linear algebra error on cluster 13 17:42:33 [W] klustakwik Linear algebra error on cluster 14 17:42:33 [W] klustakwik Linear algebra error on cluster 15 17:42:34 [W] klustakwik Linear algebra error on cluster 16 17:42:34 [W] klustakwik Linear algebra error on cluster 17 17:42:34 [W] klustakwik Linear algebra error on cluster 18 17:42:34 [W] klustakwik Linear algebra error on cluster 19 17:42:34 [W] klustakwik Linear algebra error on cluster 20 17:42:34 [W] klustakwik Linear algebra error on cluster 21 17:42:34 [W] klustakwik Linear algebra error on cluster 22 17:42:34 [W] klustakwik Linear algebra error on cluster 23 17:42:34 [W] klustakwik Linear algebra error on cluster 24 17:42:34 [W] klustakwik Linear algebra error on cluster 25 17:42:34 [W] klustakwik Linear algebra error on cluster 26 17:42:34 [W] klustakwik Linear algebra error on cluster 27 17:42:34 [W] klustakwik Linear algebra error on cluster 28 17:42:34 [W] klustakwik Linear algebra error on cluster 29 17:42:34 [W] klustakwik Linear algebra error on cluster 30 17:42:34 [W] klustakwik Linear algebra error on cluster 31 17:42:34 [W] klustakwik Linear algebra error on cluster 32 17:42:34 [W] klustakwik Linear algebra error on cluster 33 17:42:34 [W] klustakwik Linear algebra error on cluster 34 17:42:34 [W] klustakwik Linear algebra error on cluster 35 17:42:34 [W] klustakwik Linear algebra error on cluster 36 17:42:34 [W] klustakwik Linear algebra error on cluster 37 17:42:34 [W] klustakwik Linear algebra error on cluster 38 17:42:34 [W] klustakwik Linear algebra error on cluster 39 17:42:34 [W] klustakwik Linear algebra error on cluster 40 17:42:34 [W] klustakwik Linear algebra error on cluster 41 17:42:34 [W] klustakwik Linear algebra error on cluster 42 17:42:34 [W] klustakwik Linear algebra error on cluster 43 17:42:34 [W] klustakwik Linear algebra error on cluster 44 17:42:34 [W] klustakwik Linear algebra error on cluster 45 17:42:34 [W] klustakwik Linear algebra error on cluster 46 17:42:34 [W] klustakwik Linear algebra error on cluster 47 17:42:34 [W] klustakwik Linear algebra error on cluster 48 17:42:34 [W] klustakwik Linear algebra error on cluster 49 17:42:34 [W] klustakwik Linear algebra error on cluster 50 17:42:34 [W] klustakwik Linear algebra error on cluster 51 17:42:34 [W] klustakwik Linear algebra error on cluster 52 17:42:34 [W] klustakwik Linear algebra error on cluster 53 17:42:34 [W] klustakwik Linear algebra error on cluster 54 17:42:34 [W] klustakwik Linear algebra error on cluster 55 17:42:34 [W] klustakwik Linear algebra error on cluster 56 17:42:34 [W] klustakwik Linear algebra error on cluster 57 17:42:34 [W] klustakwik Linear algebra error on cluster 58 17:42:34 [W] klustakwik Linear algebra error on cluster 59 17:42:34 [W] klustakwik Linear algebra error on cluster 60 17:42:34 [W] klustakwik Linear algebra error on cluster 61 17:42:34 [W] klustakwik Linear algebra error on cluster 62 17:42:34 [W] klustakwik Linear algebra error on cluster 63 17:42:34 [W] klustakwik Linear algebra error on cluster 64 17:42:34 [W] klustakwik Linear algebra error on cluster 65 17:42:34 [W] klustakwik Linear algebra error on cluster 66 17:42:34 [W] klustakwik Linear algebra error on cluster 67 17:42:34 [W] klustakwik Linear algebra error on cluster 68 17:42:34 [W] klustakwik Linear algebra error on cluster 69 17:42:34 [W] klustakwik Linear algebra error on cluster 70 17:42:34 [W] klustakwik Linear algebra error on cluster 71 17:42:34 [W] klustakwik Linear algebra error on cluster 72 17:42:34 [W] klustakwik Linear algebra error on cluster 73 17:42:34 [W] klustakwik Linear algebra error on cluster 74 17:42:34 [W] klustakwik Linear algebra error on cluster 75 17:42:34 [W] klustakwik Linear algebra error on cluster 76 17:42:34 [W] klustakwik Linear algebra error on cluster 77 17:42:34 [W] klustakwik Linear algebra error on cluster 78 17:42:34 [W] klustakwik Linear algebra error on cluster 79 17:42:34 [W] klustakwik Linear algebra error on cluster 80 17:42:34 [W] klustakwik Linear algebra error on cluster 81 17:42:34 [W] klustakwik Linear algebra error on cluster 82 17:42:34 [W] klustakwik Linear algebra error on cluster 83 17:42:34 [W] klustakwik Linear algebra error on cluster 84 17:42:34 [W] klustakwik Linear algebra error on cluster 85 17:42:34 [W] klustakwik Linear algebra error on cluster 86 17:42:34 [W] klustakwik Linear algebra error on cluster 87 17:42:34 [W] klustakwik Linear algebra error on cluster 88 17:42:34 [W] klustakwik Linear algebra error on cluster 89 17:42:34 [W] klustakwik Linear algebra error on cluster 90 17:42:34 [W] klustakwik Linear algebra error on cluster 91 17:42:34 [W] klustakwik Linear algebra error on cluster 92 17:42:34 [W] klustakwik Linear algebra error on cluster 93 17:42:34 [W] klustakwik Linear algebra error on cluster 94 17:42:34 [W] klustakwik Linear algebra error on cluster 95 17:42:34 [W] klustakwik Linear algebra error on cluster 96 17:42:34 [W] klustakwik Linear algebra error on cluster 97 17:42:34 [I] klustakwik Not enough clusters to try deletion 17:42:35 [I] klustakwik Iteration 1F: 2 clusters, 5767580 changed, score=89788648.310887 17:42:55 [I] klustakwik Not enough clusters to try deletion 17:42:55 [I] klustakwik Iteration 2F: 2 clusters, 0 changed, score=231.982110 (decreased by 89788416.328777) 17:42:55 [I] klustakwik No points changed and last step was full, so trying to split. 17:42:55 [I] klustakwik Trying to split clusters 17:43:13 [I] klustakwik No points changed, previous step was full and did not split, so finishing. 17:43:13 [I] launch:131 The automatic clustering process has finished. 17:43:13 [I] launch:268 Save the clustering to 2022-08-29_15-46-52M4R1.kwik. 17:43:14 [I] model:1085 Save the Kwik file at C:\klusta\PRM files\HP\2022-08-29_15-46-52M4R1\2022-08-29_15-46-52M4R1.kwik. 17:43:14 [I] launch:290 Clustering done!
2022-08-29_15-46-52M4R1.kwik
C:\klusta\PRM files\HP\2022-08-29_15-46-52M4R1\2022-08-29_15-46-52M4R1.kwik
Why could I be getting those Linear algebra errors? I have enough space on the PC.
Hi! I have preprocessed data in a standard way that worked before, but not I am getting the following:
Extracting waveforms : 100%|###################################| 2525/2525 [00:39<00:00, 63.55it/s] Performing PCA : 100%|#########################################| 1/1 [00:00<00:00, 16.14it/s] Computing features : 100%|#################################| 2525/2525 [1:13:14<00:00, 1.74s/it] 17:36:33 [I] launch:218 Spike detection done! 5767580 spikes found in shank 0 17:36:34 [I] launch:249 Starting clustering on shank 0/1. 17:36:35 [I] launch:252 Clustering group 0 (5767580 spikes). 17:36:35 [I] launch:123 Starting KK... 17:36:35 [I] klustakwik KlustaKwik2 version 0.2.6 17:41:52 [I] klustakwik.initial_parameters num_changed_threshold = 0.05 17:41:52 [I] klustakwik.initial_parameters split_every = 40 17:41:52 [I] klustakwik.initial_parameters max_quick_step_candidates = 100000000 17:41:52 [I] klustakwik.initial_parameters break_fraction = 0.0 17:41:52 [I] klustakwik.initial_parameters max_split_iterations = None 17:41:52 [I] klustakwik.initial_parameters mua_point = 2 17:41:52 [I] klustakwik.initial_parameters subset_break_fraction = 0.01 17:41:52 [I] klustakwik.initial_parameters fast_split = False 17:41:52 [I] klustakwik.initial_parameters num_starting_clusters = 100 17:41:52 [I] klustakwik.initial_parameters always_split_bimodal = False 17:41:52 [I] klustakwik.initial_parameters prior_point = 1 17:41:52 [I] klustakwik.initial_parameters use_mua_cluster = True 17:41:52 [I] klustakwik.initial_parameters dist_thresh = 9.210340371976184 17:41:52 [I] klustakwik.initial_parameters points_for_cluster_mask = 100 17:41:52 [I] klustakwik.initial_parameters consider_cluster_deletion = True 17:41:52 [I] klustakwik.initial_parameters max_iterations = 1000 17:41:52 [I] klustakwik.initial_parameters num_cpus = None 17:41:52 [I] klustakwik.initial_parameters use_noise_cluster = True 17:41:52 [I] klustakwik.initial_parameters max_possible_clusters = 1000 17:41:52 [I] klustakwik.initial_parameters split_first = 20 17:41:52 [I] klustakwik.initial_parameters max_quick_step_candidates_fraction = 0.4 17:41:52 [I] klustakwik.initial_parameters noise_point = 1 17:41:52 [I] klustakwik.initial_parameters penalty_k = 0.0 17:41:52 [I] klustakwik.initial_parameters penalty_k_log_n = 1.0 17:41:52 [I] klustakwik.initial_parameters full_step_every = 1 17:41:52 [I] klustakwik Using mask starts with 100 clusters, data has 96 unique masks 17:41:52 [W] klustakwik Not enough masks (96) for specified number of starting clusters (100) 17:42:01 [I] klustakwik Clustering data set of 5767580 points, 48 features 17:42:01 [I] klustakwik Starting iteration 0 with 98 clusters 17:42:14 [W] klustakwik Linear algebra error on cluster 2 17:42:19 [W] klustakwik Linear algebra error on cluster 3 17:42:30 [W] klustakwik Linear algebra error on cluster 4 17:42:30 [W] klustakwik Linear algebra error on cluster 5 17:42:30 [W] klustakwik Linear algebra error on cluster 6 17:42:31 [W] klustakwik Linear algebra error on cluster 7 17:42:32 [W] klustakwik Linear algebra error on cluster 8 17:42:32 [W] klustakwik Linear algebra error on cluster 9 17:42:33 [W] klustakwik Linear algebra error on cluster 10 17:42:33 [W] klustakwik Linear algebra error on cluster 11 17:42:33 [W] klustakwik Linear algebra error on cluster 12 17:42:33 [W] klustakwik Linear algebra error on cluster 13 17:42:33 [W] klustakwik Linear algebra error on cluster 14 17:42:33 [W] klustakwik Linear algebra error on cluster 15 17:42:34 [W] klustakwik Linear algebra error on cluster 16 17:42:34 [W] klustakwik Linear algebra error on cluster 17 17:42:34 [W] klustakwik Linear algebra error on cluster 18 17:42:34 [W] klustakwik Linear algebra error on cluster 19 17:42:34 [W] klustakwik Linear algebra error on cluster 20 17:42:34 [W] klustakwik Linear algebra error on cluster 21 17:42:34 [W] klustakwik Linear algebra error on cluster 22 17:42:34 [W] klustakwik Linear algebra error on cluster 23 17:42:34 [W] klustakwik Linear algebra error on cluster 24 17:42:34 [W] klustakwik Linear algebra error on cluster 25 17:42:34 [W] klustakwik Linear algebra error on cluster 26 17:42:34 [W] klustakwik Linear algebra error on cluster 27 17:42:34 [W] klustakwik Linear algebra error on cluster 28 17:42:34 [W] klustakwik Linear algebra error on cluster 29 17:42:34 [W] klustakwik Linear algebra error on cluster 30 17:42:34 [W] klustakwik Linear algebra error on cluster 31 17:42:34 [W] klustakwik Linear algebra error on cluster 32 17:42:34 [W] klustakwik Linear algebra error on cluster 33 17:42:34 [W] klustakwik Linear algebra error on cluster 34 17:42:34 [W] klustakwik Linear algebra error on cluster 35 17:42:34 [W] klustakwik Linear algebra error on cluster 36 17:42:34 [W] klustakwik Linear algebra error on cluster 37 17:42:34 [W] klustakwik Linear algebra error on cluster 38 17:42:34 [W] klustakwik Linear algebra error on cluster 39 17:42:34 [W] klustakwik Linear algebra error on cluster 40 17:42:34 [W] klustakwik Linear algebra error on cluster 41 17:42:34 [W] klustakwik Linear algebra error on cluster 42 17:42:34 [W] klustakwik Linear algebra error on cluster 43 17:42:34 [W] klustakwik Linear algebra error on cluster 44 17:42:34 [W] klustakwik Linear algebra error on cluster 45 17:42:34 [W] klustakwik Linear algebra error on cluster 46 17:42:34 [W] klustakwik Linear algebra error on cluster 47 17:42:34 [W] klustakwik Linear algebra error on cluster 48 17:42:34 [W] klustakwik Linear algebra error on cluster 49 17:42:34 [W] klustakwik Linear algebra error on cluster 50 17:42:34 [W] klustakwik Linear algebra error on cluster 51 17:42:34 [W] klustakwik Linear algebra error on cluster 52 17:42:34 [W] klustakwik Linear algebra error on cluster 53 17:42:34 [W] klustakwik Linear algebra error on cluster 54 17:42:34 [W] klustakwik Linear algebra error on cluster 55 17:42:34 [W] klustakwik Linear algebra error on cluster 56 17:42:34 [W] klustakwik Linear algebra error on cluster 57 17:42:34 [W] klustakwik Linear algebra error on cluster 58 17:42:34 [W] klustakwik Linear algebra error on cluster 59 17:42:34 [W] klustakwik Linear algebra error on cluster 60 17:42:34 [W] klustakwik Linear algebra error on cluster 61 17:42:34 [W] klustakwik Linear algebra error on cluster 62 17:42:34 [W] klustakwik Linear algebra error on cluster 63 17:42:34 [W] klustakwik Linear algebra error on cluster 64 17:42:34 [W] klustakwik Linear algebra error on cluster 65 17:42:34 [W] klustakwik Linear algebra error on cluster 66 17:42:34 [W] klustakwik Linear algebra error on cluster 67 17:42:34 [W] klustakwik Linear algebra error on cluster 68 17:42:34 [W] klustakwik Linear algebra error on cluster 69 17:42:34 [W] klustakwik Linear algebra error on cluster 70 17:42:34 [W] klustakwik Linear algebra error on cluster 71 17:42:34 [W] klustakwik Linear algebra error on cluster 72 17:42:34 [W] klustakwik Linear algebra error on cluster 73 17:42:34 [W] klustakwik Linear algebra error on cluster 74 17:42:34 [W] klustakwik Linear algebra error on cluster 75 17:42:34 [W] klustakwik Linear algebra error on cluster 76 17:42:34 [W] klustakwik Linear algebra error on cluster 77 17:42:34 [W] klustakwik Linear algebra error on cluster 78 17:42:34 [W] klustakwik Linear algebra error on cluster 79 17:42:34 [W] klustakwik Linear algebra error on cluster 80 17:42:34 [W] klustakwik Linear algebra error on cluster 81 17:42:34 [W] klustakwik Linear algebra error on cluster 82 17:42:34 [W] klustakwik Linear algebra error on cluster 83 17:42:34 [W] klustakwik Linear algebra error on cluster 84 17:42:34 [W] klustakwik Linear algebra error on cluster 85 17:42:34 [W] klustakwik Linear algebra error on cluster 86 17:42:34 [W] klustakwik Linear algebra error on cluster 87 17:42:34 [W] klustakwik Linear algebra error on cluster 88 17:42:34 [W] klustakwik Linear algebra error on cluster 89 17:42:34 [W] klustakwik Linear algebra error on cluster 90 17:42:34 [W] klustakwik Linear algebra error on cluster 91 17:42:34 [W] klustakwik Linear algebra error on cluster 92 17:42:34 [W] klustakwik Linear algebra error on cluster 93 17:42:34 [W] klustakwik Linear algebra error on cluster 94 17:42:34 [W] klustakwik Linear algebra error on cluster 95 17:42:34 [W] klustakwik Linear algebra error on cluster 96 17:42:34 [W] klustakwik Linear algebra error on cluster 97 17:42:34 [I] klustakwik Not enough clusters to try deletion 17:42:35 [I] klustakwik Iteration 1F: 2 clusters, 5767580 changed, score=89788648.310887 17:42:55 [I] klustakwik Not enough clusters to try deletion 17:42:55 [I] klustakwik Iteration 2F: 2 clusters, 0 changed, score=231.982110 (decreased by 89788416.328777) 17:42:55 [I] klustakwik No points changed and last step was full, so trying to split. 17:42:55 [I] klustakwik Trying to split clusters 17:43:13 [I] klustakwik No points changed, previous step was full and did not split, so finishing. 17:43:13 [I] launch:131 The automatic clustering process has finished. 17:43:13 [I] launch:268 Save the clustering to
2022-08-29_15-46-52M4R1.kwik. 17:43:14 [I] model:1085 Save the Kwik file atC:\klusta\PRM files\HP\2022-08-29_15-46-52M4R1\2022-08-29_15-46-52M4R1.kwik. 17:43:14 [I] launch:290 Clustering done!Why could I be getting those Linear algebra errors? I have enough space on the PC.