shuaigezhu / star_galaxy_classification

0 stars 1 forks source link

apply gaussian blur #30

Open shuaigezhu opened 4 years ago

shuaigezhu commented 4 years ago

Hi Kwang. Do you have any advice about how should I select 'label-pixels' and 'unlabel-pixels' (unlabeled pixels are meaning of 25% for each class) after I apply gaussian blur? In the past, I just need to split them as 25% points and non-25% points. The reason I ask this question is 'label-pixels' and 'unlabel-pixels' are highly related to the weights in loss function.

kmyi commented 4 years ago

You can threshold with a certain value for each label and then use that instead of selecting 25% and non-25%.

Kwang Moo YI Assistant Professor Dept. of Computer Science University of Victoria +1 (250) 472 5837

On Apr 6, 2020, at 10:22, Yufeng notifications@github.com wrote:

Hi Kwang. Do you have any advice about how should I select 'label-pixels' and 'unlabel-pixels' (unlabeled pixels are meaning of 25% for each class) after I apply gaussian blur? In the past, I just need to split them as 25% points and non-25% points. The reason I ask this question is 'label-pixels' and 'unlabel-pixels' are highly related to the weights in loss function.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe.

sfabbro commented 4 years ago

Since you are doing regression now rather than classification, do you need to split your pixels? Why not simply applying your Gaussian blur over the whole label maps after you set your background pixels as 0.25?

kmyi commented 4 years ago

I would imagine you still need to balance training samples :) Regression also needs some balancingg

Message written with iPhone. Please excuse any brievity and typos. — Kwang Moo YI Assistant Professor Dept. of Computer Science University of Victoria +1 (250) 475 5837

On Apr 6, 2020, at 11:33, Sébastien Fabbro notifications@github.com wrote:

 Since you are doing regression now rather than classification, do you need to split your pixels? Why not simply applying your Gaussian blur over the whole label maps after you set your background pixels as 0.25?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

shuaigezhu commented 4 years ago

Since you are doing regression now rather than classification, do you need to split your pixels? Why not simply applying your Gaussian blur over the whole label maps after you set your background pixels as 0.25?

Yes, I have applied Gaussian blur over the whole label maps, but then I need to decide the weights of unlabeled pixels and labeled pixels. The reason I split it up is I don't want the unlabeled pixels with actual objects there, to have the same weight as the labeled pixels.

sfabbro commented 4 years ago

You can do something like this: 1 - Make your probability label maps P, with 0.25 on the background pixels 2 - Make a probability variance map with a large error on background pixels (>0.5) and small error on labels (0.01). Then you do; Var[P] = 0.01^2 on labels, Var[P] = 0.5^2 on unlabelled 3 - Make a Gaussian kernel k. Apply k to P, and apply kernel k² to Var[P] 4 - Apply weights on all pixels as weight = 1/Var[P], replacing the P=0 with P=1e-6 to avoid NaN 6 - Use the MSE weighted loss sum( (P_model - P_label)^2 * weight )

On Mon, 6 Apr 2020 at 11:40, Yufeng notifications@github.com wrote:

Since you are doing regression now rather than classification, do you need to split your pixels? Why not simply applying your Gaussian blur over the whole label maps after you set your background pixels as 0.25?

Yes, I have applied Gaussian blur over the whole label maps, but then I need to decide the weights of unlabeled pixels and labeled pixels. The reason I split it up is I don't want the unlabeled pixels with actual objects there, to have the same weight as the labeled pixels.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/shuaigezhu/star_galaxy_classification/issues/30#issuecomment-609968044, or unsubscribe https://github.com/notifications/unsubscribe-auth/AALKLLUXPW56RO435K3TDW3RLIOZNANCNFSM4L2VHITA .

kmyi commented 4 years ago

Please post the final outcome, example images before you close the issues. Can you do that for the rest as well?

shuaigezhu commented 4 years ago

yes, of course

Kwang Moo Yi notifications@github.com 于2020年4月13日周一 下午12:30写道:

Please post the final outcome, example images before you close the issues. Can you do that for the rest as well?

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub https://github.com/shuaigezhu/star_galaxy_classification/issues/30#issuecomment-613056576, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALMEKTI2QJFHH3NWLJSIDETRMNR7FANCNFSM4L2VHITA .

shuaigezhu commented 4 years ago

Please post the final outcome, example images before you close the issues. Can you do that for the rest as well?

In this issue, for example, the gaussian blur would make central pixel with a value of 1 spread to 9 nearby pixels with the value of [0.33024799 0.33483236 0.33024799 0.33483236 0.33967865 0.33483236 0.33024799 0.33483236 0.33024799]
I uploaded the evaluation of final outcome by the confusion matrix for 6 types of model in issue #35 Confusion Matrix, and anything else I should post?

shuaigezhu commented 4 years ago

Screen Shot 2020-08-17 at 1 48 22 PM The yellow point is the pixel with prob = 1

Screen Shot 2020-08-17 at 1 48 29 PM After applied gaussian blur