@tholoien @drphilmarshall
As we have discussed before, we are very interested in this methodology for both catalog and image simulations. Therefore validating this method and maybe retraining it (but trying to keep most of the methodology in place) is important. Since you had said that there were no plans for a validation paper, some of us in DESC would like to validate and retrain this model. @kponder produced a first plot of something we wanted to check (and we have discussed before) : since the SN properties trained on galaxy properties are not intrinsic properties but a mixture of intrinsic and observed properties, is the very important expected redshift distance relationship preserved? While the current result is extremely preliminary, and we need to spend more time on it, it seemed that there are larger residuals that we would like from this relationship.
This and several other quantitive questions require further investigation. @kponder, I and perhaps other collaborators intend to create lists of such issues, investigate them and check if we can improve the model. We would also like to record the results as they progress in an ongoing LSST DESC note. Obviously, we might try to ask you questions as this moves along.
What is a good place for us to do this in terms of a github repository. Would you prefer that we used this repository (and merge with master as things move along), or woudl you prefer that we set up own own fork altogether?
@tholoien @drphilmarshall As we have discussed before, we are very interested in this methodology for both catalog and image simulations. Therefore validating this method and maybe retraining it (but trying to keep most of the methodology in place) is important. Since you had said that there were no plans for a validation paper, some of us in DESC would like to validate and retrain this model. @kponder produced a first plot of something we wanted to check (and we have discussed before) : since the SN properties trained on galaxy properties are not intrinsic properties but a mixture of intrinsic and observed properties, is the very important expected redshift distance relationship preserved? While the current result is extremely preliminary, and we need to spend more time on it, it seemed that there are larger residuals that we would like from this relationship.
This and several other quantitive questions require further investigation. @kponder, I and perhaps other collaborators intend to create lists of such issues, investigate them and check if we can improve the model. We would also like to record the results as they progress in an ongoing LSST DESC note. Obviously, we might try to ask you questions as this moves along.
What is a good place for us to do this in terms of a github repository. Would you prefer that we used this repository (and merge with master as things move along), or woudl you prefer that we set up own own fork altogether?