Closed LWilkinKrug closed 3 years ago
Usually, the better the contouring, the better the clustering. The contour is based on the tonality slider, so padding doesn't change anything. Unfortunately, you can only pick 1 value for tonality for the entire dataset. Whatever the slider is set to when you hit the clustering button will be used. I would open a representative file, set the slider, and then cluster everything.
We wanted to add file or call based tonality, but didn't have time to add the feature. If anyone on your team can code and wants to add it, feel free to send us a pull request!
More thoughts: Are pup calls less tonal than adult calls? Does the constant 58 kHz bad mess with the contour?
Newer clustering method (I am not sure if they clustered appropriately with DeepSqueak, so it may be better or not depending): https://www.biorxiv.org/content/10.1101/811661v1.full.pdf
I wouldn't say they are less tonal, but the constant noise line certainly messes with the output. Also, the line is not always at 58kHz either.
Hi Kevin,
Picking this up again: With the new version of DS, will the by-call tonality setting be possible?
Cheers
Linda
It isn't yet, but I am hoping to implement it.
On Sun, Jul 18, 2021 at 6:21 PM DocKrugie @.***> wrote:
Hi Kevin,
Picking this up again: With the new version of DS, will the by-call tonality setting be possible?
Cheers
Linda
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/DrCoffey/DeepSqueak/issues/86#issuecomment-882156699, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJOFGE6L5OF6A4IB5GADVXTTYN4YVANCNFSM4NZ3SUSA .
-- Kevin Coffey, Ph.D. Postdoctoral Scholar Psychiatry & Behavioral Science University of Washington School of Medicine mrcoffey [at] uw.edu @.***> | (860) 874 5659
when will the next version be available?
You can download the development version here now:
https://github.com/DrCoffey/DeepSqueak/tree/Screener
If you use GitHub Desktop to clone it, you can easily update it as we make improvements. I'm not not sure when it will get merged with the main branch, I don't have much programming help these days and this has become a back burner project.
On Mon, Jul 19, 2021 at 2:36 PM DrWilkin-Krug @.***> wrote:
when will the next version be available?
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/DrCoffey/DeepSqueak/issues/86#issuecomment-882877373, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJOFGE2ETXWO3DCONOQNLMDTYSLCJANCNFSM4NZ3SUSA .
-- Kevin Coffey, Ph.D. Postdoctoral Scholar Psychiatry & Behavioral Science University of Washington School of Medicine mrcoffey [at] uw.edu @.***> | (860) 874 5659
Great, but does it include the by-call tonality? Without it, we won’t be able to process our files for clustering.
On 21/07/2021, at 6:24 AM, DrCoffey @.***> wrote:
You can download the development version here now:
https://github.com/DrCoffey/DeepSqueak/tree/Screener
If you use GitHub Desktop to clone it, you can easily update it as we make improvements. I'm not not sure when it will get merged with the main branch, I don't have much programming help these days and this has become a back burner project.
On Mon, Jul 19, 2021 at 2:36 PM DrWilkin-Krug @.***> wrote:
when will the next version be available?
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/DrCoffey/DeepSqueak/issues/86#issuecomment-882877373, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJOFGE2ETXWO3DCONOQNLMDTYSLCJANCNFSM4NZ3SUSA .
-- Kevin Coffey, Ph.D. Postdoctoral Scholar Psychiatry & Behavioral Science University of Washington School of Medicine mrcoffey [at] uw.edu @.***> | (860) 874 5659
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FDrCoffey%2FDeepSqueak%2Fissues%2F86%23issuecomment-883602051&data=04%7C01%7Clinda.wilkin-krug%40vuw.ac.nz%7C0cf8f7949a514386217b08d94bab99eb%7Ccfe63e236951427e8683bb84dcf1d20c%7C0%7C0%7C637624022737596433%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=akCCASrQdXeD%2Baf%2B5BNjKakuKrs4Tnu5D%2FmxV71MyhE%3D&reserved=0, or unsubscribehttps://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAJ3QWQDPQRJPYKIBR4KRZY3TYW5NLANCNFSM4NZ3SUSA&data=04%7C01%7Clinda.wilkin-krug%40vuw.ac.nz%7C0cf8f7949a514386217b08d94bab99eb%7Ccfe63e236951427e8683bb84dcf1d20c%7C0%7C0%7C637624022737606427%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=84R1IzvkGY95JbGIecHdvDqyNISHujK0xyeeKNix6N8%3D&reserved=0.
It won't be releasing with by-call tonality, but it will have improved automatic contour extraction and the ability to adjust boxes easily, which really helps define the contour. It will also release with a new clustering method that does not use the contour, but instead the entire spectrogram (VAEs).
It is on the development list, but to be honest it is low priority. We don't have many issues with contour extraction and there is lot else we (really just me at this point) want to get done, and I have very limited time for DeepSqueak.
I would be very happy if you decide to implement by-call tonality on your own fork and then send a pull request! I always hoped the community would help develop the features that they wanted most and then send them in for inclusion in the main branch, but unfortunately that has only happened once...
I am going to consider this a "Feature Request" and move it to the Gitter page here: https://gitter.im/DeepSqueak_Community/FeatureRequests
Hi Kevin,
I've been trying to cluster about 55,000 rat pup calls. All calls were hand-checked in Raven. Initially, I ran unsupervised clustering with the standard settings (Weight: 1/1/1, max clusters: 100, reps: 3), but have since tried several other combinations without much luck. While some clusters look pretty good, others seem to be a mix of e.g. step up, step down, multi-step, or upward ramp, downward ramp, inverted U, short.
I used k means clustering in R, but the clusters didn't make sense either; plus R doesn't provide a visual cluster overview i.e. no way to easily check the clusters.
Because I have a permanent noise line from the air vent system in the lab at about 58 kHz, I deduced that perhaps this was interfering with the contour output, so I manually adjusted the contour threshold for calls in 40 files, thinking that this should allow me to get clean clusters—but it didn't.
I tried the WrightClassifier, but that wasn't usable either.
I was wondering if DS adds padding around the calls which might change the contour and subsequently the slope?
Thanks for any ideas and help you can offer.
Warm regards
Linda