shayandavoodii / CepstralCoefficients.jl

This package provides various tools for calculating the cepstral coefficients of time series and clustering them in Julia.
0 stars 1 forks source link

More efficient clustering method? #1

Open justcodebase opened 4 months ago

justcodebase commented 4 months ago

Would you have any suggestion regarding a more efficient clustering method?

I asked Mistral AI and was informed about:

Distance-based methods: These methods measure the similarity between time series using a distance metric, such as Euclidean distance, Dynamic Time Warping (DTW), or Longest Common Subsequence (LCSS). Once the distances between all pairs of time series have been computed, a clustering algorithm such as K-medoids or hierarchical clustering can be applied.

Model-based methods: These methods assume that each time series is generated by a probabilistic model, such as a Gaussian Mixture Model (GMM) or a Hidden Markov Model (HMM). The parameters of the model are estimated from the data using techniques such as Expectation-Maximization (EM), and the time series are assigned to clusters based on their probability of being generated by each model.

Shape-based methods: These methods focus on the shape of the time series, rather than their absolute values. For example, the time series may be normalized to have zero mean and unit variance, and then clustered based on features such as their Fourier coefficients or wavelet transforms.

Subspace clustering methods: These methods assume that the time series lie in a low-dimensional subspace of the high-dimensional space in which they are embedded. The subspace is estimated using techniques such as Principal Component Analysis (PCA) or Singular Value Decomposition (SVD), and the time series are clustered based on their proximity in the subspace.

Recently I have been reading about HiddenMarkovModels.jl (https://github.com/gdalle/HiddenMarkovModels.jl) by @gdalle and a few years ago (under a different name on Julia Discourse) I was in touch with @MommaWatasu, who is the author of some algorithms still quite unique in the Julia Ecosystem (https://docs.juliahub.com/General/HorseML/stable/Tutorial/Clustering/#).

Do you have maybe opinion about those methods?

justcodebase commented 4 months ago

Ah. I just took a look at your profile. It seems you are representing The Financial Engineering Department of The AmirKabir University of Technology (Polytechnic of Tehran, Iran). I was not aware about this fact. I have to admit that I have no idea about any potential constraints (and if such constraints exist at all) that may relate to this fact. I am very sorry. I will try to learn more about it. I am just a private individual interested in financial subjects. Again, I will try my best to learn more about the current environment. I really mean it. I am not looking for any troubles. I am very sorry again. Just wanted to say that your public repos look very interesting. I wish you best.

shayandavoodii commented 4 months ago

Hey, It's fine, NP. What about Cepstral Clustering? I want to implement it too. It's pretty straightforward.

justcodebase commented 4 months ago

Hey, I have limited knowledge about fuzzy logic, however, your paper appears to be very interesting. I experimented a bit with your package. I observed that assigning more weight to recent time series data could potentially enhance the efficiency of the clustering in a practical sense. Additionally, I am curious about the dihedral hidden subgroup problem and the invariant subspace problem in Hilbert spaces, as well as Floer spectral invariants of Hamiltonian flows. Does such a combination make sense?

There does not appear to be a problem. I believe we can communicate. I visited the websites of The Embassy of the Republic of Poland in Tehran and The Embassy of the Islamic Republic of Iran in Warsaw. I also reviewed Polish-Iranian historical relations (for example, here: https://en.wikipedia.org/wiki/Iran-Poland_relations). I noticed that bilateral visits between representatives of our countries are occurring, with the recent visit of The Polish Ministry of Foreign Affairs to Iran taking place in 2022. I also recall reading about a Polish delegation participating in an important event in your country in recent years, although I apologize for not remembering all the details at the moment. My understanding is that our relations date back to the 16th, if not the 11th century, and that your country was very kind to provide shelter to more than 100,000 Poles during WW2. I also learned that your country has a rich history, numerous historical monuments, and ... very, if not extremely beautiful ... botanical gardens. However, I am aware that the situation in your region seems to be quite dynamic, and there were or might still be some limitations with regard to the topics we can communicate. I will try to consult with some of my friends who are legal advisors, but I don't think any of them specialize in these areas. If I don't receive precise information, I will attempt to contact the Secretariat of Mr. Maciej Fałkowski, who is The Ambassador Extraordinary and Plenipotentiary of the Republic of Poland in the Islamic Republic of Iran, to potentially receive additional information on these subjects. As you may have noticed, I reached out to some other people. The last time I was in contact with one of them was a few years ago, and I discovered that he was not of legal age according to Polish standards. So, it's a bit of a challenging situation for me. As you can see, I am doing my best.

I have a long-standing habit of not using my real name on the internet. It's not that I have anything to hide; there are only a few platforms where I have a profile with my full name. I noticed that you are on LinkedIn. I will send you an invitation there soon. If you don't find it suitable, please feel free and kindly disregard it. Best regards.

shayandavoodii commented 4 months ago

your paper appears to be very interesting

It's not my paper.

Does such a combination make sense?

In what aspect? Clustering time series?

I believe we can communicate.

Sure!

I have a long-standing habit of not using my real name on the internet.

It's fine! NP.

justcodebase commented 4 months ago

Does such a combination make sense? In what aspect? Clustering time series?

Well, what do you think, its my best take on the subject ...

I believe we can communicate. Sure!

Yeah, this is my current understanding! However, as I indicated, my deep concern relates to the legal aspects. I am still investigating the subject. I am doing some research on this topic on my own and as I indicated, I am planning to consult with The Secretariat of Mr. Ambassador Fałkowski. Besides, what framework are we going to employ? I took a look at various organizations for an inspiration. What do you think about the values of The United Nations? Due to various reasons, this would be my best take. But I am open for any suggestions.

I have a long-standing habit of not using my real name on the internet. It's fine! NP.

Great, thank you! As I indicated, I sent you an invite over LinkedIn. May I ask, did you receive it?

justcodebase commented 4 months ago

Hello. I don't see any response and I've noticed that my invitation on LinkedIn was pending. I understand that the topic is exhausting. Once again, I sincerely apologize for this situation. It was completely unexpected. Interesting package. Wishing you all the best. Cheers.