microsoft / farmvibes-ai

FarmVibes.AI: Multi-Modal GeoSpatial ML Models for Agriculture and Sustainability
https://microsoft.github.io/farmvibes-ai/
MIT License
684 stars 118 forks source link

Possibility of Utilizing Empirical Mode Decomposition for pre-processing the data #26

Closed oshin94 closed 1 year ago

oshin94 commented 1 year ago

Hi, I have been going through the DeepMC part of the farmvibes.ai project and found that Wavelet Packet decomposition used as a pre-processor to allow models to understand and fit on the underlying patterns in the time-series data. . Similar to Wavelet Transform, Empirical Mode Decomposition (EMD) is an empirical, iterative and adaptive algorithm which decomposes a signal into components called Intrinsic Mode Functions (IMFs). EMD is also better suited for climate predictions on variables like temperature, rainfall etc., as it doesn't assume linearity of signal and has no prior assumptions of a basis function. . I was wondering if EMD would be a good additional option as a pre-processor along with the Wavelet Decomposition. Do let me know your thoughts. If you do feel it would be useful for the project, I will be happy to contribute the code to add that functionality. . References:

Thank you.

peeyush-kumar commented 1 year ago

EMD will be a good feature to have. Wavelets are used for scale based decomposition. One of the reasons is that it aids in explainability. As you correctly pointed out there are non-stationary aspects of the signals and boundary issues that still create challenges. It will be interesting to see how utilizing EMD solves for that.

Let us know if you need any support with contributing this feature!

oshin94 commented 1 year ago

Sorry for the late reply.. will start working on it..

rafaspadilha commented 1 year ago

Closing this issue for now. @oshin94, feel free to reopen it if you have updates on this.