search

alaineiturria / otsad

Online Time Series Anomaly Detectors
28 stars 4 forks source link

Learning more about otsad #2

Open markNZed opened 2 years ago

markNZed commented 2 years ago

Hi, I'm interested in NAB and just came across your project. Do you have a summary of the NAB scores achieved with the detectors in otsad? Is Numenta's HTM included in otsad (It seems that it is not). Are any of the detectors out-performing Numenta's HTM on NAB? Thanks!

alaineiturria commented 2 years ago

Hi markNZed , thanks for your comment. We have an article related to this project where we made a comparative study of the algorithms included in otsad: A. Iturria, J. Carrasco, S. Charramendieta, A. Conde, F. Herrera, otsad: A package for online time-series anomaly detectors, Neurocomputing 374 (2020) 49–53. However, I am sorry to inform you that we could not implement Numenta's HTM algorithm in otsad, and thus it was left out of the comparative study.

markNZed commented 2 years ago

Thanks for your reference! I'm confused why Numenta's HTM algorithm could not be used with otsad - given that otsad is based on the Numenta Anomaly Benchmark (NAB) the benchmark was well suited to running HTM. Could you please help me understand the problem with HTM, perhaps @subutai could help. Did you ask Numenta for help? There is also an active forum of users that might help (with a section dedicated to NAB) https://discourse.numenta.org/c/engineering/nab/36

alaineiturria commented 2 years ago

The main reason Numenta’s HTM is not included is that at the time of the otsad package implementation (2018), Numenta’s HTM was not upgraded to python3. Moreover, even though it is currently upgraded to python3, it relies on Numpic, which is still Python2 (https://github.com/numenta/NAB/tree/master/nab/detectors/numenta). I am not sure if it is possible to combine pyhton2 and python3 dependencies in the same R library; however, the combination of both would make the use and installation of the package more complex and confuse R users who are not familiar with Python.

markNZed commented 2 years ago

That makes sense to me. I will ask on the forum if anyone has a solution - there are a number of different HTM implementations and perhaps one of them is Python3.

markNZed commented 2 years ago

@alaineiturria this might be of interest https://discourse.numenta.org/t/is-there-an-htm-version-that-could-integrate-with-otsad-e-g-python3/9097 it seems the https://github.com/htm-community/htm.core implementation is intended to simplify things and runs with Python3.

markNZed commented 2 years ago

Better news, I just came across https://github.com/htm-community/NAB which is a port of NAB with HTM that supports Python3. Maybe that can integrate with otsad?