ajschumacher / ajschumacher.github.io

blog
http://planspace.org/
20 stars 21 forks source link

Topics to open #226

Open ajschumacher opened 3 years ago

ajschumacher commented 3 years ago

Things that maybe I should learn more about and/or write explainers for...

ajschumacher commented 3 years ago

Heckman correction

ajschumacher commented 3 years ago

the kernel trick (formerly #221)

ajschumacher commented 3 years ago

wavelets (formerly #210)

"... much more modern ideas, like the theory of wavelets developed in the 1970s and '80s by Jean Morlet, Stéphane Mallat, Yves Meyer, Ingrid Daubechies, and others" (page 330, Ellenberg)

ajschumacher commented 3 years ago

Turbocodes (formerly #200)

ajschumacher commented 3 years ago

support vector machines (SVM) (formerly #196)

ajschumacher commented 3 years ago

Baum–Welch algorithm (formerly #187)

https://en.wikipedia.org/wiki/Baum%E2%80%93Welch_algorithm

(recommended via that book about Simons)

ajschumacher commented 3 years ago

Fast Fourier transform (FFT) (formerly #154)

Downey's stuff might be a good start... Anyway I saw this tweet:

Which links to this notebook:


https://twitter.com/jezzamonn/status/1083498750050553856

mention Fourier in case I search by that...

https://www.jezzamon.com/fourier/index.html


FFT comes up here: https://www.quantamagazine.org/mathematicians-discover-the-perfect-way-to-multiply-20190411/ kind of surprisingly?


https://realpython.com/python-scipy-fft/


This has a FFT section: https://pythonnumericalmethods.berkeley.edu/notebooks/Index.html


twiddle factors?

ajschumacher commented 3 years ago

Hungarian association algorithm (formerly #153)

ajschumacher commented 3 years ago

particle filters (formerly #151)

ajschumacher commented 3 years ago

transducers (formerly #150)

ajschumacher commented 3 years ago

Kalman filters (formerly #149)

Least-squares estimation: from Gauss to Kalman https://www2.pv.infn.it/~fontana/download/lect/Sorenson.pdf

I had some old note like this:

Wiener process / Kalman filtering (connection with Gaussian process?)

Fun demo recommended by Gerardo Leal: https://www.cs.utexas.edu/~teammco/misc/kalman_filter/

ajschumacher commented 3 years ago

IRR function? in Excel? (formerly #131)

ajschumacher commented 3 years ago

beam search / viterbi (formerly #109 and also #81)

ajschumacher commented 3 years ago

top, htop, etc. (formerly #101)

ajschumacher commented 3 years ago

softmax temperature (formerly #105)

and let's group this with softmax generally (formerly #74)

http://en.wikipedia.org/wiki/Softmax_function

ajschumacher commented 3 years ago

inverting / pseudo-inverting a matrix (formerly #82)

fun highlights of various intuitions: https://twitter.com/michael_nielsen/status/1073673971583705089

ajschumacher commented 3 years ago

tSNE/UMAP (formerly #41)

ajschumacher commented 3 years ago

"Relative Weight Analysis"?

This fairly bad post has gotten some play online:

https://towardsdatascience.com/key-driver-analysis-in-python-788beb9b8a7d

It seems to be largely based on this better article:

https://www.researchgate.net/profile/Nicola_Di_Girolamo2/post/Which_is_the_Best_Effect-Size_for_Predictors_in_Multivariate_Logistic_Regression/attachment/59d632e0c49f478072ea1d4a/AS%3A273637431545864%401442251655932/download/Relative+Importance+Analysis%3A+A+Useful+Supplement+to+Regression+Analysis.pdf

Kind of neat as another kind of feature importance?

ajschumacher commented 3 years ago

Learn more languages? C++? Elixir?

ajschumacher commented 3 years ago

figure out a good way to do speech-to-text? for calls and so on?

ajschumacher commented 3 years ago

Morris traversal?

https://www.educative.io/edpresso/what-is-morris-traversal

https://m.youtube.com/watch?v=3rdM5fBjnB8

ajschumacher commented 3 years ago

https://en.wikipedia.org/wiki/Toeplitz_matrix for convolution

ajschumacher commented 3 years ago

Power law: scaling to distribution?