Input: Two (one) dimensional function, that gives the PMF of a univariate distribution. x = f(t1, t2); in Python, this comes as a simple function from Real*Real to Real, case in point, log-normal function.
Algorithm:
Transform the parameter space to unit cube of dimension n=1,2, e.g., (1+ arctan(t))/2 (optional)
Learn the Sigmoid(t1), Sigmoid(t2) (optional: learn t1,t2, not their sigmoid) using the usual statistical method of generating synthetic data.
Compute the variance of the error of learning, it is typically a function of t1, t2, e.g., the error is not the same everywhere.
Compute the fisher information: Log, Derivate, Square (analytically), integrate (numerically) over x, ranging over all reals.
Input: Two (one) dimensional function, that gives the PMF of a univariate distribution. x = f(t1, t2); in Python, this comes as a simple function from Real*Real to Real, case in point, log-normal function.
Algorithm: