Open kyleabeauchamp opened 8 years ago
pytables 3.2.2 np110py27_0
pymc 2.3.6 np110py27_0
@kyleabeauchamp Can you post a small example that replicates the error?
Here you go. AFAIK, the key ingredient is something about the observed variable or the deterministic. Without those, things work fine in HDF.
import pymc as pm
n_vars = 50
n_observations = 10000
observed = np.random.random_integers(1, 100, size=n_observations)
z = pm.Uniform("z", 0.0, 1E8, size=n_vars)
@pm.deterministic
def detvar(z=z):
return np.ones(n_observations)
w = pm.Normal("w", detvar, 1, observed=True,value=observed)
variables = [z, detvar, w]
mcmc = pm.MCMC(variables, db='hdf5', dbname="test.h5")
mcmc.sample(100000, thin=10, burn=1000)
I have been getting the same error. It has to do with the size of the stochastic variables that are being observed. When I reduce n_observations to 100, the error goes away. The magic number is between 8000 and 8250. I am looking into why there is that limit.
I'm having issues with the HDF5 backend on OSX. Upon calling
step()
I get the following traceback. I presume there's some pytables / HDF5 / anconda dependency problem. I was able to successfully runtables.test()
, so there's not something royally busted about my install.