search

maxpumperla / hyperas

Keras + Hyperopt: A very simple wrapper for convenient hyperparameter optimization
http://maxpumperla.com/hyperas/
MIT License
2.17k stars 316 forks source link

Unable to use tensorboard with hyperas #221

Open smk5g5 opened 5 years ago

smk5g5 commented 5 years ago

Hi,

I am trying to use hyperas with tensorboard call back. I am not using data generator for validation or training data but still it is giving me the error as described in the gist below.Thanks!

https://gist.githubusercontent.com/smk5g5/09e52b7d1181245eb960230f9828cc28/raw/87827a6c66c0f76e421b262063203d4a0485509b/Run_hyperas.py

Below is the error stack trace

Train on 15256 samples, validate on 3814 samples Epoch 1/500 Traceback (most recent call last): File "Run_hyperas.py", line 167, in trials=Trials()) File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/hyperas/optim.py", line 67, in minimize verbose=verbose) File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/hyperas/optim.py", line 133, in base_minimizer return_argmin=True), File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/hyperopt/fmin.py", line 367, in fmin return_argmin=return_argmin, File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/hyperopt/base.py", line 635, in fmin return_argmin=return_argmin) File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/hyperopt/fmin.py", line 385, in fmin rval.exhaust() File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/hyperopt/fmin.py", line 244, in exhaust self.run(self.max_evals - n_done, block_until_done=self.asynchronous) File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/hyperopt/fmin.py", line 218, in run self.serial_evaluate() File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/hyperopt/fmin.py", line 137, in serial_evaluate result = self.domain.evaluate(spec, ctrl) File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/hyperopt/base.py", line 840, in evaluate rval = self.fn(pyll_rval) File "/home/smk5g5/PSU_secstr/hyperas_combined_model/temp_model.py", line 433, in keras_fmin_fnct File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/keras/engine/training.py", line 1037, in fit validation_steps=validation_steps) File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/keras/engine/training_arrays.py", line 199, in fit_loop outs = f(ins_batch) File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/keras/backend/tensorflow_backend.py", line 2666, in call return self._call(inputs) File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/keras/backend/tensorflow_backend.py", line 2636, in _call fetched = self._callable_fn(*array_vals) File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1382, in call run_metadata_ptr) File "/home/smk5g5/.conda/envs/py36/lib/python3.6/site-packages/tensorflow/python/framework/errors_impl.py", line 519, in exit c_api.TF_GetCode(self.status.status)) tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value training/Nadam/Variable_3 [[Node: training/Nadam/Variable_3/read = IdentityT=DT_FLOAT, _class=["loc:@training/Nadam/Assign_9"], _device="/job:localhost/replica:0/task:0/device:GPU:0"]] [[Node: loss/add_3/_47 = _Recv[client_terminated=false, recv_device="/job:localhost/replica:0/task:0/device:CPU:0", send_device="/job:localhost/replica:0/task:0/device:GPU:0", send_device_incarnation=1, tensor_name="edge_1800_loss/add_3", tensor_type=DT_FLOAT, _device="/job:localhost/replica:0/task:0/device:CPU:0"]()]]