Open lixusign opened 4 years ago
self.stores = [ tf.get_variable('storelayer{}'.format(i), [self.max_id + 2, self.dim], initializer=tf.random_uniform_initializer( maxval=self.store_init_maxval, seed=1), trainable=False, collections=[tf.GraphKeys.LOCAL_VARIABLES]) for i in range(1, self.num_layers)] self.gradient_stores = [ tf.get_variable('gradient_storelayer{}'.format(i), [self.max_id + 2, self.dim], initializer=tf.zeros_initializer(), trainable=False, collections=[tf.GraphKeys.LOCAL_VARIABLES]) for i in range(1, self.num_layers)]
这个地方内存很恐怖，感觉是不是改成hashVariable方式,懒加载，要不PS上来就满了，而且lookup会比较慢，求官方帮看看这么改是否可行
self.stores = [ tf.get_variable('storelayer{}'.format(i), [self.max_id + 2, self.dim], initializer=tf.random_uniform_initializer( maxval=self.store_init_maxval, seed=1), trainable=False, collections=[tf.GraphKeys.LOCAL_VARIABLES]) for i in range(1, self.num_layers)] self.gradient_stores = [ tf.get_variable('gradient_storelayer{}'.format(i), [self.max_id + 2, self.dim], initializer=tf.zeros_initializer(), trainable=False, collections=[tf.GraphKeys.LOCAL_VARIABLES]) for i in range(1, self.num_layers)]
这个地方内存很恐怖，感觉是不是改成hashVariable方式,懒加载，要不PS上来就满了，而且lookup会比较慢，求官方帮看看这么改是否可行