search

ManifoldRG / NEKO

In Progress Implementation of GATO style Generalist Multimodal model capable of image, text, RL and Robotics tasks
https://discord.gg/brsPnzNd8h
GNU General Public License v3.0
43 stars 10 forks source link

`deterministic=[False|True]` might not be working. #82

Closed eihli closed 6 months ago

eihli commented 6 months ago

Update: Maybe not an issue. It might only be non-deterministic when training. See: https://github.com/eihli/NEKO/blob/7983802d9854bcb707814dc42c0d93c99c4b5fea/gato/policy/embeddings.py#L92

See cells 58 and 59 of https://github.com/eihli/NEKO/blob/7983802d9854bcb707814dc42c0d93c99c4b5fea/dev_notebooks/vqa_playground_fix.ipynb

image

eihli commented 6 months ago

I just didn't realize I needed to put the model in eval() mode to get determinism to work.