GGVec is currently unstable with high number of dimensions, due to dot products hitting the clipping boundary too often.
This can be done by scaling the dot product by the square root of the number of dimensions as noted in the section 2 "scaling the dot product" here: http://peterbloem.nl/blog/transformers
This should be implemented in the GGVec core algorithm.
GGVec is currently unstable with high number of dimensions, due to dot products hitting the clipping boundary too often.
This can be done by scaling the dot product by the square root of the number of dimensions as noted in the section 2 "scaling the dot product" here: http://peterbloem.nl/blog/transformers
This should be implemented in the GGVec core algorithm.