Normalising embeddings
#24
by
wenhao89
- opened
Hi,
In the example of how to encode text using HuggingFace Transformers, it is shown that the encoded embeddings are normalised. Is normalisation necessary?
Thanks!
Regards,
Wen Hao
It is done just to remove the effect of magnitude of the vectors, since we only want the cosine angle between them.