authors: Zi Yin, Vin Sachidananda, Balaji Prabhakar
paper: arxiv
1. What is it?
They propose a global anchor method, regularizing a local anchor method.
2. What is amazing compared to previous works?
They show that the global anchor method is equivalent to the alignment methods.
Moreover, their method can be adapted easily and represent changes in different times and domains.
3. Where is the key to technologies and techniques?
3.0 Local anchor method (previous work)
Calculate inner products of a target word i with l anchors in word vector spaces E and F.
Then, the norm of the difference of those vectors is computed.
✅ easy to use
❌ anchor words need to be manually selected
3.1 Global anchor method
They consider that all words in the vocabulary as anchors.
✅ easy to use
✅ does not need to select anchor words manually
✅ works between vectors with different numbers of dimensions (not in the alignment methods)
4. How did evaluate it?
4.1 trajectories of anchor difference
From Figure 1, linguistic variation increases with respect to |i − j|, which is expected in Google Books Ngram.
(This result is also shown in other corpora, Reddit, arxiv, and COHA).
Moreover, Figure 2 shows that there is a clear upward trend after 1944.
4.2 trajectory and domain similarity of corpora
Using the distance matrix such as EE^T or FF^T, they propose a Laplacian Embedding.
The laplacian embedding creates a document-based vector from the difference matrix for each corpus E or F.
Figures 3(a) and 3(b) shows that their laplacian embedding capture the trajectory and domain similarity.
0. Paper
authors: Zi Yin, Vin Sachidananda, Balaji Prabhakar paper: arxiv
1. What is it?
They propose a global anchor method, regularizing a local anchor method.
2. What is amazing compared to previous works?
They show that the global anchor method is equivalent to the alignment methods. Moreover, their method can be adapted easily and represent changes in different times and domains.
3. Where is the key to technologies and techniques?
3.0 Local anchor method (previous work)
Calculate inner products of a target word![スクリーンショット 2021-08-13 2 18 36](https://user-images.githubusercontent.com/45454055/129240264-d4d603da-9076-4e45-86a5-9f8b302f3fe1.png)
i
withl
anchors in word vector spacesE
andF
.Then, the norm of the difference of those vectors is computed.![スクリーンショット 2021-08-13 2 19 27](https://user-images.githubusercontent.com/45454055/129240362-23ab1430-e7b4-41ab-88c0-41c74c0b30ac.png)
3.1 Global anchor method
They consider that all words in the vocabulary as anchors.![スクリーンショット 2021-08-13 2 21 43](https://user-images.githubusercontent.com/45454055/129240666-4acecd59-249d-4ed8-b0bc-bbbc9b4844ea.png)
4. How did evaluate it?
4.1 trajectories of anchor difference
From Figure 1, linguistic variation increases with respect to |i − j|, which is expected in Google Books Ngram. (This result is also shown in other corpora, Reddit, arxiv, and COHA).![スクリーンショット 2021-08-13 2 25 08](https://user-images.githubusercontent.com/45454055/129241125-50135c2e-07f2-499b-ad0c-65e5228f9251.png)
Moreover, Figure 2 shows that there is a clear upward trend after 1944.![スクリーンショット 2021-08-13 2 28 25](https://user-images.githubusercontent.com/45454055/129241630-50ecb2c7-9fc6-4d1e-8c16-67c2b599dd17.png)
4.2 trajectory and domain similarity of corpora
Using the distance matrix such as![スクリーンショット 2021-08-13 2 30 56](https://user-images.githubusercontent.com/45454055/129241976-2aab1210-c369-4335-b4a0-c5133b71a74a.png)
EE^T
orFF^T
, they propose a Laplacian Embedding. The laplacian embedding creates a document-based vector from the difference matrix for each corpusE
orF
.Figures 3(a) and 3(b) shows that their laplacian embedding capture the trajectory and domain similarity.
![スクリーンショット 2021-08-13 2 34 20](https://user-images.githubusercontent.com/45454055/129242440-26221419-14d1-467a-8fd6-908525437b12.png)
5. Is there a discussion?
6. Which paper should read next?