search

ijyliu / anlp23-project

An empirical study of the costs and practicalities of prompt engineering techniques on standard and novel benchmarks
0 stars 0 forks source link

coherence with embeddings and cosine similarity #64

Closed ijyliu closed 9 months ago

ijyliu commented 9 months ago

image

ijyliu commented 9 months ago

average embeddings

ijyliu commented 9 months ago

isn't this similar to the initial bert trained task of sentence sequences?

ijyliu commented 9 months ago

https://aclanthology.org/2021.acl-short.134.pdf

ijyliu commented 9 months ago

in jurafsky

https://web.stanford.edu/~jurafsky/slp3/27.pdf

ijyliu commented 9 months ago

with our sentence to sentence and paragraph averaged embeddings, we do get a good sense of both local and global coherence

footnote: other structural global methods were considered, but not implemented due to the short length of the task responses at only two paragraphs