amrisi / amr-guidelines

244 stars 87 forks source link

Proposal of rolesets for Unification #124

Open timjogorman opened 9 years ago

timjogorman commented 9 years ago

Hi all! Here is the list of the rolesets that we still want to unify out of the ongoing de-unification discussion, with reasons why we want to keep these. We have also started on the task of finding more de-unifications for the remainder of the alphabet, and will post those when we have them

Summary of the de-unification:

51 pairs are being deunified (a few were already split), and we are expanding that list (The current list is at the bottom of this post ). We are also splitting another 7 verb senses to get the granularity required for unification: care, question, value, antagonize, compete, favor, know

12 of the 70 deunifications asked for, however, are sets that we think really should be unified. More detailed notes follow the brief list, including Ulf's complaints:

quick list of the proposed unifications

(more detailed notes at bottom)

hope-n/hope-v vs hopeful-j

We feel that almost all of the interpretations of "hopeful" involve some implication of hoping, but are talking out adding a second roleset for "hopeful" to accommodate the "hopeful prospect" instances. We simply posit that all the "hopeful" instances that entail hope should be unified with "hope".
(http://verbs.colorado.edu/propbank/framesets-english-aliases/hope.html)

equal-v vs equal-j

CU sees these as close enough to unify. Ulf noted "equal distribution of wealth", but you can say "their distributions of wealth equal each other", which is very similar. (http://verbs.colorado.edu/propbank/framesets-english-aliases/equal.html)

sympathize, sympathy vs sympathetic-j:

There are some instances of "sympathetic" that might mean "likable", but for English it almost always has some implication/entailment of sympathizing, and the sympathizing/liking distinction is often impossible to make in single-sentence context. Since they so close to mutual entailment, we propose unification. (http://verbs.colorado.edu/propbank/framesets-english-aliases/sympathize.html)

suspect-v / suspicion-n vs suspicious-j / suspect-j

There is a lot of variance in suspect, suspicious, suspicious, but we think this variance is as tied up with which arguments get realized as it is to which lexical item was used; we think it's close enough to unify. (Further discussion in details.) (http://verbs.colorado.edu/propbank/framesets-english-aliases/suspect.html)

elude-v vs elusive-j

Ulf notes a difference in completiveness here. We do agree that "elude" can often be more completive, but it's not 100% completive (you can get sentences like "His name eluded me until I saw his wife"), and would propose that it's close enough to unify. (http://verbs.colorado.edu/propbank/framesets-english-aliases/elude.html)

glory-v vs glory-n/glorious-j

We are separating out the verbal sense from the nominal one. "glorious" and nominal "glory" seem to be (roughly) the same concept, however, and we think they should be in the same roleset.
(http://verbs.colorado.edu/propbank/framesets-english-aliases/glory.html)

clingy vs cling

Ulf notes that clingy is more habitual, CU would note that "cling" can often be habitual too ("watch out, that shirt clings"), and "clingy" can be coerced to non-habitual ("stop being clingy."). Since "cling" is usually a state, this is less of a sharp contrast than other habitual/nonhabitual contrasts, and close enough to unify.
(http://verbs.colorado.edu/propbank/framesets-english-aliases/cling.html)

comfort-v vs comfortable ( and presumably comfort-n):

We do agree that there is a range of meaning from physical to abstract/emotional comfort, but posit that the range of meaning across verbal and nominal comfort is very broad ("I comforted the victim" vs "The comforting warmth of the stove") and seems like more of a difference than the differences between the verbal and adjectival senses ("The comforting warmth of the stove" vs "The comfortable warmth of my coat"). We think they are close enough to unify. (http://verbs.colorado.edu/propbank/framesets-english-aliases/comfort.html)

conclude/conclusive

Conclusive tends to be related to or being a conclusion. We are amending the frame so that "conclusive evidence" has a better argument for "evidence". (http://verbs.colorado.edu/propbank/framesets-english-aliases/conclude.html)

awe/awesome

The sense of awesome that means "evocative of awe" is hard to distinguish from the more hyperbolic version of the same sense. We have separate, additional senses of "awesome" as well. (http://verbs.colorado.edu/propbank/framesets-english-aliases/awe.html)

brave/brave/bravery

We just talked about trying to unify this, and do accept that the prototypical brave-j use is different from the prototypical brave-v use, but remember that these are the same lemma, and annotators will necessarily have to distinguish semantically between whatever two roles we split these into. We think getting a pure semantic distinction between these (which could also apply to "bravery") is actually quite hard; challenge set in the details. (http://verbs.colorado.edu/propbank/framesets-english-aliases/brave.html)

attend/attending

There is a "pay attention to" roleset currently; which we can rename (other discussion). We are adding a note on how to handle "attending physical" instances. (http://verbs.colorado.edu/propbank/framesets-english-aliases/attend.html)

More detailed discussion, with Ulf's notes:

comfort vs comfort-n/comfortable:

Ulf's definitions:

(1) comfort (v): make someone feel less unhappy; console

(2) comfort (v): help someone feel at ease; reassure

(3) comfortable (adj): providing physical ease and relaxation (esp. clothes, furniture)

(4) comfortable (adj): free from pain, stress, fear, financial worry (of a person)

"comfort" (v) conveys prior distress; "comfortable" does not.

"comfort" (v) conveys an act of consolation/reassurance; "comfortable" does not.

Example: The priest comforted the widow. (After her husband's death.) NOT: The priest is comfortable (with/to the widow).

But comfortable, when applies to people, means almost exactly that: – "The school cook is such a comfortable person to be around, the children are always happy when she is in the room."

Example: The couch is comfortable. (Even if the person who sits on it wasn't in a state of pain, stress, fear, financial worry before; and even if nobody has ever been sitting on the couch at all.)

“Comfort” doesn’t imply prior distress any more than “please” implies prior displeasure. The description following the second example could, just as easily, apply to: "His voice was firm but comforting. " "There the ceramic stove radiated a comforting warmth."

"comfort (v)/comfortable" translates to totally different non-interchangeable words in other languages (e.g. DE: troesten, bequem; FR: consoler, comfortable)

The noun "comfort" can go either way:

  • "words of comfort" (word :ARG2-of comfort-01)
  • "to live in comfort" (live-01 :manner comfortable)

Remember that our assertion is not that the emotional comfort and physical comfort senses are the same idea, but that they both can be realized in "comfort" and "comfortable". The fact that the noun "comfort" is also clearly straddling this line supports this idea.

There is a separate question of whether one wants to split comfort (in the sense of providing solace) from comfort (in the sense of providing physical niceness).

While "comfort" is based on an old Norman-French word, "comfortable" and the noun "comfort" of the same sense are actually later original English creations that were exported back to French only in modern times (about 200 years ago).

sympathize, sympathy, sympathetic:

Framenet: sympathize-v: FN: Emotion_directed, Others_situation_as_stimulus

sympathy-n: FN: Emotion_directed (we don’t have this alias currently)

sympathetic-j: FN: Emotion_directed

Ulf says:

(1) sympathetic to: to sympathize [with](dominant sense)

(2) sympathetic (adj): pleasant, agreeable ("She is a sympathetic young woman.")

For most English speakers I've talked to, I can't find clear-cut examples of (2) that don't also entail sympathy; I think "sympathize" just bleeds through so much. More importantly, (1) and (2) are almost impossible to discern from context; I suspect that most instances that anyone would read as (2) would also get annotated as (1).

Since it's both usually implicative of sympathizing, and because they are too confusable to do a more elegant solution (like splitting the sympathizing vs simpatico senses), it seems like the best option is to unify these. We can add a note in the roleset for sympathize to not use this for clear-cut uses of "likeable/pleasant/agreeable".

awe/awesome.

Ulf notes:

Informal sense: awesome = excellent ("What an awesome song !")

CU notes: The slangy version is simply a hyperbolic use of the term, and the verb can be used the same way. There is also a gradient of ambiguity there; "It was an awesome sight" could be read as "it was excellent" or "it was evocative of awe". Wordnet defines only one sense, "inspiring awe or admiration or wonder".

conclude/conclusion.conclusive

conclude-v: FN: Coming_to_believe, Process_end, Activity_finish

conclusion-n: FN: Coming_to_believe

conclusive-j: FN:-

Ulf notes:

conclusive/conclude

"conclusive evidence"

not clear how it fits with frame for conclude-01 (ARG2 = question answered)

CU: We are modifying "conclusion" to have an argument for "evidence" roles, i.e. debate-ending elements that are not the agent. Otherwise we think these are the same general idea;

Wordnet:

conclusive (forming an end or termination; especially putting an end to doubt or question) "conclusive proof"; "the evidence is conclusive"

Meriam Webser:

1 of, relating to, or being a conclusion

2 putting an end to debate or question especially by reason of irrefutability

cling-v vs clingy-j

Ulf notes:

clingy = liable/tendency to cling

CU notes: You don’t use this word for something that doesn’t cling at least occasionally, which really isn’t any different from the habitual aspect on the verb; "that's the pair of pants that clings".

glory-v vs glory-n, glorious-j

Ulf Notes:

glorious (adj)/glory (n): high renown won by notable achievement; great beauty

to glory = to take great pride or pleasure [rare]

"She gloried in being a sailor's wife." It would seem that "glory" (n) and "glorious" (adj) would be more appropriate

CU Notes: We agree: we are not merging the rolesets for "to take great pride" and "high renown". The candidates for unification here are noun and adjective, as in "glorious victory" / "glory of victory". Annnotators would chose between "high renown" and "to take great pride or pleasure" senses.

elude/elusive

same Framenet role: elude-v: FN: Evading, Elusive_goal elusive-j: FN: Evading

Ulf notes:

elusive enemy = enemy that is hard to catch; not necessarily one that escaped.

CU notes: I’m not sure that ‘elusive’ is particularly weaker than ‘elude’ in this regard. I would say that if something is elusive and then caught, the part where it ended up being caught would need to be specified just as much as for the verb. "The answer eluded me until I remembered that hint you gave me" doesn't entail that it escaped.

hope/hope/hopeful

hope-v: FN: Desiring

hope-n: FN: Desiring

hopeful-j: FN: Attitude_description

Ulf notes:

(1) hopeful (adj): feeling or inspiring optimism about a future event.

Example: Nancy Pelosi hopes that the Democrats will win a solid majority in the US House of Representatives in the upcoming elections, but she knows the odds are heavily against that (so she is not hopeful about it). "hopeful" entails "hope" but not the other way around.

CU notes: We are talking about whether to split off a 'promising' roleset for things like 'hopeful prospects'. Constructions like "have hope that" also fit into that kind of pattern, so we'd propose that we definitely need to get these into the same frame file. Personally, many of the examples used so far to "hopeful" entail the desiring frame; "a hopeful young singer on Broadway" seems to mean "a young singer on Broadway with hopes of success", and not "a promising singer on Broadway"; "she is hopeful that they will win a majority, but has many doubts" seems totally acceptable.

Equal/equal:

Ulf notes:

be equal to = equal-01

but: equal distribution of wealth

CU notes: We see no difference here. Each instance of wealth distribution is equal to all other instances of wealth distribution. The distribution of weath for the rich and poor don't equal each other.

suspect(v)/suspicion(n) vs suspicious(j)/suspect(j)

Ulf notes:

suspect-01:

ARG0: person suspecting

ARG1: assertion being suspected

ARG2: thing/person that is suspicious

This is an interesting case. Suspicion entails suspect-01, but typically does not explicitly state what exactly is suspected. The arguments in AMRs would generally include an ARG1 for "suspect" and an ARG2 for "suspicious" but not both, incl. for examples (4) and (5) below. The special medical usage of "suspicious for" semantically matches what is normally more commonly expressed with "suspect".

(1) I suspect that the package is insufficiently stamped.

(suspect-01 :ARG0 i :ARG1 (stamp-01 :ARG1 package :polarity - :ARG0-of suffice-01))

(2) I suspect that the package might be dangerous.

(suspect-01 :ARG0 i :ARG1 (endanger-01 :ARG0 package :mod possible))

(3) The package is suspicious to me.

(suspect-01 :ARG0 i :ARG2 package)

(4) The gang is suspected of smuggling drugs.

(suspect-01 :ARG1 (smuggle-01 :ARG0 gang :ARG1 drug))

(5) The lesion is suspicious for melanoma. [medical jargon]

(suspect-01 :ARG1 (melanoma :domain lesion))

CU notes: I don’t see a scenario where these are not mutually entailing. Often, "suspicious" or adjectival "suspect" don't include the suspicion Arg1, but that amounts to a transitivity difference, and we don't separate rolesets because of transitivity differences.

With arg1 as subject, ‘suspicious’ is more likely to occur intransitively, but we accept all transitivity variations within our rolesets, so this shouldn’t be a problem. Also, suspicious = suspect-j.

Sonoma County has reasonable grounds to suspect that such information is untrue. Vs. Sonoma County has reasonable grounds to be suspicious that such information is untrue.

The man in the alley is suspicious. Vs. The man in the alley is suspected [of being up to something]

Your behavior is suspicious of criminal activity. Vs. Your behavior is suspected to be criminal activity.

brave-v vs brave-j

Ulf notes:

to brave the rain (specific challenge, often far below heroic)

to be brave

I think that the ARG1s for brave-j/brave-v don't quite line up:

"Angelina Jolie was brave to share such a personal decision."

*"Angelina Jolie braved (the fact) that she shared such a personal decision."

CU Note: We think it's fine, however, if you say "Angelina Jolie braved sharing such a personal decision."

We did talk about how one would unify this, and accept that the prototypical brave-j use is different from the prototypical brave-v use, but making a replicable semantic distinction between "facing challenges" and "being brave" is very hard. Challenge set (if anyone has rolesets that would make it easy for annotators to distinguish these senses, feel free to provide them): "He braved the weather" "He braved gunfire to rescue his comrades" "He was then given a medal for his bravery" "I admire Susan for her bravery" "She was brave in the face of bankruptcy"

Splits

black, whiten, redden, worsen, dampen, thicken, moisten, gladden, flatten, deepen, deafen, sadden, ripen, widen, broaden, harden, soften, critical/criticism/criticize, specific/specification/specify, effective/effect/ to effect, dead / deaden, faulty/fault, gag/gagworthy, fuss/fussed, fit/fit, oily/oil, crafty/craft, excel/excellent, even/even, done/do06, conversant/converse, signify/significant, specific/specify, determined/determine, gray/grey, green/green, fuzzy/fuzzy, free/free, flat/flatten, empty/empty, dull/dull, dry/dry, down/down, dizzy/dizzy, distance/distant, dirty/dirty, cool/cool, content/content, clear/clear, blind/blind, chill/chilly, bare/bare, exceed, conceptualize

nschneid commented 9 years ago

Regarding brave.v vs. brave.j/bravery.n: it seems to me that there is an essential difference in the meaning of the ARG1 that is masked by the label "challenge". For brave.v, it has to be a force or situation that the ARG0 person has no control over, but decides to endure, whereas for brave.j, it has to be an act by the ARG0 that demonstrates his/her bravery. This is why you have to add another verb ("sharing") to the Angelina Jolie example. And it seems to me that the two sentences are not quite paraphrases—"Angelina Jolie braved sharing..." does not necessarily characterize her as brave, it merely says that she is voluntarily doing something likely to be unpleasant.

(Regarding "She was brave in the face of bankruptcy": I think "in the face of" could be used for all kinds of adjectives to denote a cause or stimulus—e.g., "She was sad in the face of bankruptcy"—so this is not really evidence about a core argument of brave.j.)

@timjogorman, what do you think?

timjogorman commented 9 years ago

Thanks Nathan!

Personally I agree that the two Angelina Joie sentences are not exactly paraphrases (although I'm a little confused; all the examples do have the verb "share" in them..), but would back off and emphasize that I don't care if they're exactly the same, but whether it's a distinction we want to make. The "split or not split" decision here is less important than having good, replicable frames for the annotators to use, be they one frame or two.

(Regarding "She was brave in the face of bankruptcy": That's a really good point that other terms can have "in the face of" as a cause. Would you use cause01 rather than a numbered argument for that then? What about other challenges for the "lack of fear" sense, like "his bravery in battle"?)

Deunification Pros
Deunification Cons:

That being said, I'm just going to try to frame these as distinguishably as possible , and everyone can opine about whether this seems like an easy task for people to do.

brave 01: to be lacking in fear arg0: Person experiencing a lack of fear arg1: Act by the ARG0 that demonstrates his/her courage.

brave 02: to face a specific challenge, often far below heroic arg0: person overcoming challenge arg1: force or situation that the ARG0 person has no control over, but decides to endure

Examples (repeated from above): is this easy or not? Is there a better frame description for this? "He braved the weather" "He braved gunfire to rescue his comrades" "He was then given a medal for his bravery" "I admire Susan for her bravery" "She was brave in the face of bankruptcy"

cbonial commented 9 years ago

Here's what I might try to do according to these frames, which, to me, seem to differ primarily in the following ways:

brave.01: subject "decides" to take on a challenge that others find frightening, and taking it on is perceived as noble.

brave.02: subject is obligated to take on a challenge that is rather banal, and taking it on is more of a necessity than a noble act.

Nathan, are these the differences you were pinpointing?

On Oct 29, 2014, at 7:35 PM, timjogorman notifications@github.com wrote:

That being said, I'm just going to try to frame these as distinguishably as possible , and everyone can opine about whether this seems like an easy task for people to do.

brave 01: to be lacking in fear arg0: Person experiencing a lack of fear arg1: Act by the ARG0 that demonstrates his/her courage.

brave 02: to face a specific challenge, often far below heroic arg0: person overcoming challenge arg1: force or situation that the ARG0 person has no control over, but decides to endure

Examples (repeated from above): is this easy or not? Is there a better frame description for this? "He braved the weather"

Pretty clearly brave.02 (but could be complicated in certain storm-chaser contexts, for example) "He braved gunfire to rescue his comrades"

Brave.01, especially given purpose clause.
"He was then given a medal for his bravery"

Brave.01, but this is only from pragmatic context. "I admire Susan for her bravery"

Presumably also Brave.01, but again this is totally ambiguous as far as the above criteria are concerned, but pragmatic context indicates she's done something admirable. "She was brave in the face of bankruptcy

Strictly following the rolesets above, I'd have to go brave.02 on this one, since she's overcoming a challenge that is "below heroic" by my standards; a challenge she is simply forced to endure.

Those are my calls, but I do think it's quite subjective to have people make roleset distinctions on these semantic criteria alone. I'd be interested to see if these choices match up with others' selections. =

nschneid commented 9 years ago

I was thinking that 'brave' as a verb requires its complement to be an inevitable force rather than an act, but that is clearly wrong.

This is almost certainly a case of polysemy/semantic drift, where probably the original sense of the verb would have applied in the same contexts as the adjective, but now we use the verb for routine inconveniences like bad weather. (Probably with idiolectal variation.) To me, at least, the adjective implies the notion of overcoming fear, whereas the verb does not necessarily require something that would provoke fear.

Because there are situations where the two overlap, unifying them might make the most sense. But if unification is taken to imply that they are paraphrasable (modulo aspect), I think that is too strong a claim to make, so a finer distinction might be appropriate. For example:

  1. brave.j, bravery.n, brave.v: acting without/in spite of fear
    • brave gunfire/the committee's harsh questioning/sharing a personal story
    • be brave enough to face gunfire/face the committee/share a personal story
    • be brave/show bravery in the face of bankruptcy
  2. brave.v: putting up with some mild unpleasantness
    • brave the rain
    • (#be brave enough to go outside in the rain)
    • (#be brave/show bravery in the face of rain)

(I know we have discussed principles of what PropBank "means" by unifying two predicates. Are these principles in their current form written down somewhere?)

cbonial commented 9 years ago

The past principles have been undergoing change in response to this process, so I think we're still in the process of pinning down all principles as we look through the rest of the alphabet (h-z) for possible change of state/state predicates and others that may need de-unification. Until we've settled on what those "others" may be, I don't think we can write up concrete principles.

Claire

On Oct 30, 2014, at 11:13 AM, nschneid notifications@github.com wrote:

(I know we have discussed principles of what PropBank "means" by unifying two predicates. Are these principles in their current form written down somewhere?)

MarthaSPalmer commented 9 years ago

PropBank's highest priority for unifying things has always been whether or not the roleset is consistent across the two usages. That does't seem to be the issue here at all. Here it is more a question of whether or not "braving the weather" requires the same kind of courage that "braving gunfire" requires. I am a notorious lumper, and for me, it does. The whole point of saying "braving the weather" rather than "enduring the weather" is to add a dash of gallantry to the event, :-). And I'm reading a book about winter in South Dakota, and braving those frigid temperatures is beginning to seem downright heroic! So I would have no qualms at all about tagging all of Tim's examples with "brave.01" - without a single second thought. Which seems to be one of Tim's fears - that it will be hard to get annotation consistency. So do we "brave the murky waters of distinguishing between brave.01 and brave.02, or, discretion being the better part of valor, retreat to a safer single roleset?"

nschneid commented 9 years ago

:) I thought before that the noun and adjective place a different set of semantic restrictions on the ARG1 than the verb does. But now I think that it's hard to tease those apart, if there is a difference. So I'm fine with the unification for PropBank/AMR purposes, as long as we are OK with obscuring fine-grained sense distinctions between the verb and non-verb forms (i.e., for me, "he braved the rain to buy a lottery ticket" does not entail that he was brave; rather, it can be paraphrased as "he put up with the rain to buy a lottery ticket").

P.S. I don't see 'opinion' in the unified frame files. Will PropBank follow AMR and unify it with 'opine'? That seems a comparable case in terms of a sense divergence despite a shared set of roles.

uhermjakob commented 9 years ago

Thanks Tim and other contributors. I think we are making progress. But let me expand on some cases.


brave(adj) vs. brave(v)

I still believe that these differ in meaning and have a different argument structure.

From the dictionaries: brave(adj): ready to face and endure danger or pain; showing courage ("a brave soldier") brave(adj): colorful, showy ("brave banners") brave(v): endure or face unpleasant conditions or behavior without showing fear ("to brave the rain")

brave(adj): bold; courageous brave(v): endure bad situation

brave(v) is inherently transitive (+:ARG1), brave(adj) is not (-:ARG1). Alexander the Great was brave. *Alexander the Great braved.

UColorado challenge sentences (great!):

"He braved gunfire to rescue his comrades" "She was brave in the face of bankruptcy"

Following up on Nathan's comment, I would argue that "in the face of ..." is a generic modifier to describe a context of adversity rather than a core arg (for brave and other frames). Example: "She is hopeful in the face of death." Surely "death" is not the :ARG1 of hopeful/hope. Annotators have been doing a good job annotating "in the face of" using face-01 or :concession ("even in the face of").

"He braved gunfire to rescue his comrades" does indeed imply bravery, but that does not justify unifying the two braves. First of all, even if they mean the same in this one context, it does not mean that they generally mean the same. (Example: In "He acquired the property for $500,000." the acquisition is a purchase, but not all acquisitions are purchases.) Secondly, I would argue that in "He braved gunfire to rescue his comrades", the bravery does not primarily stem from the word "braved". Indeed, I believe that there are situations where one has to (passively) endure gunfire without necessarily being an (actively) brave person. But if such endurance is a choice made for altruistic reasons, as strongly implied in "He endured and withstood gunfire to rescue his comrades", we find bravery, even without the verb "braved."

So I would go with two senses, with a simple guideline for annotators: one for the verb, one for the adjective.


hope vs. hopeful

We feel that almost all of the interpretations of "hopeful" involve some implication of hoping, but ... We simply posit that all the "hopeful" instances that entail hope should be unified with "hope".

Yes, "hopeful" entails "hope", but that does not mean they are equal. Just as "purchase" entails "acquire" without meaning the same. "hopeful" is more than "hope". "hopeful" includes a degree of optimism that the thing hoped for will indeed come to pass.

From various dictionaries: hopeful: feeling or showing hope; expecting to get what one wants hopeful: When you have complete faith that an illness will be able to be cured, this is an example of a time when you are hopeful about the prognosis. hopeful: feeling or inspiring optimism about a future event hopeful: If you're hopeful about something, you're optimistic. You think it's going to turn out OK. Your team has been doing well in practice, so you're hopeful that you'll win the finals.


comfort vs. comfortable

I asked four friends from outside the ivory tower, all educated native speakers of English, 3 US-born, 1 English-born. They all felt very strongly that "The couch comforts me." is not an acceptable paraphrase of "The couch is comfortable." ("makes me cringe" / "utterly unacceptable")

I'm comfortable with the new CEO. I'm comfortable with transgender people. I'm comfortable with the pressure. http://sport.stv.tv/golf/293468-ryder-cup-talisman-ian-poulter-comfortable-with-being-team-usa-target/ Does this really mean that the new CEO/transgender people/pressure comfort me?


conclusive vs. conclude

"conclusive" entails an element of conclusion, but it means more.

conclude: to bring to an end conclusive: serving to prove a case; decisive or convincing

Examples:


equal(adj) vs. equal(v)

Tricky case: "equal distribution of wealth" Challenge: provide an actual AMR annotation for this case

Fact: South Africa has a very unequal distribution of wealth. But this year's distribution of wealth might very well equal last year's distribution of wealth in South Africa. But that's not what "equal distribution of wealth" means. So we can't just have equal-01 modify distribute-01. One way to go would be to annotate "equal distribution of wealth" as "a distribution of wealth into assets that are equal to each other". (Good luck.) Another one might be to keep "equal" with a sense of a "meta equal-01".

nschneid commented 9 years ago

I think @ulfulf makes good points, as do the CU people. (How can they both be right?, you ask.)

The discrepancy seems to be not just about these specific cases, but our fundamental understanding of the criteria for and implications of unification.

Here are some possible criteria for which things ought to be unified:

  1. Candidates should only be considered for unification if they are morphologically related, sharing a common root.
  2. Candidates should never be unified under the same roleset if they can never be paraphrased/used in similar situations.
  3. If overt derivational morphology signals a causal difference (black vs. blacken, etc.), they should not be unified.
  4. Following PropBank conventions for deciding when to split rolesets for verbs, candidates should generally be unified if they overlap in meaning (can be used in some common situations) and have roles in common.
    • Lumpers' preference: captures more generalizations, less work for annotators.
    • The unified predicates may have slightly different entailments, nuances in meaning, register, etc.
    • It is OK if some predicates license more roles than others, so long as the roles in common have the same interpretation.
  5. Candidates should only be unified if they are almost always paraphrasable.
    • Splitters' preference: more conservative than the previous option.
    • If the rolesets correspond to predicates with different parts of speech, then the annotator can rely on the POS (so semantic gray area between them is not a practical problem).

I think we are agreed on 1, 2, and 3, but CU seems to be leaning towards 4 while @ulfulf's arguments about paraphrasability suggest 5. Is this a fair assessment?

timjogorman commented 9 years ago
comfort vs. comfortable

We can agree to that.

conclusive vs. conclude

"conclusive" entails an element of conclusion, but it means more.

conclude: to bring to an end conclusive: serving to prove a case; decisive or convincing

It was noted at the meeting that we have two rolesets for conclude, "bring to an end" and "come to/point to a decision based on evidence". Is that enough to satisfy complaints on this one?

brave(j) vs brave(v)

We can agree to that (The worry expressed from the semantic frame team was that it might sometimes be hard to distinguish these without relying on syntax, but that maybe the aliases will be enough)

hope vs. hopeful

We can agree to that.

That being said, I wanted to get some clarification about what the consequences of that split might be. It seems that the proposal is that different words in the "hoping" semantic field should not be verbalized when they imply optimism about the future event. If so , I can't see why that wouldn't apply to hope-n as well, which almost always implies optimism (lose hope, have hope, etc.). Is that intended/ being proposed? If not, why is unification of "hope-n" ok but "hopeful-j" not ok?

equal(j) vs equal(v)

The "equal" roleset as it currently stands has an Arg3: "attribute, quality in which two things are equal". We are wondering if people would be ok with keeping these unified, but doing the scale along which people get equal values/treatment with arg3, as in "South Africa have an unequal distribution of wealth" being "[arg1 (the people of) South Africa ] are unequal [arg3 (in terms of) distribution of wealth]". Does that sound ok?

If people do still want separation of senses, I'd note that "equal-j" (as well as "equality-n") both have plenty of instances that are identical to the verbal form (It seems absurd to not have "4 equals 5" and "4 is equal to 5" in the same roleset), and so it would be much more elegant and AMR-ish to have two senses of equal/equality (splitting the adjective and noun) than to completely separate them and try to punt with part of speech. I can understand people wanting to split off senses like "equal rights" or "equal distribution of wealth", and I think our worry was that this might be hard to distinguish (because often you can interpret these as being some sort of value-on-a-scale kind of meaning, and because the omitted and metonymic arguments add so much value) Our guesses about possible splits criteria for this were "[two things being equal (two arguments)] vs [sets being equal (one argument)]", "[equality of values on scales] vs [similarity of treatment in a situation]".

timjogorman commented 9 years ago

To round out the uinification discussion, we've also finished looking at the remaining unifications.

We worked through the rest of unification verbs, with Martha, Julia and I working through over 100 of the edge-case instances (Julia narrowed this down from a much larger list). We are splitting the first 37 in the "deunification" list, keeping 78 in the "unification" list (although we've left notes on some of those, which will need quick roleset adjustments. We also listed five which we think are worth unifying, but are on the fence about, and would go either way if people in the group have opinions about them.

The biggest 'new' criterion is that we feel that verbalizations of adjectives (in the very loosely "causative/stative" class) are judged unifiable in our book when verb itself is static and atelic and not causative, like "to hunger" vs "hungry", "to sleep" vs "asleep" (we applied standard telicity and durativity tests to judge this). The larger spreadsheet for de-unification with more notes is here.

On the fence :

exceed-v excessive-j pervade-v pervasive-j preempt-v preemptive-j respond-v responsive-j suggest-v suggestive-j

De-unifying:

distrust-v untrustly-j react-v reactionary-j volunteer-v voluntary-j toil-v toilsome-j note-v noteworthy-j
romance-v romantic-j prefer-v preferential-j inconvenience-v inconvenient-j adventure-n adventurous-j hazard-v hazardous-j cuddle-v cuddly-j craze-v crazy-j oil-v oily-j cloud-v cloudy-j chill-v chilly-j hassle-v hassly-j piss-v.03 pissy-j snow-v snowy-j risk-v risky-j scare-v scary-j nose-v nosy-j sweat-v sweaty-j tear-v.03 teary-j.03 perceive-v perceptive-j persuade-v persuasive-j possess-v possessive-j protect-v protective-j retain-v retentive-j sense-v sensitive-j produce-v productive-j permit-v permissive-j mean-v.01 meaningful-j harm-v harmful-j help-v helpful-j hurt-v hurtful-j waste-v wasteful-j shy-v.02 shy-j.02 mature-v.01 mature-j.01

Keeping unified:

inflame-v inflammatory-j worry-v worrisome-j.02 pride-v proud-j sleep-v asleep-j hypertrophy-v hypertrophic-j hemorrhage-v hemorrhagic-j sclerose-v sclerotic-j stenose-v stenotic-j influence-v influential-j inspire-v inspirational-j intend-v intentional-j intend-v intent-j obsess-v obsessional-j vary-v variant-j hesitate-v hesitant-j predominate-v predominant-j rely-v reliant-j resist-v resistant-j resonate-v resonant-j result-v resultant-j signify-v significant-j.01 tolerate-v tolerant-j nonexisting-n nonexistent-j suffice-v sufficient-j turbulence-n turbulent-j violence-n violent-j obey-v obedient-j persist-v persistent-j presume-v presumptuous-j prosper-v prosperous-j itch-v itchy-j thirst-v thirsty-j hunger-v hungry-j inaction-n inactive-j impress-v.01 impressive-j invade-v invasive-j represent-v representative-j innovate-v innovative-j coerce-v coercive-j collude-v collusive-j conflict-v conflictive-j destroy-v destructive-j contribute-v contributive-j cure-v curative-j deceive-v deceptive-j prohibit-v prohibitie-j include-v inclusive-j react-v reactive-j support-v supportive-j interact-v interactive-j palliation-n palliative-j hate-v hateful-j pain-v painful-j peace-n peaceful-j regret-v regretful-j resent-v resentful-j shame-v shameful-j sorrow-v sorrowful-j stress-v.02 stressful-j succeed-v successful-j respect-v respectful-j sense-n.02 sensible-j wellbeing-n.02 well-j.02 subject-v subject-j manifest-v manifest-j suspect-v suspect-j welcome-v welcome-j discontent-v discontent-j fun-n.01 fun-j.01 outrage-v outrageous-j.01 (split –j into offense and extravagant senses) aggression-n aggressive-j (split off a ‘fast growing’ sense for both) exclude-v exclusive-j (split off an ‘elite, fancy, snobbish’ sense for –j) progress-v progressive-j (split off a political sense for –j) submit-v submissive-j (split verb into ‘sumbissive’ and ‘turn in’ senses) provoke-v provocative-j (split off sexual sense from –j) inform-v informative-j (split off ‘informant’ sense from –v) offend-v offensive-j (split off sports/battle sense from –j) okay-v okay-j (split off ‘generally alright’ from ‘okay with me’ for –j) okay-v ok-j (split off ‘generally alright’ from ‘okay with me’ for –j)

MarthaSPalmer commented 9 years ago

On Nov 9, 2014, at 12:17 PM, timjogorman notifications@github.com wrote:

comfort vs. comfortable

We can agree to that.

conclusive vs. conclude

"conclusive" entails an element of conclusion, but it means more.

conclude: to bring to an end conclusive: serving to prove a case; decisive or convincing

It was noted at the meeting that we have two rolesets for conclude, "bring to an end" and "come to/point to a decision based on evidence". Is that enough to satisfy complaints on this one?

brave(j) vs brave(v)

We can agree to that (The worry expressed from the semantic frame team was that it might sometimes be hard to distinguish these without relying on syntax, but that maybe the aliases will be enough)

but did you see the NYT headline last Sunday? “Braving Ebola”? Very much in support of not splitting them….

hope vs. hopeful

We can agree to that.

That being said, I wanted to get some clarification about what the consequences of that split might be. It seems that the proposal is that different words in the "hoping" semantic field should not be verbalized when they imply optimism about the future event. If so , I can't see why that wouldn't apply to hope-n as well, which almost always implies optimism (lose hope, have hope, etc.). Is that intended/ being proposed? If not, why is unification of "hope-n" ok but "hopeful-j" not ok?

equal(j) vs equal(v)

The "equal" roleset as it currently stands has an Arg3: "attribute, quality in which two things are equal". We are wondering if people would be ok with keeping these unified, but doing the scale along which people get equal values/treatment with arg3, as in "South Africa have an unequal distribution of wealth" being "[arg1 (the people of) South Africa ] are unequal [arg3 (in terms of) distribution of wealth]". Does that sound ok?

If people do still want separation of senses, I'd note that "equal-j" (as well as "equality-n") both have plenty of instances that are identical to the verbal form (It seems absurd to not have "4 equals 5" and "4 is equal to 5" in the same roleset), and so it would be much more elegant and AMR-ish to have two senses of equal/equality (splitting the adjective and noun) than to completely separate them and try to punt with part of speech. I can understand people wanting to split off senses like "equal rights" or "equal distribution of wealth", and I think our worry was that this might be hard to distinguish (because often you can interpret these as being some sort of value-on-a-scale kind of meaning, and because the omitted and metonymic arguments add so much value) Our guesses about possible splits criteria for this were "[two things being equal (two arguments)] vs [sets being equal (one argument)]", "[equality of values on scales] vs [similarity of treatment in a situation]".

— Reply to this email directly or view it on GitHub.