search

victorbarres / TCG_SALVIA

Template Construction Grammar: A Computational CxG for the Schema Architecture Language Vision InterAction cognitive model (SALVIA)
0 stars 1 forks source link

Subscenes and attentional processes #32

Open victorbarres opened 8 years ago

victorbarres commented 8 years ago

Jin mentions three types of attentional processes involved in scene perception: Zooming-in, Zooming-out, and shifting. Can I implement those? Can this make the implementation of subscenes based scene representation better defined?

victorbarres commented 8 years ago

attentional_shifts

victorbarres commented 8 years ago

kuchinksy Figure 17: An illustration of “hypothesized” TCG processes in the two cases of Kuchinsky (2009)’s study. (A) illustrates the case where the sentence structure is specified first, resulting in a process consistent with the structural view (i.e., no cueing effect due to the verbal guidance principle), whereas (B) illustrates the case where a lexical item (woman) is specified earlier than the sentential structure (SVO), resulting in a process consistent with the incremental view (i.e., cueing effect). Since low threshold is assumed for both of the cases, utterances are made intermittently. The yellow shade represents the place where speaker’s attention focuses, and the dashed red oval marks subscene.

Kuchinsky example used by Jin. Just as in the previous example two questions:

  1. Can one recognize an action before recognizing the actors etc.. I say yes if we agree that the node can be linked to concepts that remain too vague to be lexicalized (ie we could say a person punches someone else, but the system wants more info, that's why I don't like the "??" notation in the initial frame, should be "HUMAN").
  2. In the case of kuchinsky, the edges are not stipulated. Might just be an simplification in the cartoon by Jin, but it points to the fact that just as Nodes can be underdetermined, so could edges. -> HOW CAN I HANDLE THAT? How do you semantically denote: someone is acting on someoneelse but I don't know who is the agent and who is the patient?