search

ARIA-VALUSPA / AVP

This is the ARIA-VALUSPA Platform, or AVP for short. Use this platform to build your own Virtual Humans with audio-visual input and output, language models for English, French, and German, emotional understanding, and many more. This work was funded by European Union Horizon 2020 research and innovation programme, grant agreement No 645378.
https://aria-agent.eu
32 stars 16 forks source link

Documentation question #16

Open Niklasaaron opened 6 years ago

Niklasaaron commented 6 years ago

I have two issues when creating my own scenario:

  1. I cannot find the files where the turn management is specified (e.g. when does the avatar wait for an answer and when not)
  2. I cannot find the files where performative behaviour is specified (e.g. greeting) Is there a list for all possible "fml" and "bml"? thanks in advance
Barachia commented 6 years ago

Hi Niklas,

  1. There's some minor turn-management going on in the current system, you have to look at this file: https://github.com/ARIA-VALUSPA/AVP/blob/master/Agent-Core-Final/src/main/resources/templates/InteractionManagement.xml. The first part about engaging/engaged/idle/disengaging is based on user presence via audio and video (is.states.amq.user.voice.active and face.id in the information state). The second part (Listen, talk, interrupt, etc) is for more depth for turn-taking, though it's not directly used in the system right now. You can see in https://github.com/ARIA-VALUSPA/AVP/blob/master/Agent-Core-Final/src/main/resources/templates/FMLManagement.xml, which performs the actual behaviour of the agent, that the agent needs to be engaged before sending another behaviour, as well as some other parameters (planning, not already talking). I'm sorry for the clutter in these files, I need to clean this up.
  2. If you're running the Quest-scenario, the speech is defined in https://github.com/ARIA-VALUSPA/AVP/blob/master/Agent-Core-Final/src/main/resources/templates/Moves_Eval_Quest1.xml. If you want to see the BML/FML, that is located in this folder: https://github.com/ARIA-VALUSPA/AVP/tree/master/Agent-Core-Final/src/main/resources/data/fmltemplates. Unfortunately I don't have an exhaustive list of all FML/BML options, but most of it is present here: https://github.com/ARIA-VALUSPA/AVP/wiki/Documentation#fml-templates.
pelachaud commented 6 years ago

Hello,

We have put Greta on github lately.

You can find all the files related to Greta at:

https://github.com/gretaproject/greta

We are currently working on adding information on using the agent platform.

The communicative intentions (eg performative-greet) are described in the file:

bin/BehaviorPlanner/IntentionLexicon/

Kind regards,

Catherine

Le 2018-09-10 15:25, Niklasaaron a écrit :

I have two issues when creating my own scenario:

  • I cannot find the files where the turn management is specified (e.g. when does the avatar wait for an answer and when not)

  • I cannot find the files where performative behaviour is specified (e.g. greeting) Is there a list for all possible "fml" and "bml"? thanks in advance

-- You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub [1], or mute the thread [2].

Links:

[1] https://github.com/ARIA-VALUSPA/AVP/issues/16 [2] https://github.com/notifications/unsubscribe-auth/ALNZY2DYCd4StFmdOkgDmXd9oietm2zwks5uZmhHgaJpZM4WhZOA