BIDMCDigitalPsychiatry / LAMP-platform

The LAMP Platform (issues and documentation).
https://docs.lamp.digital/
Other
12 stars 10 forks source link

Emotion recognition game #759

Closed Devayani0102 closed 1 year ago

Devayani0102 commented 1 year ago

We want to introduce a new emotion recognition game to mindLAMP. The game will enable researchers to upload pictures of faces, and participants will select the emotion that best represents each image.

The front-end interface of the game will look like the image provided below.

Screen Shot 2023-04-20 at 11 50 04 AM

Researchers will upload images of faces, and participants will choose from five predetermined emotions - Happiness, Sadness, Fear, Anger, and Neutral. Participants will click on the emotion they feel best represents the image and then click on "Save" to move to the next question. The game will consist of ten questions, and once the participant has answered all ten questions, the responses will be saved, and the game will exit. If a participant leaves in the middle of the game, their responses will be saved until the last question answered.

The dashboard will look like the image below.

Screen Shot 2023-04-28 at 4 39 08 PM

The back-end interface will provide researchers with a dashboard that allows them to upload images, name those images, and assign the associated emotion to them. These images are not preset; researchers will upload images every time they create a new activity.

Each uploaded image will have a menu of emotions to choose from, and the menu options will remain the same for each image uploaded - Happiness, Sadness, Fear, Anger, and Neutral. The style of the menu will be similar to the one used to assign which tab the activity appears in. The name of the file will be a unique identifier for each image that the researcher writes. This will be a free-text box and a required field. It should not contain any spaces.

Researchers can upload up to 50 pictures. The app will select ten images at random to display to the participant from the 50 uploaded images, and the order and pictures will be different each time the game is played. If a researcher uploads less than 10 images, then all images will be displayed in a random order.

Results: The results will be in the following format:

{ duration: duration until the participant presses "Save", item: question number (1-10), level: the image identifier - in the example above, it would be 'Face1_Happy', type: True/False (if the participant's answer matches the one provided by the researcher- True, Else- False), value: participant's response (Happiness, Sadness, Fear, Anger, Neutral) }

Visualization: The portal page could display a graph with the total number of correct responses for each game. The other view could show whether each item was true or false.

ZCOEngineer commented 1 year ago

@Devayani0102 We shall review this and add ETA

sarithapillai8 commented 1 year ago

Game development is in progress. Dashboard side changes with activity creation is completed. Activity spec created in api-staging.

divyav2020 commented 1 year ago

We have updated Emotion recognition game in Dashboard Staging LAMP_Admin Website_Emotion recognition game.xls

carlan1 commented 1 year ago

Appears functional in staging