search

expfactory / expfactory

software to generate a reproducible container with a battery of experiments
https://expfactory.github.io/
BSD 3-Clause "New" or "Revised" License
35 stars 16 forks source link

How to evaluate performances in two-stage-decision #174

Open NicoBiagi opened 1 year ago

NicoBiagi commented 1 year ago

Version of Experiment Factory:

Latest version, pulled from GitHub

Expected behavior

At the end of the experiment, the csv with the behavioural data gets downloaded, but I don't know which columns I need to look at in order to evaluate the performance

Actual behavior

Columns 'credit_var' and 'performance_var' in the downloadedare empty

Steps to reproduce behavior

Write here.

vsoch commented 1 year ago

This sounds like something to figure out for the experiment, not necessarily the deployment mechanism?

NicoBiagi commented 1 year ago

I agree. Do you know where I can find info on how to analyse the data for this specific task?

vsoch commented 1 year ago

What is the experiment?

NicoBiagi commented 1 year ago

The 'two-stage-decision' (https://expfactory.github.io/experiments/e/two-stage-decision/). I downloaded the folder and hosted it on a private server using CPanel.

vsoch commented 1 year ago

Your best bet is to ask at https://github.com/expfactory/expfactory-experiments and you can see the folks that have worked on that experiment over the years: https://github.com/expfactory/expfactory-experiments/commits/master/two_stage_decision. I didn't make most of the experiments, just packaged them up, so I'm afraid I don't know the answer to questions about them.