j55blanchet / dance-teacher-xr-unity

https://dance-teacher-xr-unity.vercel.app
0 stars 0 forks source link

Make a practice plan #97

Closed sixuanhan closed 1 month ago

sixuanhan commented 11 months ago

Similar to what Julien and I have discussed earlier, it would be beneficial to have specific guides about What to do next (which part of the song to practice) and different practice modes (drill, walkthrough, speed etc. the How question).

sixuanhan commented 11 months ago

<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns="http://www.w3.org/TR/REC-html40">

action verb | speed default | speed customizable? | reference/mirror default | reference/mirror customizable? | skeleton colorcode | LLM feedback | directing the user to a step -- | -- | -- | -- | -- | -- | -- | -- mark | 0.5 | yes | reference | yes | yes | no | no drill | 0.5 | yes | both | yes | yes | yes | no do full out | 1 | no | mirror | no | no | yes | yes   |   |   |   |   |   |   |   voice command: action verb + sectionID + modifiers |   |   |   |   |   example voice commands from the user: |   |   |   |   |   |   "mark section 1 with 0.5 speed and show both reference and mirror." |   |   |   |   |   "drill section 2 with only reference." |   |   |   |   |   |   "do full out section 3." |   |   |   |   |   |   |  

j55blanchet commented 10 months ago

Marking: we don't want the user to feel like they're being evaluated. So don't prescribe a next step.

j55blanchet commented 10 months ago

Users may want to go in any order with regards to mark -> drill -> full-out, and which sections they do these for. They could do mark > drill > fillout for one section before moving on, or perhaps mark a bunch of sections at a time before drilling any of them. The choice should be up to the user.

j55blanchet commented 10 months ago

Is it useful to help the user keep track of what they've marked?

j55blanchet commented 10 months ago

For mark phase, the coach can ask users "do you feel like you know the moves now?" or similar question. The user can answer "yes", "no". If they say yes, we suggest they move onto a next activity. If they say no, we suggest they try making again.

We can extend this approach for other phases.

  1. User finishes practicing a segment.
  2. The system generates a list of potential next activities. 3a. The system asks the user a follow-up question to decide on which activity to suggest.
    • The user answers, and the system recommends a next activity accordingly. 3b. The system uses it's own evaluation to suggest a next activity.
  3. The user chooses a next activity. Can be from the list or not.
j55blanchet commented 10 months ago

Make a little menu that enables click-based navigation to mark/drill/full out phases + associated configurable parameters.

j55blanchet commented 10 months ago

Final stage of full out: dance without a mirror, then review the recording afterwards

j55blanchet commented 10 months ago

Drilling has a sub-progression:

Full out has sub-progression:

j55blanchet commented 10 months ago

There's a minimum length where doing full-out makes sense.

j55blanchet commented 10 months ago

In dance studio, drills often focus on a particular part of the dance. You get tired, maybe sloppy, but are practicing something specific.

Full-out is a mock-performance, puts you in a different mental headspace. You put your best out there

j55blanchet commented 10 months ago

In drill, the user may want to focus on one particular aspect of their performance (like their legs, for instance). So we don't want to give them feedback which may not be relevant to what they're actually trying to practice.

Or, users can just ignore the feedback in this case. It's not a big deal

j55blanchet commented 1 month ago

Done as part of MOCO submission