Explore new sound design focused on all quadrilateral shape transformations

[brettfiedler]

We aim to investigate a new sound design that emphasizes the transition between all named quadrilateral shapes, while supporting their maintenance as well. We aim to capture the build-up of unique properties for named shapes, but not contain the design space so tightly to require exact mapping of properties to sounds. The conceptual space is very complex and does not lend itself well to simple sound design for all relevant conceptual properties.

[brettfiedler]

Talked with EM and Ashton about a possible general sound design that emphasizes the transitions between shapes we name (Convex Quadrilateral, Concave Quadrilateral, Dart, Kite, Trapezoid, Isosceles Trapezoid, Parallelogram, Rhombus, Rectangle, Square) and give the overall impression of building up as you move from shapes with no discernible properties (convex quadrilateral, only requirement = interior angles sum to 360) to shapes with rigid definitions (most complex being square which inherits the definitions of most other quadrilateral shapes).

I attempted to bundle together the unique properties (angles, lengths) about each named quadrilateral to indicate the smallest possible changes as you change between shapes. This resulted in about 7-8 categories as pictures below.

0. Quadrilateral (ambient or silent)
1. Concave (or inverted)
2. Diagonal symmetry
3. Lateral Symmetry
4. Half-Parallel (1 set of parallel sides)
5. Full-Parallel (2 sets of parallel sides)
6. Angle Equality (all = 90)
7. Side equality (all sides same length)

Categories such as Convex/Concave or Half-Parallel/Full-Parallel can replace each other. Otherwise the sounds are additive.

Likely constraints for any sound designs:

• Only play new sounds on a transition (with some extra attack on first occurrence)
• When resuming drag that does not change the shape, fade in sounds (no attack)
• (idea) Scale volume with approximate area of shape (bounded to reasonable volumes)
• Should add some quality to the sounds that improve their listenability when maintaining the same shape.
• Sounds do not need to map exactly to properties in a quickly decipherable way - acknowledgement of transition and pleasantness of sounds should be priority.

[brettfiedler]

At sound meeting today we talked about introducing further musicality into the sound design during this rapid exploration, including the possible introduction/disappearance of instrumental/rhythmic components.

@Ashton-Morris will begin some mock-ups and follow up with @BLFiedler for synchronous design time and otherwise ping design team members for feedback here/in Slack.

[brettfiedler]

Made by @Ashton-Morris this week:

• Music/Rhythm layering: https://streamable.com/mx8i1m
• Individual notes layering: https://streamable.com/lqd5qp
• Shape “ambience”: https://streamable.com/9q0a07

At a quick meeting between AM and me, we discussed showcasing the possibilities of the following tomorrow using his software:

• Listening with more randomization in what aspects are present
• FMOD (music/rhythm layering example above):
  • Different sets of sounds present (e.g., 1246, 15678)
  • Emphasize one instrument at a time (louder) but play entire track at all times
  • Play a basic rhythm and add one later per shape (12, 13, 14, 18, etc)
  • Play basic rhythm (and maybe 1 other track) and alter instrument voice for each shape
  • Minor mapping of sounds and mixing beats with ambience/tones
    • E.g., We know convex or concave will be the base layer for all shapes, so keep them pretty inconspicuous as a simpler (warbling) tone and start adding more interesting beats with each shape (or different)
• Adding different parts to the beat (completing the track) vs. layer additional, complementary tracks
• Individual Notes (like streamable link above)
• Different ambiences per shape (like streamable link above)

We'll hold off exporting sounds until after the meeting, but have them ready for when @jessegreenberg can implement.

[brettfiedler]

@Ashton-Morris will export the tracks/loops/tones he has created so far broken out by the sets he demo'd at the last sound meeting. Then @BLFiedler will give specific sound designs for @jessegreenberg to implement in the sim as a priority over other issues (except Voicing issues).

I made these notes on the sets that were demo'd.

Individual notes (chord building for each aspect of shape, e.g., (from https://streamable.com/lqd5qp)) Ambiences (each shape one, ambience may reflect aspect of shape, e.g., https://streamable.com/9q0a07) Tracks: Beat tracks layer with each category addition (building) (e.g., https://streamable.com/mx8i1m) Tracks: Base beat + new track per shape (new track may reflect aspect of shape) Arpeggio: New part of arpeggio per shape (building up) Arpeggio: New part of arpeggio (building up) + new beat track

Tagging other Quad sound design folk for awareness - @emily-phet @terracoda

[emily-phet]

Just a note @BLFiedler: If you feel some of these seem more promising than others, you can go ahead and pick those that seem most promising to move forward with. It's definitely hard to predict exactly how they'll feel before you get to play with them in the sim...but wanted to make sure you knew it's ok to go with your gut to help streamline the process. If your gut says you need to see them all in action, of course, go for it. :)

@Ashton-Morris If any of these don't make it into the sim, can you record a short demo of the idea and list in this thread, so we have a record of it? Since we're trying something totally new here for Quad, we may end up writing about it later and having some examples of early designs will help!

[Ashton-Morris]

In my option we should start with three (time permitting).

• (3.) Arpeggio: New part of arpeggio
• (5.) Melody: Base track plays consistently and each shape has a corresponding melody to it
• (4.) Tracks: Beat tracks layer with each category addition (building)

@jessegreenberg There should be two types of logic from what I can tell, Shape Identifier, and State Identifier. The sound mockups wen't off of both directions. Hopefully the audio tracks could be interchangeable once that logic is put in. (ex. the logic for the Ambience mockup is the same for the Melody mockup, and the logic for building music is the same for the Arpeggio one.)

Let me know if you have any questions regarding implementation, I'd be happy to walk though things if needed.

Also, I'll do a screen recording of each mockup for our records.

Here are all the files to test.

1. Individual notes (these are actually lowest in pitch from highest in number to lowest) Quad_Individual_Notes-000.mp3 Quad_Individual_Notes-007.mp3 Quad_Individual_Notes-006.mp3 Quad_Individual_Notes-005.mp3 Quad_Individual_Notes-004.mp3 Quad_Individual_Notes-003.mp3 Quad_Individual_Notes-002.mp3 Quad_Individual_Notes-001.mp3

2. Ambiences Quad_Ambiences-005.mp3 Quad_Ambiences-001.mp3 Quad_Ambiences-003.mp3 Quad_Ambiences-002.mp3 Quad_Ambiences-004.mp3 Quad_Ambiences-007.mp3 Quad_Ambiences-000.mp3 Quad_Ambiences-006.mp3

3. Arpeggio: New part of arpeggio Quad_Building_Up_Arpeggio-000.mp3 Quad_Building_Up_Arpeggio-001.mp3 Quad_Building_Up_Arpeggio-002.mp3 Quad_Building_Up_Arpeggio-003.mp3 Quad_Building_Up_Arpeggio-004.mp3 Quad_Building_Up_Arpeggio-005.mp3 Quad_Building_Up_Arpeggio-006.mp3 Quad_Building_Up_Arpeggio-007.mp3

   • Optional Shape Identifier Tracks for above Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-000.mp3 Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-001.mp3 Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-002.mp3 Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-003.mp3

4. Tracks: Beat tracks layer with each category addition (building) Quad_Beat_Tracks_Building_Base_Rhythm.mp3 Quad_Beat_Tracks_Building_Building_Tracks-000.mp3 Quad_Beat_Tracks_Building_Building_Tracks-001.mp3 Quad_Beat_Tracks_Building_Building_Tracks-002.mp3 Quad_Beat_Tracks_Building_Building_Tracks-003.mp3 Quad_Beat_Tracks_Building_Building_Tracks-004.mp3 Quad_Beat_Tracks_Building_Building_Tracks-005.mp3 Quad_Beat_Tracks_Building_Building_Tracks-006.mp3

5. Melody: Base track plays consistently and each shape has a corresponding melody to it Quad_Melody_Tracks_Base_Music.mp3 Quad_Melody_Tracks_000.mp3 Quad_Melody_Tracks-005.mp3 Quad_Melody_Tracks-004.mp3 Quad_Melody_Tracks-002.mp3 Quad_Melody_Tracks-003.mp3 Quad_Melody_Tracks-001.mp3

[jessegreenberg]

Thanks @Ashton-Morris!

Sorry, I read through the issue but dont understand what to implement. @Ashton-Morris or @BLFiedler can you describe how each of the sound design should work? What sound is associated with what shape or state? How long should each sound play in response to input?

[brettfiedler]

For some quick initial testing let's go with 4 sound sets.

• Let's use a general rule for persistence for all of them for now (though we may choose to modify these for any individual set ahead of interviewing): Sounds play for 2 seconds after (mouse/touch release, last keyboard input) of any vertex or side

1. Tracks - Build Up.

Here we should try assigning a track to a specific element of the shape that may vary between shapes (e.g., amount of parallel), but builds toward more complex when you reach a square. This is based on my initial comment at the top of the issue.

Ideally, tracks that are already playing continue to play without restarting their loop. Functionally this might involve having all tracks playing all the time, but their volumes muted until they reach a shape that has that track assigned?

First, we assign each file a letter for brevity in the shape assignment

(0) A. Quad_Beat_Tracks_Building_Base_Rhythm.mp3 (base) (1) B. Quad_Beat_Tracks_Building_Building_Tracks-000.mp3 (inversion) (2) C. Quad_Beat_Tracks_Building_Building_Tracks-001.mp3 (diag symmetry) (3) D. Quad_Beat_Tracks_Building_Building_Tracks-002.mp3 (lat symmetry) (4) E. Quad_Beat_Tracks_Building_Building_Tracks-003.mp3 (1 x parallel) (5) F. Quad_Beat_Tracks_Building_Building_Tracks-004.mp3 (2 x parallel) (6) G. Quad_Beat_Tracks_Building_Building_Tracks-005.mp3 (sides equal) (7) H. Quad_Beat_Tracks_Building_Building_Tracks-006.mp3 (angles equal)

Each shape will have one or more tracks playing. Let's assign them like this for now (and adjust later for

• Convex: A
• Concave: B
• Dart: B, C
• Kite: A, C
• Trapezoid: A, E
• Isosceles Trapezoid: A, E, D
• Parallelogram: A, F
• Rhombus: A, C, F, G
• Rectangle: A, D, F, H
• Square: A, C, D, F, G, H

(@jessegreenberg, if while implementing you find swapping tracks above makes for better clarity/groovier beats, go for it! They are not mapped to particular elements at the moment. Just assigned based on increasing order).

2. Tracks - Volume Emphasis (Shape/State emphasis)

Here we'll try just giving each shape a part of the whole. Play all tracks all the time, but raise the volume of the assigned track (or lower the volume of all the rest, whichever works). I'm not sure how much to lower or raise, but probably something to quickly feel out during implementation.

We'll use the same letter assignments for the tracks as the previous set.

For the purposes of testing (without explicit mapping) - Let's order the shapes this way and just map on the above-ordered sound files. I realize there are actually 10 shapes and only 8 files for many of these. Let's skip Concave and Dart for now in this one.

• Convex - A
• Concave - (none)
• Dart - (none)
• Kite - B
• Trapezoid - C
• Isosceles Trapezoid - D
• Parallelogram - E
• Rhombus - F
• Rectangle - G
• Square - H

3. Melody (Shape/State Emphasis)

Similar to the last set, but instead of changing volume, we'll always play the base rhythm and swap out the tracks for each shape, so there is only ever two tracks playing (base + mapped track).

Again, there are not as many files as shapes here (6 of 10), so we'll have to cut a few for demo purposes.

ALWAYS: Quad_Melody_Tracks_Base_Music.mp3 Concave & Convex: Nothing additional Kite & Dart: Quad_Melody_Tracks_000.mp3 Trapezoid & Isosceles: Quad_Melody_Tracks-005.mp3 Parallelogram: Quad_Melody_Tracks-004.mp3 Rectangle: Quad_Melody_Tracks-002.mp3 Rhombus: Quad_Melody_Tracks-003.mp3 Square: Quad_Melody_Tracks-001.mp3

4. Arpeggio (Hybrid Sequential/Track Shape Emphasis)

Here I believe the goal was to assign both an arpeggio that built up the higher farther into the shape hierarchy you go. I'll be honest that I have difficulty mapping this correctly since there isn't a linear mapping or "logical progression" from Convex to Square. We only have 8 files for 10 shapes that we can detect, so we'll skip Concave/Convex. Also, there are additional tracks to layer, but there are only 4 that I can see. Unless we have more, let's try just differentiating the parallelograms as a test?

Let's try building up from arpeggio files 000 - 007 in the following order:

• Convex (none)
• Concave (none)
• Dart 000
• Kite 000 to 001
• Trapezoid 000 to 002
• Isosceles Trapezoid 000 to 003
• Parallelogram: 000 to 004, also play Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-000.mp3
• Rhombus: 000 to 005, also play Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-001.mp3
• Rectangle: 000 to 006, also play Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-002.mp3
• Square: 000 to 007, also play Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-003.mp3

@jessegreenberg, over to you. Feel free to slack with questions/concerns!

[brettfiedler]

@Ashton-Morris , just to note that there tend to be fewer tracks than shapes for the above sets. I have some alterations above to account for this, but we'll likely want to fill in the gaps before interviews.

[jessegreenberg]

OK everything is implemented with the above commits with the exception of a few sound files in the "Arpeggio" design. I don't see any of the "Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks" in the google doc file. Once those are in this will be ready for review.

[jessegreenberg]

Since we don't have the "optional arpeggio" sounds we will try playing the melody sounds under the arpeggio, at a reduced volume with this design

Convex (none)
Concave (none)
Dart 000, also play Quad_Melody_Tracks_000.mp3
Kite 000 to 001, also play Quad_Melody_Tracks_000.mp3
Trapezoid 000 to 002, also play Quad_Melody_Tracks-005.mp3
Isosceles Trapezoid 000 to 003, also play Quad_Melody_Tracks-005.mp3
Parallelogram: 000 to 004, also play Quad_Melody_Tracks-004.mp3
Rhombus: 000 to 005, also play Quad_Melody_Tracks-003.mp3
Rectangle: 000 to 006, also play Quad_Melody_Tracks-002.mp3
Square: 000 to 007, also play Quad_Melody_Tracks-001.mp3

[jessegreenberg]

OK, new sound designs are in! @BLFiedler @Ashton-Morris over to you to try it out and consider next steps! https://phet-dev.colorado.edu/html/quadrilateral/1.0.0-dev.46/phet/quadrilateral_en_phet.html

[Ashton-Morris]

@jessegreenberg Sorry I must have missed those. I am adding these now if you still want to add them.

Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-000.mp3 Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-001.mp3 Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-002.mp3 Quad_Building_Up_Arpeggio_Optional_Shape_Identifier_Tracks-003.mp3

[brettfiedler]

From last meeting:

Focus on mapping for

• Build Up (distinct tracks mapped to element of shape that create distinct sound for each shape)
• Volume Emphasis/Melody (distinct tracks mapped to each shape)
• Adjust tracks to keep similarity when appropriate (these are not different shapes altogether), but distinguishable.
  • All Convex should still sound pretty “similar”, maybe only Concave that sounds like a “different world”

Next Steps:

• [x] [Assigned to JG] Fade in and out when interaction begins and ends respectively. (accomplished in #189 )

• [x] [Assigned to JG] Reduce base rhythm volume by 25 - 50% for Buildup and Melody (corresponds to Convex in Buildup)

• [Assigned to Ashton]

  • [x] 1. Try creating a “simpler” set of tracks for Build Up and Melody.

  • [x] 2. Generate base beat track for Build Up and Melody that is reduced in complexity for use in current sound design.

  • [x] [Assigned to Brett with support from Ashton] Figure out which tracks currently work best for each possible mapping and suggest edits or new qualities for tracks for Ashton to edit or create.

[jessegreenberg]

The "base" sounds for melody and build-up designs were reduced in the above commits. Removing my assignment.

[Ashton-Morris]

Adding some files for:

Generate base beat track for Build Up and Melody that is reduced in complexity for use in current sound design.

• Quad_Simpler_Melody_Tracks_Base_Music.mp3
• Quad_Base_Beat_Simple.mp3

And: Try creating a “simpler” set of tracks for Build Up and Melody.

• Quad_Simple_Building_Tracks-000.mp3
• Quad_Simple_Building_Tracks-001.mp3
• Quad_Simple_Building_Tracks-002.mp3
• Quad_Simple_Building_Tracks-003.mp3
• Quad_Simple_Building_Tracks-004.mp3
• Quad_Simple_Building_Tracks-005.mp3
• Quad_Simple_Building_Tracks-006.mp3
• Quad_Simple_Building_Tracks-007.mp3
• Quad_Simpler_Melody_Tracks_000.mp3
• Quad_Simpler_Melody_Tracks_001.mp3
• Quad_Simpler_Melody_Tracks_002.mp3
• Quad_Simpler_Melody_Tracks_003.mp3
• Quad_Simpler_Melody_Tracks_004.mp3
• Quad_Simpler_Melody_Tracks_005.mp3
• Quad_Simpler_Melody_Tracks_006.mp3
• Quad_Simpler_Melody_Tracks_007.mp3

[brettfiedler]

@jessegreenberg, for quick turnaround to hear these new tracks, if possible before tomorrow (interviews 10AM ET and 3PM ET), let's create three NEW sound design sets:

1.) Tracks - Build Up - Simple Same as Tracks - Build Up, but replace every track with the Simple Version

2.) Tracks - Melody - Simple Same as Tracks - Melody, but replace every track with the Simple Version

3.) Tracks - Melody - Simple Mapping

Combine current Melody with Simple Melody to attain some similarities between similar shapes (similar shapes will have a more or less complex version of the same track).

• Concave: Quad_Beat_Tracks_Building_Building_Tracks-000 (borrow from Tracks - Build Up for that "otherworldly feel")

• Dart: Quad_Melody_Tracks_Base_Music.mp3 && Quad_Melody_Tracks_000.mp3

• Convex: Quad_Simpler_Melody_Tracks_Base_Music.mp3

• Kite Quad_Simpler_Melody_Tracks_Base_Music.mp3 && Quad_Simpler_Melody_Tracks_000.mp3

• Trapezoid: Quad_Simpler_Melody_Tracks_Base_Music.mp3 && Quad_Simpler_Melody_Tracks-005.mp3

• Isosceles Trapezoid: Quad_Simpler_Melody_Tracks_Base_Music.mp3 && Quad_Melody_Tracks-005.mp3

• Parallelogram: Quad_Simpler_Melody_Tracks_Base_Music.mp3 && Quad_Simpler_Melody_Tracks-004.mp3

• Rectangle: Quad_Simpler_Melody_Tracks_Base_Music.mp3 && Quad_Simpler_Melody_Tracks-002.mp3

• Rhombus: Quad_Simpler_Melody_Tracks_Base_Music.mp3 && Quad_Simpler_Melody_Tracks-003.mp3

• Square: Quad_Simpler_Melody_Tracks_Base_Music.mp3 && Quad_Simpler_Melody_Tracks-001.mp3

The next sound designs for Ashton are on Brett to play around with mapping and listening to tracks (though welcome feedback from everyone on that!)

[brettfiedler]

@jessegreenberg Feel free to remove all sound designs from the Preferences Menu list above the Tracks sound designs except for Parallels Volume (though that will probably go soon as well!)

Reverting part of that! @terracoda noted she would need the old Success sound design to match the description for interviews. We will need to retain that one as well.

[jessegreenberg]

@Ashton-Morris @BLFiedler here is a new version with the sounds as they are described in the above comment. Over to you to try it out and comment on next steps. https://phet-dev.colorado.edu/html/quadrilateral/1.0.0-dev.52/phet/quadrilateral_en_phet.html

[brettfiedler]

@jessegreenberg if possible before 2PM ET, thank you!!!

Just update existing Volume Emphasis sound design by adding the simple tracks identified below to Concave and Dart as the emphasized tracks. (still playing all)

(0) A. Quad_Beat_Tracks_Building_Base_Rhythm.mp3 (base) (1) B. Quad_Beat_Tracks_Building_Building_Tracks-000.mp3 (inversion) (2) C. Quad_Beat_Tracks_Building_Building_Tracks-001.mp3 (diag symmetry) (3) D. Quad_Beat_Tracks_Building_Building_Tracks-002.mp3 (lat symmetry) (4) E. Quad_Beat_Tracks_Building_Building_Tracks-003.mp3 (1 x parallel) (5) F. Quad_Beat_Tracks_Building_Building_Tracks-004.mp3 (2 x parallel) (6) G. Quad_Beat_Tracks_Building_Building_Tracks-005.mp3 (sides equal) (7) H. Quad_Beat_Tracks_Building_Building_Tracks-006.mp3 (angles equal)

(8) I. Quad_Base_Beat_Simple.mp3 (9) J. Quad_Simple_Building_Tracks-000.mp3

• Convex - A

• Concave - I
• Dart - J

• Kite - B
• Trapezoid - C
• Isosceles Trapezoid - D
• Parallelogram - E
• Rhombus - F
• Rectangle - G
• Square - H

Edit with justification I wrote to JG in Slack:

"I'd like to better test the "non-mapped, just distinguishable" sound designs, but I think the Melody sound design isn't triggering the "oh this is different" as currently mixed/mapped, but the volume emphasis should (if it was complete)

We could probably get Melody there, I'm just not sure exactly what changes to make, whereas it's more straightforward with this one!"

[jessegreenberg]

@BLFiedler OK, here is a new version with changes to "Tracks - Volume Emphasis" sound design.

https://phet-dev.colorado.edu/html/quadrilateral/1.0.0-dev.55/phet/quadrilateral_en_phet.html

[brettfiedler]

(discussed w/ JG over Slack, but posting here for posterity)

Trapezoid is kind of hard to hear and Kite/Dart are actually the same since Build Up 000 is the same in simple or normal.

Using a few tracks from the Melody sound design to differentiate can we:

• Give the current Kite track (Quad_Beat_Tracks_Building_Building_Tracks-000.mp3) to Trapezoid. Don't use Quad_Beat_Tracks_Building_Building_Tracks-001.mp3 at all.
• Give Kite Quad_Melody_Tracks-004.mp3
• Give Dart Quad_Melody_Tracks-001.mp3

[jessegreenberg]

Sounds good, done in this version: https://phet-dev.colorado.edu/html/quadrilateral/1.0.0-dev.56/phet/quadrilateral_en_phet.html

[Ashton-Morris]

1. I liked the levels, sound, and feel of: Tracks - Build up - Simple

2. I felt like: Tracks - Melody - Simple, would have worked better if the melody was less simple. When it's just on 8th note timing as opposed to 16th note timing it misses some instant recognizability. But I did enjoy the backing track bring as low in volume as it was.

3. Tracks - Melody - Mapping: I am not sure I could hear the distinct mapping on this one as clear. I did enjoy that the backing tracks had some more melodic elements to it but I don't feel like I was perceiving the differences from the previous mapping to this one when it comes to Melody.

[brettfiedler]

I felt like: Tracks - Melody - Simple, would have worked better if the melody was less simple. When it's just on 8th note timing as opposed to 16th note timing it misses some instant recognizability. But I did enjoy the backing track bring as low in volume as it was.

Agreed. And the same goes for the interviews. I think we'll need to do everything we can to boost instant recognizability for each shape transition. Tracks - Volume Emphasis performed better here in that regard. The standout track was sufficiently louder than the "constant" or background pieces.

Tracks - Melody - Mapping: I am not sure I could hear the distinct mapping on this one as clear. I did enjoy that the backing tracks had some more melodic elements to it but I don't feel like I was perceiving the differences from the previous mapping to this one when it comes to Melody.

Yeah, I wasn't sure exactly what was off here, but didn't have time to tease it out. We had enough to go on with the other sound designs.

[brettfiedler]

We're ready to begin modifications here.

After @terracoda finished up the consultant interviews, we chatted and agreed that it might be nicer to continue backing off on the "base" sound used whenever a convex quadrilateral is created/maintained.

I suspect a focus on Tracks - Build Up - Simple design while maintaining the Volume Emphasis design in parallel (no pun intended) would let us continue to provide either a property vs. shape music experience. We do plan to provide more than one sound design in the Preferences menu at publication.

Note, there are only 8 tracks needed for Build Up, but 10 needed for Volume Emphasis (or any other shape mapped sound design).

For Build Up, I'd like to discuss the following at design meeting today: 1) Reducing the Convex quad track to make it less interesting, but retain some nice foundational, constant quality the beat provides. Consider how it can mirror the Concave sound (either by adjusting concave or convex). 2) Consider the tracks use for 1 and 2 parallel pairs (trapezoid and parallelogram respectively). It'd be nice if they had some quality that built up going from 1 to 2, but ideally they should be distinct enough on their own.

[brettfiedler]

@Ashton-Morris , go ahead with coming up with ideas/tracks for item 2 above

Consider the tracks use for 1 and 2 parallel pairs (trapezoid and parallelogram respectively). It'd be nice if they had some quality that built up going from 1 to 2, but ideally they should be distinct enough on their own.

And I'll add in a specific item for item 1 soon.

[Ashton-Morris]

I uploaded some new audio files for the above conversation.

1. "Reducing the Convex quad track to make it less interesting, but retain some nice foundational, constant quality the beat provides. Consider how it can mirror the Concave sound (either by adjusting concave or convex)."
   • I have added Quad_Base_Beat_Simpler.wav and Quad_Base_Beat_Simpler.mp3 to try for this
   • I also have two options to try instead of "Quad_Simple_Building_Tracks-000.wav"

Quad_Base_Beat_Simpler_Concave_Quadrilateral_Just_Rhythm.wav Quad_Base_Beat_Simpler_Concave_Quadrilateral_Just_Rhythm.mp3 Quad_Base_Beat_Simpler_Concave_Quadrilateral.wav Quad_Base_Beat_Simpler_Concave_Quadrilateral.mp3

2. "Consider the tracks use for 1 and 2 parallel pairs (trapezoid and parallelogram respectively). It'd be nice if they had some quality that built up going from 1 to 2, but ideally they should be distinct enough on their own." For this I have Quad_Simple_Building_Tracks-004-Trapezoid.wav and Quad_Simple_Building_Tracks-004-Trapezoid.mp3 to try in place of "Quad_Simple_Building_Tracks-004"

[Ashton-Morris]

@jessegreenberg It should be just replacing existing files but let me know if you have any questions regardless.

[jessegreenberg]

This was discussed in meeting today, @Ashton-Morris demoed the new sounds and everyone thought they were great! They accomplished the pedagogical needs described above.

@Ashton-Morris is going to adjust or add a couple of sounds and @BLFiedler is going to identify how they should be mapped into the tracks designs.

[Ashton-Morris]

Adding two more files.

• Quad_Base_Beat_Simpler_Concave_Quadrilateral_Just_Rhythm_v2.mp3
• Quad_Base_Beat_Simpler_Concave_Quadrilateral_Just_Rhythm_v2.wav

[brettfiedler]

A few changes to test out for the Build Up Simple sound design and a general mixing change:

Default Sound Design

• [x] Set the default sound design to: TRACKS_BUILD_UP_SIMPLE

Default Volume for Shape Music

We would like to lower the volume of the shape music overall. Ashton indicated that the Reset All is the “baseline volume” is at 0.7 and suggested:

• [x] Start the maximum at 0.5 instead of 1.0 (we'll adjust from there).

Reset will be just slightly more prominent.

Reassign tracks for 1. Tracks - Build Up - Simple.

We have a lot of tracks now! I spent a bit of time reassigning tracks to the different mapping for Tracks - Build Up - Simple. The mappings for each shape are the same. Just the tracks are being swapped.

All tracks are found in this Drive folder. I moved a few older files into an Archive Subdirectory, but all of the below files are in the main directory.

• [x] Reassign the tracks according to list below (all tracks have changed).

A. (base) Quad_Base_Beat_Simpler (0) B. (inversion) Quad_Base_Beat_Simpler_Concave_Quadrilateral_Just_Rhythm_v2 (1) C. (diag symmetry) Quad_Beat_Tracks_Building_Building_Tracks-000 (2) D. (lat symmetry) Quad__Simple_Building_Tracks-007 (3) E. (1 x parallel) Quad_Simple_Building_Tracks-004-Trapezoid (4) F. (2 x parallel) Quad_Beat_Tracks_Building_Building_Tracks-004 (5) G. (sides equal) Quad_Melody_Tracks-004 (6) H. (angles equal) Quad_Beat_Tracks_Building_Building_Tracks-005 (7)

Overall look at what sounds play with which shape (unchanged)

• Convex: A (0)
• Concave: B (1)
• Dart: B, C (1, 2)
• Kite: A, C (0, 2)
• Trapezoid: A, E (0, 4)
• Isosceles Trapezoid: A, E, D (0, 4, 3)
• Parallelogram: A, F (0, 5)
• Rhombus: A, C, F, G (0, 2, 5, 6)
• Rectangle: A, D, F, H (0, 3, 5, 7)
• Square: A, C, D, F, G, H (0, 2, 3, 5, 6, 7)

JG EDIT: Here is the link to the folder, above was just a link to the track - https://drive.google.com/drive/folders/1YNrthgUqZXTQw-gA8ch6XIwBZ_RhsIKW

JG EDIT: Tracks are referenced by index in code so I added numbers so it is easier to check implementation against design. And that ended up confirming that none of the assigned values changed only the tracks :)

[jessegreenberg]

Alright, sounds good @BLFiedler! (finger guns)

I believe this is in place as you described, back to you.

[brettfiedler]

I'm seeing the change in default sound design and adjustment in volume, but not the correct mappings. Messaged JG with the following:

I think there is some scrambling in the audio files. [...]. I quickly copied over the relevant files in the Audio folder to a new folder for this iteration and renamed the files to have the index up front: https://drive.google.com/drive/folders/1JSN2Obe1OpOaY2qJKFsh31IVnLchUZlz?usp=sharing

Updated mapping:

index	filename	category
0	0-Quad_Base_Beat_Simpler	convex/base
1	1-Quad_Base_Beat_Simpler_Concave_Quadrilateral_Just_Rhythm_v2	concave/inverted
2	2-Quad_Beat_Tracks_Building_Building_Tracks-000	diagonal symmetry
3	3-Quad__Simple_Building_Tracks-007	lateral symmetry
4	4-Quad_Simple_Building_Tracks-004-Trapezoid	1x Parallel Sides
5	5-Quad_Beat_Tracks_Building_Building_Tracks-004	2x Parallel Sides
6	6-Quad_Melody_Tracks-004	Equal Sides
7	7-Quad_Beat_Tracks_Building_Building_Tracks-005	Equal Angles

[jessegreenberg]

I just pushed to quadrilateral for another issue and now see https://github.com/phetsims/quadrilateral/commit/347aae22c51247fcf11f2782f0d045c3afd1d667 came through just today which is the commit that rearranged the sound files...so that explains why the mappings were not right. Sorry about that!

Back to @BLFiedler to try now that https://github.com/phetsims/quadrilateral/commit/347aae22c51247fcf11f2782f0d045c3afd1d667 is pushed to remote.

[brettfiedler]

Wooo. Well, I think that's worth some listening for folks.

Could we post a dev version? If possible before the meeting tomorrow, but no worries if not.

My personal thoughts (given my own assignments :) )

• The 1xParallel track (index 4) is maybe a bit much or is maybe a bit loud given its qualities. Especially in an Isosceles Trapezoid - I think the Lateral Symmetry track (index 3) should stand out a bit more.
• Need some further volume balancing for All Sides Equal (index 6) and All Angles Equal (index 7) to help differentiate between Rhombus < - > Square < - > Rectangle. Maybe a track swap is still in order to help distinguish. Or maybe @Ashton-Morris has other ideas.
  • I brought in a Melody track for All Sides Equal to find something pretty distinguishable from the other tracks we had. It's a little repetitive. If folks like it in general, we might extend it just slightly with another one of the melody tracks.
• I like the concave/convex difference. It's a good balance of subtlety to me while being surprisingly quick to distinguish.
• I like the 2x Parallel track and how it layers behind rhombus/rect/square
• Similarly, kite family are really distinguishable and even for rhomb/square if you're listening for it.

[jessegreenberg]

Sure, here is a dev version with https://github.com/phetsims/quadrilateral/commit/347aae22c51247fcf11f2782f0d045c3afd1d667!

https://phet-dev.colorado.edu/html/quadrilateral/1.0.0-dev.66/phet/quadrilateral_en_phet.html

[brettfiedler]

In chatting with Taliesin, we concluded the following track swap might address some concerns while playing with a trapezoid:

• [x] Swap Quad_Simple_Building_Tracks-004-Trapezoid in index 4 for Quad_Beat_Tracks_Building_Building_Tracks-003

index	filename	category
0	0-Quad_Base_Beat_Simpler	convex/base
1	1-Quad_Base_Beat_Simpler_Concave_Quadrilateral_Just_Rhythm_v2	concave/inverted
2	2-Quad_Beat_Tracks_Building_Building_Tracks-000	diagonal symmetry
3	3-Quad__Simple_Building_Tracks-007	lateral symmetry
4	>>4-Quad_Beat_Tracks_Building_Building_Tracks-003 <<	1x Parallel Sides
5	5-Quad_Beat_Tracks_Building_Building_Tracks-004	2x Parallel Sides
6	6-Quad_Melody_Tracks-004	Equal Sides
7	7-Quad_Beat_Tracks_Building_Building_Tracks-005	Equal Angles

[brettfiedler]

Assign back when swap has happened and we'll work on volume mixing of tracks for individual shapes. e.g., Equal Sides (index 6) is a bit loud in the Rhombus and Square.

[jessegreenberg]

Swap was made in https://github.com/phetsims/quadrilateral/commit/060eded29d3ac09fcb252570cf7aba558ed9d039, back to @BLFiedler.

[jessegreenberg]

We reviewed this today and decided that the output levels of individual tracks in each design needs to be adjusted. It would be quick to add some temporary controls to adjust the output levels so Ill do that in case it helps with the sound design.

[jessegreenberg]

@BLFiedler @Ashton-Morris I added some controls for this under the ?soundBoard query parameter. You can control the output of sound levels for individual tracks with this


Please note that ONLY the sounds assigned to each shape are controllable. So when a sound is not playing for a particular shape, the related slider has no impact on the output. It also isn't possible to control the "ambient" output in the "Shape Emphasis" design. If it would be helpful to have full control over these things let me know - it would be a simple change but I thought that would actually add confusion at this point to change the designs that much.

[brettfiedler]

Placeholder for now - I think I like this configuration. Note, I also lowered MAX_OUTPUT_LEVEL = 0.3

[brettfiedler]

Let's commit to this change ahead of anyone else using the sim.

@jessegreenberg

• [x] Lower MAX_OUTPUT_LEVEL = 0.3
• [x] Adjust track volumes according to graphic in previous post.

[jessegreenberg]

Adjust track volumes according to graphic in previous post.

@BLFiedler are those the values I should use for both sound designs?

[brettfiedler]

These apply only to Build up, though the overall output level should decrease for both sound designs.

A change to a couple of tracks are needed for Shape/Volume Emphasis. Keeping myself assigned for that task.

• [ ] Assign new tracks for secondary sound design. @BLFiedler

[jessegreenberg]

https://github.com/phetsims/quadrilateral/issues/175#issuecomment-1351752296 done, and set up so that the other sound design can have its own set of output level values when ready. Back to @BLFiedler for next steps.

[brettfiedler]

For the secondary sound design, I swapped a few tracks for ones not being used that were a little less punchy, and differentiated Concave and Convex a bit more (moved concave to the simpler concave beat) in the above commit. I also restored the background volume to 0.15.

I wanted to make a few volume adjustment requests and then call this complete.

@jessegreenberg, I have a few mixing requests for when the sounds are foregrounded, but also one for the background.

• [x] 1.) Can you make individual adjustments to the following tracks when they are foregrounded: Related to this soundboard graphic:

  • Index [0], convex, lower to 0.75 relative to maximum
  • Index [2], kite, lower to 0.80 '' ''
  • Index [6], rectangle, lower to 0.50 '' ''

• [x] 2.) The rectangle sound (track index 5), dominates a lot of the background tracks. I put the overall background volume back to "0.15", which I think works well for most of the tracks, but it'd be nice to cut track 5's by 50% in the background.

[jessegreenberg]

• I noticed that for the "Build Up" sound design, all tracks are playing at their default level instead of the level requested in https://github.com/phetsims/quadrilateral/issues/175#issuecomment-1339626942. Fixed in the above commit.

• Can you make individual adjustments to the following tracks when they are foregrounded:

• 2.) The rectangle sound (track index 5), dominates a lot of the background tracks.

Done. @BLFiedler can you please review?

[brettfiedler]

• I noticed that for the "Build Up" sound design, all tracks are playing at their default level instead of the level requested in Explore new sound design focused on all quadrilateral shape transformations #175 (comment). Fixed in the above commit.

Regardless of where it was, it sounds good to me now.

• Can you make individual adjustments to the following tracks when they are foregrounded:

• 2.) The rectangle sound (track index 5), dominates a lot of the background tracks.

Ack. I requested the wrong track. Meant 6 instead of 5. But, since you put in the structure @jessegreenberg, I could easily fix my mistake :) Done in above commit. I also raised the background volume of the trapezoid track.

I'm calling this design complete :dusts hands:

Offering to @Ashton-Morris to do a full review of the shape sounds in both designs (can be changed in the Preferences menu) before closing this issue.