extratone / bilge

Documentation for The Psalms - my blog about software’s intersection with culture. Not just for the website - for the entire process (correspondence, notetaking, drafting, *revising*, editorializing, promoting, discussing, and even reflecting.)
https://bilge.world
Other
40 stars 4 forks source link

Apple “Spatial Audio” Specifications #175

Open extratone opened 3 years ago

extratone commented 3 years ago

"Dolby Atmos: What you need to know about the spatial audio format"

By Geoffrey Morrison 'Jun 17, 2021 at 05:00'


11-amazon-echo-studio

The $200 Amazon Echo Studio is a Dolby Atmos-compatible speaker.

Sarah Tew/CNET

At its WWDC 2021 conference last week Apple announced "spatial audio" for its Apple Music service, and company exec Eddy Cue said it was like the transition to HD for television. What not many people realize is that this particular branch of the technology has been with us for quite a few years, where it has been, and still is, known as Dolby Atmos.

Dolby Atmos is a popular surround-sound format, a competitor to DTS:X, and it's found in everything from the biggest commercial cinemas to home theater systems -- and now on mobile phones. While this format, also known as "immersive,"was originally designed for movie theaters, it is now used as a new way to remix and listen to music from the likes of The Beatles and Ariana Grande.

While the biggest change in the cinema was the addition of height channels, Atmos soundtracks can work with many different systems, no height speakers required. Dolby Atmos can be replayed on a traditional surround system or even with a pair of headphones thanks to technologies like Dolby Virtual:X and Dolby Headphones. What Apple calls spatial audio incorporates Dolby Atmos as well as its own head-tracking technologies in products like the AirPods earbuds.

Video: iOS 15 brings AirPods upgrades

In this explainer I'll break down how Atmos works, why height speakers and upward-firing soundbars are cool, and everything you've ever wanted to know about Dolby Atmos but never bothered to ask.

A few highlights:

Making sound surround

vizio-2021-soundbar-range.png

The $450 Vizio M512a-H6 is an upcoming Dolby Atmos soundbar.

Vizio

To understand what makes Atmos different from, say, its direct predecessor Dolby Digital, let's first take a look at how sound is mixed for movies and TV shows.

Everything you hear in a movie, from the music to the voices to the sound effects, all gets mixed into specific "channels." For simplicity's sake, we'll say these channels are, as you look at them in a room, left front (L), center (C), right front (R), right surround (RS) and left surround (LS). Some more complex systems add "surround back" channels. All the low frequency booms and thumps go to the ".1" subwoofer channel. This diagram should help:

traditional-dolby-cinema-layout

A traditional 7.1 surround system in a theater. Lots of speakers, but only a few "channels" to direct the sound to. So a sound would come from the left "wall" not a specific speaker on that wall.

Dolby

So if two actors are speaking onscreen, that gets mixed to the center channel. When the music swells during a dramatic moment, that's usually in the front left and right channels. Zooming and swooping special effects might appear in the surround speakers. To an extent, this same mix of channels also translates to the home. After all, if you have a 5.1 speaker system, you have all those same speakers.

Except… you don't. Not exactly. Where your speakers are, how powerful they are, and increasingly, how much range each has, varies greatly compared with a decent movie theater.

Atmos, for the most part, doesn't use channels. Instead, most sounds are treated as "objects." Instead of assigning a sound to a channel (and by extension, a speaker), Atmos lets filmmakers assign a sound to a place. Not "left surround speaker" but "left rear corner." Not "pan from left surround speaker to right sound speaker" but "pan smoothly across the rear wall." Not only does this give greater flexibility, but it improves the experience in the theater and, potentially, at home.

dolby-atmos-pinpoint

With Atmos (on the right), sound designers can pinpoint exactly where in any Atmos theater they want a sound to "appear." This could be just about any place in the room, including overhead.

Dolby

Atmos is an end-to-end change in theater and home audio. The mixing is different, as we've discussed, but so is the decoding. At different theaters the number of speakers can vary dramatically, but Atmos will scale with them regardless. Most theaters have many speakers along the walls to ensure everyone gets the same-ish experience. With Atmos those speakers can be individually addressable and a sound designer can pinpoint the exact location in a theater where they want to place a sound. A smoother experience for everyone. This is represented in the image above.

This includes the headline Atmos feature: height. With speakers hanging from the ceiling, sound engineers can now move sounds seamlessly over your head and all around. Done right, it's not only more convincing than before, but also less obtrusive. It's more natural, so you're less likely to notice the special effects and more likely to stay absorbed in the movie. And that's the point, right?

So what about the home?

Tidal offers a selection of Dolby Atmos Music titles via its app.

Sarah Tew/CNET

Theaters are great and all, but most of us watch more movies at home, even under normal circumstances. Atmos isn't even just about home theater anymore either, as Dolby has been branching the format out into music. Before Apple threw its hat into the ring, Tidal and Amazon Music offered a selection of titles that had been remixed in Atmos, and with Sony's competing 360 Reality Audio, the number of beyond-stereo tracks is still growing.

To let mobile users experience both Atmos music and movies, many newer mobile devices have a version of the technology called Dolby Atmos for Headphones. Though those are stereo-only, they're designed to simulate Atmos effects with any headphones. The tech is available for Xbox and PC as well, for $15, via the Dolby Access app.

Loading video

If you're listening at home, though, let's get this out of the way first: Obviously most people aren't going to install height speakers in their ceiling. That's fine because there are a growing number of speakers and soundbars that either feature built-in height channels or fit on top of existing models. In the case of a standard tower or bookshelf speaker you can fit a speaker model on top that has a separate, upward-firing driver. These speakers bounce sound off the ceiling to mimic "real" height speakers. I've heard quite a few of these and they work surprisingly well. Not as well as real height speakers, of course, but it works and is a far simpler option if you aren't interested in installing speakers in or near the ceiling.

The Focal Sib Evo is an Atmos-ready speaker set. Just add a Dolby Atmos receiver.

Sarah Tew/CNET

So, yes, if you want to take advantage of true Atmos surround you'll need new hardware. But Dolby Digital is still the default for everything, so this isn't a required upgrade. If you're not interested in Atmos, your gear will still work. Even if you get a brand-new 4K streamer to connect to your older receiver, the audio will still work if it doesn't have Atmos. It will just play a Dolby Digital or Dolby Digital Plus track.

Two Atmos home setup examples.

Dolby

But if you want height channels, more channels or other benefits of Atmos, then you'll need a receiver or soundbar that can decode it and a source that provides it. (Those sources include 4K Blu-ray players, newer media streamers and some game consoles.) And you'll need Atmos content, of course, which we'll discuss in a moment.

To the right, you'll see a couple of Atmos home setup examples. At the top, you see a setup with specially designed upward-firing speakers. Each is a traditional speaker but also has separate drivers that shoot sound to bounce off the ceiling. These are tuned so the bounced audio sounds correct to your ears. At the bottom, you see a soundbar designed to do the same.

Atmos also lets you have a greater number of possible speakers. So how many could you have if you really wanted to go wild? Oh, 24… plus 10 height speakers. Yep, 34 speakers if you want. You don't need to do that, of course. But if you've got a bunch of spare speakers and amps laying around and a room that can fit them, go for it.

On the left, a well-installed Atmos home theater system with four in-ceiling height speakers. On the right... good luck with that.

Dolby

For Atmos, Dolby uses a slightly different twist on the nomenclature of home systems. Traditionally a 5.1 system has three speakers up front, two on the sides or in back and a single subwoofer. If you then added two Atmos height speakers, Dolby would describe this system as a 5.1.2 system. If you see "a 7.2.4 home theater" you can deduce that it's probably got three speakers up front, two on the sides, two in back, two subwoofers and four height speakers.

All around

In addition to the gear, you'll also need Atmos content. That's actually pretty easy. If you're streaming you can find it on Amazon Prime Video, Netflix and Vudu. As we noted above, music can be found on Amazon Music Unlimited, Tidal and Apple Music. On disc it can be found on 4K and regular Blu-ray discs. It's even in a handful of video games.

Chances are if the movie is 4K, it's also Atmos -- though that doesn't mean it's in Atmos everywhere you can find that movie. It might be available with Atmos on the 4K Blu-ray, but not on Amazon, for example. Just keep in mind there won't be compatibility issues. If you buy a movie that features Atmos it will also have an audio track your current gear can play, minus the height channels.

Is it worth upgrading all your gear to take full advantage of Atmos? No. It's cool, but if you're not a home theater junkie this might be more money than you need to spend if you're not using it. When you're ready to upgrade anyway, chances are the gear you're considering will have Atmos. For example, most of our favorite receivers already work with Atmos, as do several of our favorite soundbars.

Originally published two years ago. Updated with information about Atmos Music and Apple's spatial audio.


Got a question for Geoff? First, check out all the other articles he's written on topics like why you shouldn't buy expensive HDMI cables, TV resolutions explained, how HDR works and more.

Still have a question? Tweet at him @TechWriterGeoff, then check out his travel photography on Instagram. He also thinks you should check out his best-selling sci-fi novel and its sequel.

-"Dolby Atmos: What you need to know about the spatial audio format"

extratone commented 3 years ago

"Fraser T Smith: "We’ll look back on stereo like we do black and white TV""

By ** ''


The producer and artist shares the story behind his zeitgeist-splicing Future Utopia project and how he’s using spatial audio to rewrite the live music experience.

[ ](mailto:?subject=Fraser T Smith: “We’ll look back on stereo like we do black and white TV”&body=https://www.musictech.net/features/interviews/fraser-t-smith-future-utopia-concept-albums-spatial-audio/)

Fraser T Smith

“I really think we’ll be looking back at stereo sound in the same way we view black and white TVs now we’ve found colour. With spatial audio, we’re on the verge of something really new and exciting.”

Grammy Award-winning artist and producer Fraser T Smith is discussing his debut live outing as Future Utopia and the spatial audio technology he’s embraced to bring his music to life. He’s no stranger to anticipating the future. From working closely with the likes of Adele to pioneering rapper Dave and UK grime hero Stormzy, Fraser’s musical projects have continually pushed things forward, redefining our contemporary sonic world via a 20-plus year career shining with number one albums, industry awards and critical success.

Now working under the guise of Future Utopia, a creative vehicle for his work as an artist, he released a debut album 12 Questions in 2020, a kinetic collection of tracks interrogating the mysteries of our modern world. Packed with guests such as Dave, Stormzy, Arlo Parks and former Black Panther Albert Woodfox, Fraser has followed the release with a socially distanced live show at the fittingly titled Bold Tendencies venue in Peckham. The performance saw him using the spatial audio technology of the d&b Soundscape to offer an immersive live experience for those present.

“The advances in spatial audio, Dolby Atmos and Soundscape are so exciting at the minute,” says Fraser of the performance, which showed off the depth of his collaborations with former poet laureate Simon Armitage and Kojey Radical appearing.

“We’re so used to vocals and any low frequencies in the centre of the sound and everything panning out from there. With this, we can place sound anywhere we want, and it’s exciting to see if vocals feel more emotive if they’re coming from behind you or to the left or right. All these possibilities have yet to be realised.”

Fraser T Smith

12 Questions

12 Questions was unveiled last year in the midst of the pandemic, and Fraser has been itching to present this record in a live setting ever since. With an exciting cast of characters on board, he believes the album’s success stems from its authenticity, his extensive studio experience and the efforts channelled into it.

“I flew to New Orleans to speak with Albert Woodfox and crafted the tracks with the best instruments and recording techniques I could gather from what I’ve learned in the last 20 years,” he explains. “Hopefully, the love for the subjects and sounds, alongside the attention to detail and the knowledge I’ve gained from working with so many incredible artists in my career, shines through.”

Following years of working as a producer for others, Fraser saw the record as an opportunity to pour his whole creative self into the 12 tracks, totally embracing his own musical aesthetic.

“It was incredibly freeing creatively to make something that was all me,” he laughs. “I felt like I had this music inside me. I’m not the sort of producer who will stamp everyone’s records with my chords, sound and beats; it’s more like ‘how can I help you?’ So for me, this album was all about being able to express myself fully.”

Fraser T Smith

Soundscape tech

Used previously by fellow audio aficionados Björk and Imogen Heap, d&b Soundscape allows sound designers, engineers and artists to work with multidimensional source placement and acoustic room simulation to create an immersive audio experience.

In traditional live scenarios, sound comes from two groups of speakers on either side of the stage in a stereo solution. Although this has offered great results, there are some limitations with the sound only achieving so-called ‘perfection’ for those equidistant from both sets of speakers. With d&b Soundscape, each listener perceives each sound source, whether it’s the artist’s voice or an instrument, to come from exactly where it is located to offer a more consistent musical experience. For Fraser, this tech allowed him to explore a performance that goes far beyond mere album playback.

“I wanted to reimagine the sound and progress into a new realm,” he states. “So interpreting the songs in a more electronic way, which I could actually play back. The record is so orchestrated and arranged – there are live drums, bass, strings and horns – I wanted to take this live reimagining into a different world.”

The live setup is based around running live stems through Ableton, then Fraser has the opportunity to trigger sounds. He also uses an Akai MPD 32, Roland SPD drum pads and a Moog Voyager, among his other pieces of gear.

“People’s ears will become accustomed to such amazing imagery sonically from the headphones that when they go to a traditional live gig, it will feel really disappointing if you haven’t got this surrounding sound.”

“I’m playing all this live on the top, so it’s a hybrid set up of musicianship and electronica, but even the latter is triggered live, so there’s a lot of fluidity to it,” he says.

With the album featuring so many collaborators, Fraser was keen for the performance to celebrate them, the front-of-house engineers, and the location of sound via d&b. He views the event as a real collaboration, and with Apple committing to spatial audio on both Apple Music and Logic, Fraser thinks this kind of live music experience will increasingly become the norm.

“People’s ears will become accustomed to such amazing imagery sonically from their headphones that when they go to a traditional live gig, it will feel really disappointing if you haven’t got this surrounding sound.”

“Then you can come back to creatives like me, and suddenly we’re thinking about sound in 360 degrees. You have all this sonic real estate to play with, which is so exciting.”

The performance itself took place in Bold Tendencies, a car park in Peckham, which created other exciting challenges and thematic shades.

“The venue was pure concrete, but I was able to enjoy seeing it lit brilliantly and how iconic it actually was. There was something dystopian about it with my gear set up around this Noise Matrix sculpture made by my wife, Sarah.”

Fraser T Smith

Future Utopia

Some of the record’s themes have taken on extra layers of meaning because of how the pandemic has impacted our lives.

“The bulk of the album was there before lockdown, but the resonance of some of the questions such as ‘What’s the Cost of Freedom?’ Is more open to interpretation now,” states Fraser. “I asked Albert Woodfox, who was locked up for 44 years and gave the most incredible answer around taking your views and making them a reality. I gave that to Kano, and he interpreted it from his side of being inside during the pandemic.”

Fraser also loves the idea of concept albums: ambitious records where creatives have much more freedom to explore their artistry in greater depth.

“Some people have tried to tell me it’s a seventies idea, but Psychodrama by Dave is a real concept album, so is Gang Signs and Prayers,” he explains.

“I love the idea of all these tracks hanging together, and I think most artists aspire to make a body of work like this. I’m lucky to have been behind some albums that have done very well and hope those records will be looked at as classics. People will have different favourite tracks, but you get a certain sense of freedom with a long-player. You can put a 30-second song on there or an 11 minute one like Lesley on Psychodrama – you can be as expansive or as reductive as you want.”

The producer

As producer of choice for Kano, Dave and Stormzy, Fraser is a creative mentor, helping these artists realise their musical ambitions and create landmark albums. He’s modest about his contribution, but there’s no doubt that there’s something magical about the relationships he’s forged. Fraser’s role is different in each case, but there are some unifying threads binding these projects together.

“One of the common things when working with artists is to provide a safe space for them in which they can express themselves without judgement. I’m there to establish a rapport so they understand that I’m there for the good of the music, and I can have honest conversations.”

Fraser’s previous experience as a session guitarist, his understanding of gear, and how to make things sound good quickly has stood him in great stead.

“With Dave, he’s such a great musician, whereas with Stormzy, he always has this vision – ‘let’s put a harp on this grime track’. My job is to try and translate these incredible ideas into something that would work on a record. With Kano, he’s so musical, he’d jam on the MPC drum machine, and I’d be playing keys a lot of the time. Ultimately, every relationship is very different but based on experimentation and instinct. This is the most powerful aspect.”

Fraser T Smith

Gear

Fraser works primarily out of his own studio, and despite being a tech-enthusiast, he tries to avoid getting hooked on specific pieces of equipment. For him, upgrading what you use is an effective way of discovering new sounds and creative areas. At the same time, there are some pieces he loves.

“I was lucky enough to meet Eric Valentine, who creates the UnderTone Audio gear. He built this desk for me, and I use his preamps for everything. There’s something about the sonics of that. It has a very detailed imprint sonically with this lovely warm, punchy low end, but a very clear top end that isn’t harsh.”

For Fraser, the needs of the artists dictate what direction he goes with his equipment and tech.

“Ultimately, when you work with Adele, it’s like, ‘how does the vocal sound?’” he says. “You’re after clarity in the meaning and emotion, so the vocal chain is really important.”

Fraser T Smith

Production wisdom

When it comes to advice for aspiring studio heads, Fraser suggests dipping into records by the great producers and artists and mining for ideas and pointers within them.

“There’s so much richness out there to delve into. Learning how the older generations made music and seeing if you can use any of their processes in yours is a great way to take it forward,” he says.

He also believes doing your research and measuring your output against your favourite records provides a benchmark of quality to aim for.

“Having an honesty to your art and being self-critical can be very important,” he states. “If you’re making a hip-hop record, then put on something from Dr Dre’s 2001 and ask yourself whether your kick drum is good enough. Is the snare hitting in the same way? If you put on a Dre track and you realise that ‘Oh, I’m actually nothing – I’m not even a speck of dirt on that guy’s shoe’, then go into it further. Learn his techniques and play around. That desire for progression coupled with honesty is a good combo.”

Embrace the future

With the first live show now under his belt, Fraser is keen to continue adding to his experiences as Future Utopia despite being a self-confessed introvert,

“I love being in the studio on my own. Although I had a burning desire to play live, if I started to think about it too much, then it became terrifying,” he laughs. “I had to remind myself I was really well-rehearsed, and as it came down to it, it was brilliant. It was right to be apprehensive but to do it and see it all come together was amazing.”

Despite being one of the world’s most in-demand and successful music producers, Fraser is hugely modest about his achievements and this new project.

“I don’t have any sense of entitlement around Future Utopia. I may have worked with Stormzy, and he may be on my record, but I realised I need to work for this. I’m a new artist, starting from scratch, so I’m hungry to get out there and take every opportunity that comes my way.”

He continues: “I’ve always loved music, but I don’t like repeating myself. I thought after Made in the Manor, Gang Signs and Prayers and Psychodrama that I was in danger of becoming a pastiche. But doing something different and taking a different path is what I’m all about.”

_Future Utopia’s 12 Questions is out now. Listen to the latest single Freedom now. _Visit frasertsmith.com for more information.

-"Fraser T Smith: "We’ll look back on stereo like we do black and white TV""

extratone commented 3 years ago

"Stop Settling for Mono Playback" | The Psalms

Yeah, it was literally just 1743 days ago that I felt obligated to publish one of my very first (if not the first) ranty iOS-related post about...

Insufficient STEREO PLAYBACK ACCOMODATIONS