h1

SALSA: Spatial Automated Live Sports Audio – demonstration at IBC 2015

October 31, 2015

IBC-5

In addition to the Object Based Clean Audio demos that Rob Oldfield and I gave at IBC 2015 we were also showcasing the results of a long running development project in audio for live sports broadcast. Thanks to some internal funding from the University of Salford‘s Staff Innovation Challenge competition, and to some great work from Darius Satonger we have done some further development on research that we started on the EU FP7 FascinatE Project capturing audio objects from a live football match.

Live football broadcast - OB at EastlandsDuring the development work we spent quite a bit of time in outside broadcast trucks with some of the best mixing engineers around – the skill levels of these guys is impressive and watching them using mixing desk faders to follow the ball movement around the pitch during a football match made us realise the complexity of their job. The aim of our work was to find ways that would assist the mixing engineer in creating a great mix for both conventional, and object-based broadcast, and to ensure that transition to object-based broadcast was a painless one by tailoring our additions to existing workflows.

The software we have developed over the last few years works in real time by matching on-pitch sound events to a database of audio object templates in order to identify sounds that we want to capture such as ball kicks and referee whistle blows. Once a sound is identified the software identifies the location of the sound (typically to within around 50cm), isolates the sound as a short-duration audio object and tags it with metadata detailing the type of sound, its location on the pitch and its duration.

Once the tagged audio object is created it is used in three ways:

  • firstly, to control the faders on a mixing console (using standard console automation protocols) so simplifying the process of capturing on-pitch events and allowing the mixing engineer to concentrate on the sound design of the game.
  • secondly, to route the packaged object to a different bus for each object type – so ball kicks were routed to bus 1, whistle blows to bus 2 – in order that they could be processed and eq’d independently.
  • and third, to create audio objects suitable for new object-based broadcast formats.

Screen Shot 2015-09-23 at 11.00.53Thanks to our friends at DTS and Fairlight we were able to implement all of this in real time for demonstrations at IBC 2015 as part of a complete outside broadcast production workflow, from capture to reproduction, using DTS’s MDA object-based audio format.

Our SALSA software was modified so that our extracted audio objects were sent to Fairlight’s 3DAW system in their QUANTUM live mixing console which then packaged the objects into an MDA stream for broadcast.

University of Salford's SALSA software at IBC 2015

University of Salford’s SALSA software at IBC2015

We have plans to improve on the software over the next few months and using it to mix a live game with a view to licensing the technology.

Many thanks to DTS and Fairlight for such a great collaboration.

Advertisements

3 comments

  1. […] second show Rob Oldfield and I have done in collaboration with DTS and Fairlight; last September saw us at IBC in Amsterdam showing our automated sports audio solution working with the MDA open object-based […]


  2. Hi

    TV2 Denmark here.
    We do lot of sports and are interested in testing asap. Software solution prefered.
    Must talk ember+ to a studer console.Yamaha PM5 or CL1
    Sports : Basket,football,handball,badminton etc.

    Any tech specs: like latency, number of mics prefered,”precalibration” for the specific sport sound etc.

    Is it tested live somewhere ??

    Otto Mikkelsen. TV2/Denmark OB department


  3. […] SALSA: Spatial Automated Live Sports Audio – demonstration at IBC 2015 […]



Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: