Featured at The Lab at Panorama Festival in NYC July 22nd-24th, Hyper Thread is a large-scale interactive sonic experience that invites the audience to explore, manipulate, and create sounds in real time through tactile engagement. Via a series of silk cocoons inside of a larger undulating silk envelope, tension and movement of the audience are translated into musical components of the 3D soundscape and immersive lighting environment.
Jon Baken, Composer
Nick Bratton, Composer
Shane Myrbeck, Composer
Yotam Mann, Composer
Yuka C. Honda, Composer
Kae Burke, Fabrics
Jeff Sturdivant, Fabrics
Marcus Swagger - Gamma NYC, Digital Fabrication
Adrian Martinez, Build Lead
Daniel Stewart, Systems Wiring
Alcy Sivyer, Build
Rose McKee, Build
Harrison Lockhart, Build
Thea Rae, Build
Adam R. Brown, Director/Editor (video)
Kyle I. Kelley, Cinematography (video)
BullMoose Pictures, Production (video)
Client: AEG Live
Curated by: META.IS
DELQA is a collaboration with Matthew Dear that seeks to create a living world of music. By combining skills in architecture, acoustics, interaction design, and music, the experience invites visitors to physically explore his composition and participate in its arrangement.
We worked with Matthew directly to transform his composition from a static piece to a dynamic one. The music and sound synthesis is influenced by the presence of the audience in different places inside the structure, reacting as they climb and touch it.
We built a 44-channel spatial audio system that places and moves sounds around the listeners in 3D so that as they explore, their perspective on the sonic environment will also change. Additionally, we designed an immersive and reactive lighting system that is tied to the progression of the music and interactive inputs. In DELQA. there is a blurring distinction between space, music, and light, uniting them into a singular cohesive reality.
Super Rad Team:
Matthew Dear - Music
Yotam Mann - Interactive Music Developer
The Principals - Architecture & Environmental Design
Listen - Creative Development & Production
Charlie Whitney - Media Artist
Phil Sierzega - Design Direction
The ARC is our second large-scale interactive music experience leveraging our experience in light, music, interaction, and physical design. It was developed for Deloitte Digital who came to us with the question “What is the future of music?” as a prompt for their presence at SXSW 2016. By working with their team, lead by Marcus DePaula, we focused the concept for the experience around a collaboration between artist and audience, enabled by a series of unique tactile instruments.
Featuring a constantly evolving composition created by Grammy-nominated artist RAC, the project embodied a new frontier in live performance and recorded music through a living, evolving arrangement. The music was able to be explored and influenced by the participating audience.
The five distinct instruments were designed for both musicians and non-musicians alike, allowing control of both the rhythms and melodies. Each instrument had a multi-dimensional impact on the overall experience, changing qualities in the immersive lighting, sonic textures of the mix, and patterns in the song.
The ring of 20 speakers that surrounded the audience was unified into a spatial field of sound that allowed each part of the arrangement to orbit in independent directions. Certain sounds gently rotated while others energetically bounced from one side of the room to the other.
Beau Burrows - Visual Design and Light Animation
RAC - Music
Yotam Mann - Music Interaction Design and Programming
Marcus Swagger - Digital Fabrication Lead
Aaron Lobdell - Digital Fabrication
Daniel Schaeffer - Light Animation & Tech
Photos & Video: Jeff Osborne
METAMORPHOSIS was an unprecedented one-day art collaboration at the House of Vans in Brooklyn. We partnered with artists Hisham Bharoocha and Santtu Mustonen to create an immersive, large-scale floating tunnel that featured projection mapped visuals.
A custom designed scene was created for each of the eight sets throughout the night. For the first three DJs, the audience was invited to contribute to the animations by playing on four drum pads located in the space. Hitting a drum pad would create unique effects on the visuals unique to each scene. The animations were also reacting to the music from the DJs, creating an interplay between the audience’s own influences via their drumming.
The evening also featured a live percussion and electronics performance by IIII (pronounced 'four’) that took advantage of a newly developed drum trigger built by Sunhouse called Sensory Percussion. The sensor is able to gather information about a drummer’s performance on an acoustic drum in ways not previously possible. Each unique hit, whether a light tap in the center of the drum, a cracking rim shot, or a cross stick could trigger a unique corresponding sound sample and visual animation.
We were responsible the software, hardware, and wiring involved in making the sound reactive visuals, the audience reactive drums, and the projection mapping.
The full line-up of counter-culture musicians and dancers included Brian DeGraw, Venus X, DJ Tameil, MikeQ / Qween Beat, IIII, Tygapaw, Dutch E Germ and Soft Circle.
Hisham Bharoocha (curator, visual artist & direction)
Santtu Mustonen (visual artist & direction)
Marcus Swagger, Gamma NYC (build lead)
Jesse Hlebo & Greg Kalliche (AV production)
Daniel Neumann (sound engineering)
Imprint Projects (production & management)
Commissioned by House of Vans
photos and video by Santtu Mustonen
PROCESS AND BEHIND THE SCENES HERE
We worked with Snarkitecture and Perfection Electricks to deliver this multi-story lighting sculpture at Aventura Mall in Miami. It's made up of 16,100 LEDs within 4,025 frosted spheres inside a large, naturally lit atrium.
We created the real-time animation engine, rendered pre-visualizations in virtual reality leading up to the install, and orchestrated the animations that bring the piece to life.
We built a series of experiences for Smoke Machine, a celebration held on a decommissioned ferry boat at an undisclosed location in New York City. Together with Beau Burrows, we built the following:
• 50-ft dance floor with embedded LEDs that visitors could control via iPad while dancing
• immersive sound puzzle in the style of a Goonies-esque organ
• a breathalyzer chandelier, more booze = more light
• backlighting for a large-scale sculpture with brightness that breathed with the real-time movement of the surrounding water
• incandescent lights that changed bulb brightness to follow visitors' movements up and down staircases
• a second sound puzzle involving the injection of music and morse code into the existing telephone infrastructure throughout the boat
We designed a multi-channel audio system surrounding the audience and spatialized both live and pre-designed sounds in 3D during the show. We also designed a multi-channel projection system to map the show’s video content, including video reproduction on all sides of Cassandra’s giant dress and mapping visual content to various scenic elements throughout the performance.
Using 1200 pounds of clear ice blocks and capacitive sensors, we created an experience that was amazing to touch (ice feels so good), look at (ice looks so good when backlit by LEDs), and listen to (we gave each block its own sonic personality, so when one was touched, it would trigger a unique yell from a highly exuberant funk vocalist).
The piece was in collaboration with Emilie Baltz and premiered at PRAVA Festival in Washington DC in February, 2015
Mondrian Moose is an interactive LED dance floor that triggers lasers out of a moose’s eyes. Inspired by Piet Mondrian and created for Absolut Electrik ‘House Party’ in Los Angeles, CA, the floor was installed in a living room and was revealed in stages, sparking the energy of the party. The movements and colors of the lasers and LEDs responded in real time to the live music played by the DJ.
We supported Beau Burrows of Future Wife in the design and installation of the piece.
Beau Burrows, Future Wife (design, programming)
Marcus Swagger, Gamma NYC (build lead)
Tim Otman, Les Soltes, Jacob Walsh (build crew)
Living Room design by Steven M. Caruso of MKG
Commissioned by Absolut + Sid Lee + Meta Agency
In collaboration with Windmill Factory
video by Beau Burrows
photos by Will Watkins
AF595 is a permanent sound and light installation at Antfood Music and Sound in Brooklyn. Installed in the ceiling of a long hallway that connects the entire recording studio, the piece includes 595 floating points of light, each full color and individually addressable. The overall shape of the sculpture is based on the physical acoustics of Antfood’s two main recording spaces.
Animations are controlled via a custom control panel in the hallway, allowing users to dial different scenes and change scenic parameters on the fly. Live sound in the studio can also drive content across the piece.
Designed, built, installed, and programmed by Gabe Liberti, Dave Rife, Zach Dunham, and Kevin Siwoff.
A collaboration with James DeVito and a permanent fixture at Red Bull Studios NY, this 25,000 LED display is custom designed and hand built. The design makes use of a concentric diamond pattern over 12 panels, with 60% openness in each panel, retaining natural daylight and views to the street at the window.
The display is mounted 4" from the glass and creates a reflection of the lights when viewed from the interior, creating a gorgeous visual effect - holographic and ghostly.
The team also wrote custom software to map the array of LEDs, which then enabled Red Bull to load any video content across the entire display.
We were commissioned by BarkBox, Voyce, and MKG to produce a canine-friendly fireworks display for dogs to interact with at BarkFest 2015 in Brooklyn. We designed and built a 9-ft tall animated fireworks sculpture that both lit up AND delivered a dog treat upon command (a bark)
For artist Ashley Zelinskie's opening at Lightbox, Gabe collaborated with her to create an animation that would immerse the viewer in code by placing them in the “brain” of a computer. As the code fills up the room, wrapping the viewer in text, the computer struggles to continue processing the data. Glitches appear creating beautiful digital disasters. The computer finally crashes in a blaze of glitch glory. The source of the data used is from a blank video file.
After discussing the concept with Ashley, Gabe wrote an app that generates a video animation based on a text file containing the source code of the canvas. It can output to any resolution (in this case, the size of Lightbox's projection mapped room was used, 5150x800 pixels). The parametric app allowed for an iterative design process to dial in the right typeface, spacing, and pace of the animation.
MODULAR uses movement to drive generative visuals and choreograph sound spatially through space. The visuals, 3D sound, and choreography are in constant dialog in real time throughout the piece - the digital and natural become intertwined, yielding an experience that is at once abstract and familiar.
The stems from the musical composition were mapped to spatial trajectories in the room in real time, according to the dancer’s behavior, the particle system, or the musical content itself. The result is an immersive, dynamic sonic experience based on user input.
CORNERS is a series of short film installations created by Emilie Baltz and Electric Yolk Media for the BASF 2015 Creator Space Tour in New York City. The project reveals how food catalyzes innovation in habitat, citizenship and resilience in everyday spaces. Through a series of local interviews in Red Hook, East Harlem and downtown Manhattan, the unique characters and recipes that inspire a connected future of urban living in the New York City area are brought to life through our most fundamental form of human connection: food.
We provided audiovisual design, including projection mapping and multichannel wireless headphone distribution.
Fabrication by South Side Design & Building
Dppler Reactor is a 360’ interactive installation that plays with our perception of volume. Utilizilizing projection mapping techniques and motion tracking to react to the environment with up to 12 active users ‘transforming’ the skin of the sculpture with an almost infinite number of combinations. The project includes a multichannel array of vibration transducers which allow the sculpture itself to produce full 360 sound. Installed at F5 Festival 2015.
A debate show for contemporary consumption, this Lincoln-Douglas style verbal sparring match sat at the intersection of ridicule and reason, focusing on current issues, as disputed by two thought leaders debating while being force-fed extreme amounts of food. It was performed in front of a studio audience and live streamed as part of StorefrontTV in New York City.
Serving up critical commentary on the overconsumption of sensationalized politics in modern-day American society, this show functioned as a mash-up of Middle Age disputations, 18th century debating societies and competition style reality-shows. The look and feel of the show was Willy Wonka meets Crossfire, using fantastic foodstuffs alongside expressive imagery in order to create an overlay of absurdity unto the intellectual debate at hand.
In collaboration with Emilie Baltz
In a nod to Times Square of old, The Lambs Club hosted a series of ephemeral installations and performances hidden in Times Square’s unique venues. We performed with Helga Davis and Adam Klipple, manipulating and spatializing Helga's voice in real time over a series of 8 loudspeakers surrounding the audience.
If A Tree Falls is an interactive video and generative sound installation centered on movement of the body. Video content is displayed only in the mirror image of those in the room in real time, inviting participants to explore the video canvas with their own and others’ movements and gestures. A surreal, self-generating soundscape compliments the video component.
The piece was created in response to a brief to ‘celebrate memory, dreams, synchronicity, interconnectivity among strangers, and the alchemy through which the ordinary becomes extraordinary.’ The work was displayed in an abandoned row house on Governor’s Island as part of the 2014 FIGMENT Art Festival.
MicroBiophony is a 5-channel generative composition based on bacteria found in Grand Central Terminal in NYC. As part of Science Saturday at Rockefeller University, we created a custom loudspeaker for each bacteria and composed music based on the data so kids could learn about and listen to the bacteria and their relative concentrations in the subway.
Silent Lights is a public sound and light installation beneath the Brooklyn Queens Expressway in Brooklyn, NY -- a project led by Urban Matter Inc. in partnership with the NYC DOT. The installation features gates along a pedestrian path that react to the ambient sounds of the street by generating ethereal patterns of light. We provided the hardware and software involved in capturing the soundscape, and co-commissioned the piece alongside creative technologist Brett Burton.
Streetscape Symphony is an interactive sound installation exploring simultaneous soundscapes of disparate parts of New York City. Installed at the Garis & Hahn Gallery as part of the New Museum’s IDEAS CITY Festival in May 2013, the work uses geotagged, binaural audio recordings captured by the artists over an entire day from each of the five boroughs. Visitors' position in the space affected the mix of the soundscapes over a 5 channel audio system throughout the gallery. A binaural station was also setup for visitors to make A-B comparisons of the sounds between boroughs over headphones.
Sun Speak is an interactive light and sound installation, installed at the 2014 DUMBO Arts Festival in New York City in collaboration with Kevin Siwoff.
Upon entering the exhibition, visitors saw a pulsing column of light bridging the balcony and ground floor near the center of the room. Its colors and intensity were driven by microphones located inside the tube at each end.
Visitors were invited to sing, speak, or yell into either end of the tube to create new light patterns traveling from one end to the other.
Because the ends were on different floors of the space, it was typical that strangers were creating light patterns across the piece by whistling, speaking, or singing to one another.