An Interactive Pavillion

Type: Misc 

In Collaboration With: Ruslan Antonenko & Mertcan Büyüksandalyacı 


2016 | TX, USA


Phonoscope is an interface between performance, performer and observer which extracts data from performance and the observer, combines them and emphasizes the output as spatial and ambient transformations. This experience was developed with the aim of merging physical and digital grounds of the pavilion with various displays of inputs and outputs.


Different animated shapes were assigned to ambient and rhythmic sounds to form a DJ interface within the VR worlds. These shapes active in response to the collision with the HTC VIVE controllers in the user’s hands.


The generated music feeds the Processing code for analysis of beat and pith detection, while the output of this analysis supplies variables for both Unity and Resolume in real time to manipulate VR and projection mapping into the milled surface. Within the same code, Kinect was used capture hand gestures and execute the ripple effect in both physical and digital world experience.