Overview

This project aimed to recreate the illusion of a hologram while incorporating interactivity through a Kinect camera. Created in collaboration with Josh Baptista, this interactive hologram demonstrates our skills in combining cutting-edge technology with creative design to produce engaging visual experiences.

Technical Components

• TouchDesigner for software integration and visual programming
• Xbox Kinect camera for motion tracking
• Custom-made scrim using mosquito netting and PVC pipe frame
• Ultra-short throw projector for upward projection

Interactive Features

The system interprets user interactions through a bird's-eye view Kinect camera. Left and right movements are calibrated by arm placement, while up and down movements are calculated using the infrared depth sensor. This setup allows for precise tracking of hand positions, which are then mapped to corresponding locations in the holographic display.

Visual Effects

1. Sphere Mesh: A complex sphere filled with smaller spheres that users can spin and manipulate.
2. Displacement Pattern: An interactive pattern that dissipates around the user's hand as they touch the scrim.

Technical Challenges and Solutions

One of the main challenges was accurately interpreting the user's hand position and mapping it to the correct location in the scene. This was resolved by using an ultra-short throw projector for upward projection, eliminating side-angle distortions. TouchDesigner was crucial in processing both pixel data from the camera and infrared depth information, ensuring accurate tracking and mapping.

Hologram Illusion

The hologram effect is achieved using a custom-made scrim. The mosquito netting's properties allow viewers to see through it while its highly reflective fibers create the illusion of a floating image. This cost-effective solution produces a convincing holographic effect.

Skills Demonstrated

This project showcases:

1. Creativity in combining physical devices and sensors with digital interactivity
2. Proficiency in working with advanced technologies like TouchDesigner and Kinect
3. Ability to create immersive, responsive visual experiences
4. Problem-solving skills in addressing technical challenges
5. Collaboration in a complex, multifaceted project

Future Implications

This project serves as a stepping stone for future work in interactive design and technology. As technology advances, the techniques and skills demonstrated here will evolve to create even more powerful and engaging interactive experiences.

Visual Documentation

While the project was not deployed for public interaction, video documentation captures key aspects of the hologram's capabilities:

• The see-through effect of the hologram
• Overlay of projections on users
• Visibility of the background when viewed from the same side as the user

These visual elements effectively demonstrate the project's technical achievements and immersive nature, highlighting the successful integration of physical and digital elements in creating a compelling interactive hologram experience.