During the Fall 2016 I had the opportunity to join a research team on campus, and participate in researching and developing virtual reality (VR) and augmented reality (AR) with the Microsoft HoloLens! After having worked with AR at NASA Kennedy Space Center during my internship, I was really excited to start this research project.
While working in research, we have the privilege of developing and improving new technology that hasn’t been widely used yet. Instead of being trained by someone who has worked in the field for most of their career, we have to come up with our own solutions to new problems that are being solved in research labs every day. This has really forced me to think more creatively and intuitively, and improve my problem solving skills.
In this project my focus has been on combining embedded systems with the HoloLens for mixed reality experiences, and developing holographic apps using Unity. So far I’ve been able to establish communication between the HoloLens and an Arduino Uno via bluetooth and the Windows Virtual Shields for Arduino app, which allows me to send commands to the Arduino through the HoloLens, and have the Arduino run the commands in real time! (Ex. use holographic buttons to control an LED light). I’m currently working on developing a full 3D holographic immersion app using Unity that streams footage from a depth camera.