top of page

Experience Pixel Labs (EXP Labs)

UX Designer & Developer

Rice University

Houston, TX

Screen shot of Unity play mode that shows ArUco marker checkerboard with data of each marker being shown on the relative location and a list of options on the left side that comes with the ArUco marker package on OpenCV

ArUco marker board calibration

Context

A multiplayer VR environment requiring real-time interaction between physical and virtual objects.

Problem

Users experienced low interaction accuracy and confusion due to misalignment between physical and virtual inputs.

Screen shot of Unity play mode that shows a VR scene with virtual hands being tracked through Meta Quest cameras and projected onto the scene

Hand and gesture tracking applied in test scene

Screen shot of example Unity scene that is a creepy hospital room with doors that lead outside to a creepy woman that looks like a zombie

Example Unity scene to implement ArUco markers and hand gestures to

What I Did

- Designed and developed real-time object tracking using ArUco markers
- Built interaction models aligning physical and virtual behavior
- Prototyped and tested interaction flows in VR
- Iterated to improve usability and responsiveness

Impact

Increased interaction accuracy and reduced user error, resulting in smoother and more intuitive VR experiences.

bottom of page