Intent: research. In 2011, Microsoft Research demonstrated a prototype that seemed like science fiction: a wearable projector and depth camera system that turned any surface into a touchscreen.
Your palm became a phone dial pad. A nearby wall became a document viewer. A table became a collaborative workspace.
The OmniTouch project never became a commercial product, but its ideas continue to influence how we think about interactive displays—especially in exhibit design, where the boundaries between “screen” and “environment” increasingly blur.
What OmniTouch Actually Did
The prototype combined three technologies:
Short-Throw Projection
A small projector mounted on the user’s shoulder could display images on surfaces within arm’s reach. Unlike traditional projectors requiring flat screens at fixed distances, short-throw projection works on irregular surfaces close to the source.
Depth Sensing
A depth camera (similar to Microsoft’s Kinect sensor) tracked the three-dimensional shape of surfaces and the user’s fingers. This allowed the system to detect touch even on surfaces that couldn’t sense pressure or capacitance.
Real-Time Processing
Software combined depth data with projection output to:
- Warp images to fit irregular surfaces
- Detect finger touches on any surface
- Track multi-finger gestures
The result: multitouch interaction on books, walls, hands, desks—anything within the projection cone.
Why It Matters for Exhibit Design
OmniTouch as a product failed for predictable reasons: the wearable hardware was bulky, the projection was limited by ambient light, and the system required calibration for each surface.
But the conceptual breakthrough remains relevant: interactive surfaces don’t require dedicated hardware at every interaction point.
Projection Mapping in Museums
Modern museum exhibits increasingly use projection mapping to create interactive experiences without installing touchscreens throughout galleries. A projector-camera system can:
- Track visitor gestures in front of a projected display
- Create interactive experiences on architectural surfaces
- Adapt to traffic flow and group dynamics
The trade-off: projection works best in controlled lighting. A sun-drenched atrium is a challenging environment; a windowless gallery is ideal.
Depth Sensing at Scale
The depth cameras that powered OmniTouch evolved into commodity hardware. Microsoft’s Azure Kinect, Intel’s RealSense, and similar sensors enable:
- Touchless gesture control (important post-pandemic)
- People counting and flow analytics
- Distance-aware content scaling
An exhibit might detect when visitors approach and automatically enlarge text or begin audio narration—no touch required.
Blending Physical and Digital
OmniTouch’s vision of computing “everywhere” connects to current trends in blended physical-digital experiences:
- Interactive tabletops where physical objects trigger digital responses
- Augmented displays where printed materials come alive when viewed through screens
- Gesture zones where body position triggers environmental changes
Current Commercial Applications
Several technologies descended from OmniTouch-era research now appear in commercial products:
Interactive Projectors
Short-throw projectors with built-in touch detection can transform any flat surface into an interactive whiteboard. These are common in education settings.
Advantages: No dedicated screen needed; works on existing walls Limitations: Requires low ambient light; resolution limited by projection distance
Gesture-Controlled Kiosks
Post-COVID interest in touchless interfaces accelerated adoption of gesture recognition. Users navigate by pointing, waving, or hovering rather than touching glass.
Advantages: Hygienic; novel experience Limitations: Higher error rates than touch; learning curve for users
Object-Recognition Tables
Surfaces that detect placed objects—recognizing product packages, game pieces, or tangible tokens—enable interactions impossible with standard touchscreens.
Advantages: Powerful for retail, museums, and games Limitations: Requires object tagging or shape libraries; expensive
Considerations for Your Project
If you’re exploring alternatives to traditional touchscreens, ask:
What’s the ambient light environment?
Projection-based solutions struggle in bright environments. Assess lighting at different times of day before committing.
What’s the maintenance tolerance?
Projector lamps require replacement. Depth cameras need periodic calibration. Traditional touchscreens typically require less ongoing maintenance.
What’s the user expectation?
Visitors familiar with smartphones expect touch to “just work.” Alternative interaction methods—gesture, voice, object recognition—require clearer affordances and feedback.
What’s the fallback?
Technology failures happen. If your projection system fails, is there a graceful degradation? Can visitors still access core content?
The Future Trajectory
OmniTouch represented one branch of a research tree that continues to grow:
- Ultrasonic haptics creating touchable sensations in mid-air
- AR glasses overlaying interfaces on any surface
- AI-powered scene understanding that recognizes context and user intent
For most practical installations today, traditional touchscreens remain the reliable choice. But for experiences where differentiation matters—flagship museums, experiential retail, brand activations—the OmniTouch vision of “touch anywhere” increasingly becomes achievable.
Conclusion
OmniTouch failed as a product but succeeded as a proof of concept. Its core insight—that interaction should adapt to environments rather than requiring purpose-built hardware everywhere—continues to shape exhibit design.
When evaluating touchscreen alternatives, consider:
- Is the added complexity worth the experience gain?
- Does your environment support the technology’s requirements?
- Can you maintain the system long-term?
- What happens when it fails?
The best interaction technology is often invisible technology—systems that work so naturally users forget they’re using technology at all.
For guidance on traditional touchscreen display solutions and when to consider alternatives, see our comprehensive guide.
Best Touchscreen provides independent analysis. We have no affiliation with Microsoft Research or any specific display vendor.