What happens when the room itself becomes the interface?
This immersive theater is designed to convince your brain that solid ground is optional.
Using real-time projection mapping, spatial audio, synchronized motion cues, and depth-warped visuals, the environment surrounds you completely. No headsets. No screens. Just space that moves with you.
Walls, floors, and ceilings transform together, creating the sensation of shifting terrain, floating reference points, or underwater worlds. When the visuals imply motion like tilting, falling, or forward momentum, the brain responds instinctively.
Even though your body is still, your perception is not. That moment of hesitation or reaching out is the proof.
By blending real-time rendering engines with AR-style environmental cues, this approach creates a shared metaverse experience that feels physical, social, and surprisingly real.
This is not watching the future of immersive media.
It is standing inside it.
Video credits: wealth
#ImmersiveExperience#Metaverse#SpatialComputing#ProjectionMapping#FutureOfEntertainment#XR#Innovation
Designing for spatial interfaces feels like being handed a blank room and told, “Make it make sense.” AR, XR, VR (whatever acronym you want) forces you to rethink everything. But here’s the twist:
The oldest principles in design are still the most useful.
When I work on AR interfaces at Polyform Studio, I don’t start with sci-fi metaphors or gestural fireworks.
I start with the same tool every designer learned in their first year:
The grid.
Why?
Because when you’re working in 3D space, you need structure more than ever.
Your UI elements aren’t just “on screen.”
They’re floating, scaling, fading, orbiting.
Without invisible order, it’s chaos.
Here’s how I apply traditional layout to spatial design:
Create an anchor plane
- Even in 3D, most interactions need a visual home base.
- Build a primary surface to hold your core elements, menus, inputs, feedback.
Apply grid logic to Z-space
- Treat depth like a layout dimension.
- Give UI elements clear visual hierarchy not just left to right, but front to back.
Use rhythm to reduce motion sickness
- Spacing, pacing, balance, those Bauhaus rules you ignored?
- They’re crucial when your interface moves with your head.
The most advanced interfaces aren’t chaotic.
They’re structured.
Gridded.
Timeless.
→ See how we structure emerging interfaces at Polyform .co
What if an interface could adapt to your world in real time?
Imagine your car’s dashboard subtly shifting to shades of green as you drive through a forest, or an app adjusting to your personal accessibility needs without breaking. For the past few months, I've spoken with many of you and I’ve realized we’re all working toward the same ambitious goal: creating interfaces that offer a seamless blend of brand personalization, true adaptability, and accessibility. This is about building an experience that is not only true to a brand's perception but is also tailored to our individual needs as consumers.
My exploration so far has revealed three foundational concepts that I feel are important to make this a reality.
In the upcoming months, I’ll be sharing our journey as we explore these concepts. Some ideas will work, some will fail. I don’t know where this path will lead, but I want to bring you along in the process.
1. Contextual Awareness
This is the idea that an element understands its environment. A button, for example, knows what surface it’s sitting on and adapts accordingly. While tools like Figma use variable collections to simulate this, the approach is often fragile because it lacks a scalable underlying logic. This very challenge was a driving force behind developing the graph engine. I’m excited to share that a solution for this is now possible directly in modern browsers with pure CSS, laying a powerful and scalable foundation for the future.
2. Content Awareness
Imagine an interface that reflects the content it displays. We see a version of this in Spotify’s UI, which adapts to album art to create a more immersive experience. This principle allows the UI to react dynamically, personalizing the experience in real-time based on its content.
3. User Awareness
This pillar brings it all together by focusing on the user’s specific needs. It means designing systems that can respond to a user with Parkinson’s who may need more forgiving interaction areas, or accommodating the universal reality that as we get older, we need larger fonts. The key is to make these adjustments without breaking the interface or compromising the brand experience.
These three pillars form the blueprint for the next generation of user interfaces. By understanding where an element is, what it contains, and who is using it, we can create experiences that feel truly alive.
I think there’s more to discover beyond our current methods. Let's explore what it means to build something truly adaptive, together.
After years of working in VR in education, I think it is time to say the quiet part out loud:
Custom VR learning experiences do not have to be wildly expensive, one-off projects.
When designed properly, they can be scalable and surprisingly affordable.
Many people still think custom VR means building a massive, cinematic simulation from scratch every time. That is one version of custom VR, but it is not the only version.
Another approach is to design around reusable environments, learning outcomes, repeatable practice moments, and assets that can be repurposed across lessons, programs, and departments.
Instead of asking, “How do we build one impressive VR experience?” the better question is:
“How do we build a flexible immersive learning system that creates value over time?”
Custom VR becomes more affordable when we stop treating it like a one-time spectacle and start treating it like instructional infrastructure.
In education, one of VR’s highest-value uses is simulation: repeatable practice in low-stakes situations.
Learners can make decisions, receive feedback, and build confidence before they enter higher-stakes environments.
But people often assume custom VR requires a large team, months of production, and huge costs.
It can be expensive. But it does not have to be.
My low-cost, high-value workflow looks like this:
Step 1: Start with the learning.
Identify the need, outcomes, performance gaps, and decisions learners need to practise. Then build a storyboard before anything is developed.
Step 2: Build the right environment.
Low-code platforms are powerful, but they do not always have the exact space you need. For one client, we needed an Early Childhood Education classroom, so I worked with a Unity developer to create a custom space, that met the needs of my client, could be uploaded into a low-code platform and was a fraction of the cost. Check out the image.
Step 3: Create only the assets that matter.
You will need to populate your space with 3d assets. Some assets can be static. Others need to be interactive because they connect directly to the outcomes. I have used tools like Meshy to create custom 3D assets efficiently and then uploaded them into my low-code software.
Step 4: Build in a low-code or no-code platform.
Once the environment and assets are ready, the experience can often be built in platforms like ENGAGE or Zoe Immersive. Scene-building and interaction design become easier when the instructional design is already mapped out.
This process is not "rocket science" nor is it unaffordable.
The goal is meaningful practice, not the flashiest VR experience.
Reach out to me if you are interested in scaling Immersive learning that is easy and affordable.
💎 Scientists Reviewed 201 Studies on #VR. Here’s What They Found:
This refers to the publication The Impact of Virtual Reality on Employee Training and Learning in Organisations, published in 2025. It was not a single study conducted on one group of employees, but a systematic review of scientific literature — one of the strongest methods for assessing the current state of knowledge in a field. The authors collected, evaluated, and compared findings from 201 previous studies published between 1998 and 2025 to determine the real impact of VR technology on training, employee learning, and organisational development.
The study was prepared by Sofia Azevedo Carvalho, Ema Simões Conceição, and Isabel C. P. Marques from the University of Lisbon, Portugal. Their goal was to organise fragmented knowledge and answer an important question: is VR just a passing trend, or a real tool for capability development?
What did they examine?
➡︎where VR works best
➡︎which skills it develops
➡︎what barriers exist to implementation
➡︎whether it genuinely supports business goals
The conclusions are highly specific. #VirtualReality significantly improves learning effectiveness because it enables people to learn through experience, simulation, and practice instead of theory alone. Employees absorb knowledge faster, remember procedures better, and can repeatedly practise difficult situations without the risk of mistakes in real environments.
The authors also point out that VR develops more than technical skills. It strongly supports decision-making under pressure, communication, teamwork, leadership, as well as empathy and emotional intelligence. This is especially relevant today, as many technical tasks are increasingly handled by automation and AI, while human advantage shifts toward social and interpersonal capabilities.
The greatest benefits appear where traditional training is expensive, risky, or logistically difficult. That is why VR performs particularly well in healthcare, aviation, manufacturing, transport, safety, and crisis management. Companies can train people faster, more safely, and to a consistent standard — regardless of location.
But there are also barriers:
- employee resistance to new technology
- the need for strong instructional design
- the risk of rapid technological obsolescence
The researchers also emphasise something VR implementation experts have known for years: buying headsets alone is not enough. Success depends on the quality of training scenarios, employees’ readiness to use the technology, and a meaningful connection between VR initiatives and business objectives.
The conclusion is simple: VR is a stable, scientifically validated method and a strategic tool for developing people and organisations.
If you see an area in your company where VR could genuinely accelerate training, improve safety, or increase operational effectiveness — let’s talk!
In XR, a bad user experience can break immersion in seconds. 👀"
Let’s be honest. When you’re in an immersive XR experience, everything needs to feel natural. The second something feels off whether it’s awkward controls, confusing navigation, or a glitchy interface the magic is gone. 💨
That’s why UX design is critical in XR. It’s not just about making things look good it’s about making them feel right. When you’re designing for XR, you’re not just dealing with flat screens anymore. You’re designing entire worlds that users need to move through, interact with, and believe in.
But here’s the catch:
If the experience isn’t seamless, users get frustrated and disengage quickly. And once they’re out of the experience? It’s hard to pull them back in.
Why is UX so important in XR?
1. Immersion is fragile
In XR, you’re trying to create a sense of presence that feeling where users forget they’re wearing a headset or holding a device. But one clunky interaction or poorly designed interface can snap them out of that immersion instantly. Imagine trying to pick up an object in VR, but your hand glitches through it… frustrating, right?
↳ That’s why intuitive interactions are key.
2. Users need intuitive controls
In traditional apps, users click buttons or swipe screens. In XR? They might be using hand gestures, voice commands, or even eye-tracking! If these interactions don’t feel natural or intuitive, users will struggle—and that breaks the experience.
Think about it: Would you want to wave your hands around awkwardly just to open a menu? 🤔
3. Comfort and safety matter
Ever heard of VR motion sickness? It happens when there’s a disconnect between what users see and how their body feels. Poor UX design can make this worse with jerky movements or disorienting transitions. A well-designed experience should feel smooth and comfortable no nausea required! 🤢
4. Accessibility for all users
Great UX also means making sure everyone can enjoy the experience, regardless of their abilities. This means designing for accessibility—whether that’s adding subtitles for audio cues or ensuring interactions are simple enough for non-tech-savvy users to navigate easily.
What can you do to improve UX in XR?
Test early and often: Don’t wait until the final stages to test your design! Get real users into your XR environment as soon as possible and collect feedback on what works and what doesn’t.
Focus on natural interactions: Mimic real-world actions as much as possible (e.g., grabbing objects with hand gestures). The more intuitive it feels, the better.
Prioritize comfort: Ensure smooth transitions between scenes and avoid sudden movements that could cause discomfort. (alot of games published in meta horizon store lacks this basic thing)
Make it accessible: Think about how different users will interact with your experience whether they have disabilities or are new to XR technology.
What broke the immersion for you?
Share your thoughts below! 👇
🤝 The 4 things most Enterprise XR vendors got wrong, and what years of deployments taught us.
Yes, creating a high-quality VR module is genuinely hard.
3–6 months of SME input, iteration, QA. (Our platform VRseBuilder speeds this up but the underlying difficulty is real.)
But this isn’t why most XR projects got stuck.
The real failures happened after the content was built.
Here are the four lessons the XR industry consistently got wrong:
1️⃣ XR didn’t fail because of content.
It failed because vendors never solved device + account + network readiness.
Enterprises don’t want “a VR module.”
They want a working device on their network with their users and their content, without chasing 10 internal teams.
My Customer Success team listed few blockers:
🔹 Meta account provisioning
🔹 App Lab access
🔹 Domain whitelisting
🔹 Wi-Fi certs
🔹 Security approvals
🔹 LMS mapping
🔹 On-site support expectations
2️⃣ Enterprises don’t just need content. They need visibility, control, and standardisation.
Training teams ask simple operational questions:
🔸 Which plant has completed which module?
🔸 How many devices are active?
🔸 Who is stuck?
🔸 Are all locations running the same version?
This is why we built Pulse — a single dashboard for
users → devices → content → analytics → policy.
JSW and UltraTech scaled not because one module worked, but because they finally had system-level visibility across thousands of trainees.
3️⃣ XR fails when IT is involved late. IT is the gatekeeper, not an afterthought.
Identity, network rules, security, data flow, compliance, if VR doesn’t fit into these systems, deployment simply stops.
This is why we built capabilities around policy templates, on-prem support, secure data pipelines, and clear IT-readiness documentation.
Once IT has clarity, deployment moves. When they don’t, nothing moves.
4️⃣ Content delivers training. Deployment delivers scale.
Most XR vendors treated projects as “one module.”
Enterprises actually need:
🟢 Versioning
🟢 Updates pushed org-wide
🟢 Localization
🟢 SOP-aligned content updates
🟢 Recurring analytics reviews
🟢 A predictable rollout process for future modules
This is how my team expanded from one module to dozens within few months of pilots with all our major customers.
#enterpriseXR#virtualreality#mixedreality#immersivelearning
Weekend Research Deep Dive #07 — Multimodal AI in XR Interaction
Continuing the weekend series where I break down one high-value research area for builders, educators, and XR/AI practitioners.
This week’s theme:
How multimodal AI (vision, speech, gesture, gaze) is reshaping interaction design in XR — and why interfaces are becoming systems, not screens.
🔹 This week’s reads:
• “Multimodal Foundation Models for Embodied and Extended Reality”
Liu et al., 2024
https://lnkd.in/gSNeQiDP
Shows how multimodal models integrate vision, language, and action to enable context-aware XR interactions.
Key insight: interaction quality improves when AI reasons across modalities instead of handling them separately.
• “Gaze, Gesture, and Language: Designing Multimodal Interaction for XR”
Oviatt & Cohen, 2023
https://lnkd.in/gr4ywpCW
Demonstrates that combining gaze and speech reduces cognitive load in immersive tasks.
Key signal: multimodality works best when inputs are complementary, not redundant.
• “Towards Multimodal AI Agents in Virtual and Augmented Reality”
Zhang et al., 2025
https://lnkd.in/g_jS222Q
Explores AI agents that interpret user intent across voice, gesture, and environment.
Highlights design challenges around timing, ambiguity, and trust in XR agents.
🔹 Why it’s worth your coffee:
• XR interfaces are shifting from menu-driven to intent-driven systems
• Multimodal AI enables more natural, low-friction interaction in immersive spaces
• Educators can reduce cognitive load while increasing engagement and retention
• Builders gain new design primitives beyond controllers and UI panels
🔹 3 takeaways for practitioners:
• Design multimodality intentionally — more inputs ≠ better UX
• Use gaze and context for implicit signals, not constant control
• Treat AI agents as interaction partners, not just input processors
🔹 Bonus context:
• “Ten Myths of Multimodal Interaction”
Oviatt, 1999
Still relevant: successful multimodal systems reduce effort, not add complexity.
Question for the community:
If you had to prioritize one modality for future XR systems, which would you build around first — voice, gaze, gesture, or context-aware AI — and why?
#XR#AI#HCI#EdTech#ImmersiveLearning#SpatialComputing#Research
I document my XR + AI work, projects, publications, and evolving insights here — updated as the ecosystem evolves → https://lnkd.in/g8UT8g7r