WEEK - 6
AUGMENTED & VIRTUAL REALITY
Lecture by –
Dr. Natarajan P. (10560)
SCOPE
TABLE OF CONTENTS
01 05
Innovative HMDs VR for Modern World
New headsets offer better
immersion with lighter builds and
sharper visuals
02 04 Used in education, defense,
healthcare, and gaming.
VR Research Outcomes VR Headset Models
Studies show VR boosts training, Includes tethered, standalone, and
simulation, and user engagement. hybrid devices.
03
Eye Tracking in VR
Tracks gaze for smarter rendering
and interactive control.
01
Innovative HMDs
1. Evolution & Innovations
2. Key Innovations in HMDs
3. Applications of HMDs
4. Challenges & Limitations
5. Future trends & Potentials
Evolution & Innovations
The modern era of HMDs took off in the early 2010s with
Technology evolution devices like Oculus Rift, HTC Vive, and PlayStation VR,
powered by advances in motion tracking, displays, and
Head-mounted displays (HMDs) revolutionize digital computing.
interaction by offering immersive experiences across
sectors like gaming, healthcare, military training,
industry, and VR environments.
A major leap was the adoption of six degrees of freedom
(6DoF) tracking, enabling full user movement and
significantly enhancing immersion and realism.
Key Innovations in HMDs Technology : Displays
OLED & Micro-LED Retina-Resolution
Displays Displays
High-density displays
Provide better contrast,
offer near human-eye
richer colors, and
clarity, as seen in
smoother visuals than
devices like the Varjo
LCDs.
XR-3.
Foveated
Rendering
Renders high detail only
where users look,
cutting processing load
while keeping quality.
Key Innovations in HMDs Technology : Optics
Pancake Lenses Wide Field Of View
These replace traditional
Fresnel lenses, reducing device
Companies like Pimax have
thickness
developed HMDs
and improving clarity. Devices
with FoVs exceeding 200
like the Pico 4 use this
degrees, creating more
technology for enhanced
immersive experiences.
comfort and visual
performance.
Key Innovations in HMDs Technology : Tacking & I/P Systems
Inside-Out
Eye Tracking
Tracking
Modern HMDs, such as the The integration of eye-
Oculus Quest 2, use onboard tracking technology
cameras and sensors to enables intuitive
track the user’s position interactions and more
without the need for external immersive
hardware.. experiences.
Haptic Feedbacks
Some HMDs incorporate
haptic systems to
provide tactile
feedback, enhancing
user engagement.
Key Innovations in HMDs Technology
Wireless Connectivity
• The transition from tethered to wireless HMDs has been transformative.
• Technologies such as Wi-Fi and dedicated 60 GHz wireless adapters enable
high-bandwidth, low-latency streaming, eliminating the need for cumbersome
cables.
Key Innovations in HMDs Technology
Lightweight & Ergonomic Design
• Innovations in materials and engineering have made HMDs lighter and more
comfortable.
• Companies such as Magic Leap and Nreal emphasize ergonomics to ensure
prolonged use without discomfort.
Applications of Innovative HMDs : Gaming
Multiplayer VR Platforms
Platforms like Rec Room and VRChat
enable users to socialise, collaborate,
and compete in immersive 3D spaces.
Cinematic VR Experiences
VR technology allows filmmakers and
content creators to immerse users in
action-driven narratives.
Theme Parks
Void VR combines physical
environments with virtual experiences,
enabling users to touch and interact
with digital elements.
Applications of Innovative HMDs : Healthcare
Surgical Training
Osso VR and Touch Surgery provide
immersive simulations, allowing
surgeons to practise complex
Therapeutic Applications procedures in a risk-free
environment.
VR-based treatments are used in
exposure therapy to address
conditions such as post-traumatic
stress disorder (PTSD) and phobias. Physical Rehabilitation
Gamified VR exercises using HMDs
help patients regain motor functions
through interactive training sessions.
Applications of Innovative HMDs : Military & Defence
Integrated Visual Augmentation System (IVAS)
The US Army's IVAS, based on Microsoft HoloLens,
overlays augmented reality (AR) data onto soldiers' field
of view.
Training Simulations
VR-based military simulations replicate
combat scenarios, allowing soldiers to
develop tactical skills in safe, controlled
environments. These
simulations cover diverse conditions, from
urban warfare to Arctic operations.
Applications of Innovative HMDs : Industrial Applications
Design & Prototyping
Engineers and designers use VR to visualise 3D models,
assess ergonomics, and simulate product performance,
reducing development time and costs.
Maintenance & Repairs
AR-enabled HMDs overlay instructions
and diagnostics onto equipment,
reducing errors and downtime for
technicians.
Virtual Classroms
Students can explore historical events, conduct scientific
experiments, and visit distant locations without leaving
their classrooms.
Applications of Innovative HMDs
Education & Training
Simulated Training
Fields such as aviation, medicine, and engineering benefit from
hands-on training experiences that are otherwise costly or
hazardous in real-life
scenarios.
Applications of Innovative HMDs : Remote Work & Collab
Virtual Meeting Platforms
Spatial and Meta's Horizon Workrooms
enable teams to collaborate in shared virtual
environments, complete with 3D representations of
documents, models, and tools.
Enhanced Productivity
These solutions bridge the gap
between remote and in-person
collaboration, fostering creativity
and efficiency.
Challenges & Limitations
Cost
Privacy
Concerns
Motion Sickness
Battery Life
Limited Content
Future Trends & Potentials
Personalized AI
5G & Edge Mixed Reality Integration
experiences
AI gaze tracking Enables low-latency, AR+VR merge for Enables dynamic
predicts intent; ML high-bandwidth design, assistance, content and real-
improves interaction. VR/AR streaming. storytelling (e.g., Vision time analytics.
Pro, Quest Pro).
02
VR Research Outcomes
1. Constructing the VR environment
2. Challenges in developing environments
3. Leveraging VR Environments for Research
4. Biosensor integration in VR Research
5. Challenges in Analysing Data
6. Implications for Research in VR
7. Best Practices for multimodal VR Research
Constructing the VR environment
3d Development Platforms 3D Virtual vs 360 degreesVideo
• Unity (C# language) 1 2 • 3D Virtual Worlds: Interactive, computer-
• Unreal Engine (C++) generated environments for spatial tasks.
• Industry Platforms: Rabbit is Requires 3Dmodeling.
commonly used for architectural
visualization, while Prepared3D is • 360-Degree Video: Immersive but non-
tailored for military training interactive videos for
simulations. 3 observation/storytelling. Requires
specialized cameras and post-production.
Monoscopic VR vs Stereoscopic VR
• Monoscopic VR: Same image to both
eyes; flat depth.
• Stereoscopic VR: Different image to
each eye; realistic depth.
Challenges in Developing VR
Hardware Performance User Interface
Compatibility Optimization Design
Motion Content Creation Ethical
Sickness Expertise Considerations
Leveraging VR Environments for Research
• Focus: VR research aims to understand human interactions within virtual
environments.
• Data Collection: Researchers use game telemetry (event-based or continuous)
to quantify user interactions, movement, and engagement.
• Insights: Telemetry provides insights into user experiences, preferences, and
psychological responses.
• Advanced Methods: Data analysis is enriched by integrating telemetry with
biosensors (like eye tracking and EEG) to better understand human behavior
and cognition in VR.
BioSensor Integration in VR
Facial
Voice Analysis EEG Systems Motion Sensors Expression
Measures Enhances
gaze/focus; used Assesses stress & Analyzes stress and
emotional/psychological understanding of
in design and motion sickness non-
states. emotional and social
simulations. invasively.
responses
BioSensor Integration in VR
Eye Tracking Heart Rate Respiration EDA Sensors
Measures Assesses stress & Sensors
gaze/focus; used emotional/psychological Analyzes stress and Assesses psychological
in design and states. motion sickness non- arousal and emotional
simulations. invasively. engagement.
Challenges in Analysing VR Data
Aggregating diverse data
Each VR experience is unique.
Aligning data by assigning
participant-specific tasks or
Real-time synchronization focusing on shared areas of
interest can help mitigate
variability.
Ensuring that biosensor data aligns
precisely with virtual events is
essential for accurate interpretations.
Transitioning from 3D to 2D
Eye-tracking data analysis
often requires converting 3D
gaze points into 2D
representations, complicating
spatial analysis.
Implications for Research in VR
Psychology & Healthcare &
Neuroscience Rehabilitation
Human
Education &
Computer
Training
Interaction
Implications for Research in VR
Social Environmental
Sciences & Spatial
Sciences
Marketing &
Creative Arts &
Consumer
Media
Behaviour
Key Innovations in HMDs Technology
Wireless Connectivity
• The transition from tethered to wireless HMDs has been transformative.
• Technologies such as Wi-Fi and dedicated 60 GHz wireless adapters enable
high-bandwidth, low-latency streaming, eliminating the need for cumbersome
cables.
03
Eye Tracking in VR
1. How Eye Tracking works
2. Key metrics in Eye
Tracking
3. Applications
4. Advantages
5. Challenges
6. Future Directions
How does it work
Infrared Based Electrooculography Computer Vision
Tracking (EOG) Board
Uses IR light to track Electrodes measure electrical Algorithms analyze camera
reflections from the potential from eye movement. video feeds. Cost-effective
cornea/retina. Highly Resistant to occlusions (e.g., and scalable (mobile/low-cost
accurate, fast, and most glasses), but lower spatial VR), but requires significant
common commercially. accuracy. Used in computational power.
medical/research.
Key Metrics
Pupil Dilation Gaze Direction Fixation Points
Changes in pupil size The primary metric for VR applications, it Eyes remain stationary; reveals
indicate cognitive load, helps identify the user's attention, visual focus, and
stress, emotional responses, area of focus within the virtual scanning behavior.
and engagement. environment.
Saccades Blink Rates
Rapid, jerky movements between Frequency of blinks
fixations; reveals scanning patterns indicates fatigue,
and information processing. arousal, or stress.
Applications of Eye Tracking in VR: Gaming & Entertainment
Foveated Gaze-based
Rendering Controls
Emotional Social
Engagement Interaction
Applications of Eye Tracking in VR: Training Simulation
Surgeons can be assessed based on Eye tracking monitors how trainees Eye tracking can evaluate how
their eye focus during complex focus on critical elements trainees maintain eye contact
procedures in VR training in their environment. and engage with virtual characters,
simulations.
Medical Training Military & Aviation Soft Skill Training
Advantages of Eye Tracking
Enhanced Performance Behavioural Real-Time
Immersion Optimization Insights Personalization
Limitations
Accuracy & Precision
Latency
Occlusion & Variability
Ethical & Privacy Reasons
04
VR Headset Models
Meta Quest 3, Meta Quest 2, PlayStation VR, Pico 4
Meta Quest 3 The Meta Quest 3 is an entry-level VR
headset that balances performance and
affordability. Designed as a standalone
device, the Meta Quest 3 eliminates the
need for external hardware, such as
gaming PCs or consoles, making it an
accessible choice for beginners.
Features
DISPLAY PERFROMANCE DESIGN
RGB LCDs, 1832 Qualcomm Snapdragon Slightly bulkier with Fresnel
* 1920 pixels per XR 2 Gen 2 processor lenses but remains
eye. and 8 GB of RAM comfortable for extended use
KEY FEATURES PRICE
Full color Mixed $299 for 120 GB or
Reality with pass- $399 for 256 GB
through cameras. version.
PROS
Standalone
Affordable
Functionality
Mixed Comfort-Oriented
High-Performance
Reality Design
Hardware
Features
CONS
Bulkier Limited Content
Design Ecosystem
No PVCR Battery
Compatibility Life
Meta Quest 2
The Meta Quest 2 remains a popular
choice for those on a budget. Despite
being slightly
older, it competes well with newer models
in terms of performance and affordability.
Features
PRICE DISPLAYS PERFORMANCE
Typically, $299, offering LCD, 1832 * 1920 Qualcomm Snapdragon
good value. pixels per eye, $90 XR 2 processor and 6
Hz refresh rate. GB of RAM
ADAPTIBILITY DESIGN CONTROLLER
Functions as both Lightweight, comfortable, Intuitive Touch Controllers
standalone and PC-tethered and includes a glass spacer with tracking and haptic
(Oculus Link) headset. for eyewear. feedback.
PROS
Dual Extensive
Functionality Content Library
Lightweight User-Friendly
Regular Setup
Design Software
Updates
CONS
Facebook Account Limited Storage
requirement Options
Average
Mid-Tier
Battery Life
Performance
Play Station VR
For console gamers, the PlayStation VR
offers an affordable entry point into the
world of VR. Compatible with both the
PlayStation 4 and PlayStation 5, it is an
attractive option for Sony fans.
Features
PRICE DISPLAY TRACKING
Affordable, priced ED display, 960 * 1080 pixels Uses PlayStation Camera
below $250. per eye (lower resolution but and Move controllers for
deep blacks). outside-in tracking.
GAME LIBRARY DESIGN
Vast library of exclusive VR Comfortable Halo strap design,
titles integrated with the minimizing facial pressure.
PlayStation ecosystem.
PROS
Affordable for Vast Game
Console Gamers Library
Ergonomic Design Exclusive Vibrant OLED
Titles Display
CONS
Facebook Account Limited Storage
requirement Options
Average
Mid-Tier
Battery Life
Performance
Pico 4
Pico 4 has gained popularity as an
affordable alternative to Meta’s VR
headsets. Developed by Pico Interactive, it
caters to both casual and advanced users
seeking high-quality VR experiences.
PROS
Affordable pricing High Resolution
Display
Ergonomic Design Future-Proof
Standalone
Performance
Capability
CONS
Limited Ecosystem
The Pico Store has fewer titles compared to
Meta and PlayStation platforms, limiting
content availability.
Shorter Battery Life
While adequate for most sessions,
the battery life may be insufficient for
users who wish to engage in lengthy
VR experiences.
Less Brand Recognition
Pico is less established than
Meta, meaning it may lack the
same level of trust and
customer support.
05
VR for Modern World
VR in Education & Training
Enhanced engagement & interactivity
Cost-effectiveness
Expanding accessibility with VR
Fostering Creativity through VR
Challenges & Limitations
Apple Vision Pro: The Latest
Academic Use
Allows students (e.g., medical) to perform virtual
procedures in risk-free environments.
VR IN EDUCATION & TRAINING
Professional Training
Improves employee skills and decision-making by simulating
real-life, complex, or high-stress scenarios without real-world
risk.
Market Branding
Increases brand recall and loyalty by creating memorable
customer experiences (e.g., Coca-Cola, Audi).
Enhanced Engagement &
Interactivity
Communication
Facilitates the communication of complex ideas in an engaging
and memorable way, shifting users from passive consumption to
active participation.
• Leads to substantial long-term savings despite initial
investment.
• Reduces costs in education (eliminates labs/field trips)
and real estate (cuts travel/staging).
Cost Effectiveness of VR
Technology
• Improves operational efficiency by enabling remote
training and collaboration, cutting travel expenses.
Removes physical, financial, and geographical
barriers to experiences (e.g., virtual museums,
activities for individuals with disabilities).
Expanding Accessibility
Crucial for bridging gaps between global,
remote teams, enhancing productivity
regardless of location.
Market Branding
Increases brand recall and loyalty by creating memorable
customer experiences (e.g., Coca-Cola, Audi).
Fostering Creativity through
VR
Communication
Facilitates the communication of complex ideas in an engaging
and memorable way, shifting users from passive consumption to
active participation.
Challenges
Health Concerns &
Safety
Technical Limited training &
Limitations of Interoperability
VR
Ethical &
Privacy
Issues in VR
Apple Vision Pro:
The Latest Technology
A cutting-edge spatial computing device blending physical
and digital worlds; features a sleek, futuristic design using
glass, aluminum, and fabric. Includes an external display to
show the user's eyes (Eyesight).
Features
Display Spatial Computing Performance
Boasts the most advanced Introduces a spatial
display system in an HMD, Dual-chip architecture,
computing paradigm powered by the M2 and
featuring dual 4K Micro OLED where users interact with
displays (over 23 million R1 chips, ensuring
apps using natural input, smooth performance
pixels total) and adaptive eliminating traditional
optics for prescription with minimal latency.
controllers.
glasses.
ECOSYSTEM & SOFTWARE
Runs on visionOS, Apple's first OS for spatial
computing. Integrates seamlessly with Apple's
ecosystem (Macs, iPhones), allowing users to access
familiar apps and a dedicated App Store.
.
MEDIA & COMMUNICATION
Elevates media with immersive capabilities, including
a virtual 100-foot screen for 3D content, and
integrated spatial audio.
Transforms communication using realistic 3D avatars
for FaceTime
THANKS
CREDITS: This presentation template was
Slidesgo
created by Slidesgo, including icons by
Flaticon Freepik
Flaticon, infographics & images by Freepik