1 Introduction to Virtual Reality and Virtual Environment

MODULE 6
Introduction to Virtual Reality and Virtual Environment

Virtual Reality places the viewer inside a moment or a place, made possible by visual and sound
technology that makes the brain into believing it is somewhere else. It is an experience of a world that
does not exist.

What is Virtual Reality?

Virtual Reality (VR) is a technology that creates a simulated environment, allowing users to feel like
they are in a different place or world. VR puts you inside a computer-generated world that feels real. It
does this by using special equipment that covers your eyes and sometimes your ears called VR Headset.
Virtual Reality creates a believable, interactive 3D environment that you can explore and interact with,
making you feel like you are really there.
The technology feeds in the images of the objects taken at slightly different angles which creates an
impression of depth and solidity. The LCD or OLED panels inside are refracted by lenses completely
fill the field of vision with what is to be displayed and experienced. Together with the technology and
the input tracking, it creates an immersive and exciting believable world that the computer generates.
What we know today as VR, has been existing for decades now. Taking you back to when 360° paintings
took the world by surprise, giving a virtual element.
Types of Virtual Reality (VR)
On the basis of the most important feature of VR i.e. immersion and the types of systems and
interfaces used, The VR systems can be classified into 3 types :
1. Immersive
2. Semi-immersive
3. Non – immersive

1. Immersive VR system
Immersive VR system is closest to the virtual environment. It makes us experience the highest level of
immersion. This VR system is expensive than others. It provides the closest feeling of being in virtual
world. Tools and gadgets used in this system are advanced and not so common to use.

Nayana M Ass. Prof. SVIT

 2 Introduction to Virtual Reality and Virtual Environment

2. Semi – immersive VR system

Semi – immersive VR systems also make us to experience a high level of immersion but the tools and
gadgets used are not so advanced and costly. Tools and gadgets used in this system are common to us
and utilize physical models.

3. Non-immersive VR system
Non-immersive VR system is the least immersive and least immersive VR system. It is not expensive to
use this system. It is also known as desktop VR system because the gadgets used are limited to glasses
and display monitors and it uses the least expensive components.

What are the basic components for VR systems?

1. Input devices
2. Output devices
3. Software

1. Input Devices
Input devices in VR are the tools for the users to interact with virtual world. Using Input devices, the
users communicate with the computer.
Example – 3D mouse.
2. Output devices
Output devices is used to represent the virtual world and it’s effect to the users. It generates the feeling
of immersion to the users.
Example: LCD shutter glasses.
3. Software
Software has a key role in VR. It is used for the handling Input and output devices, data analysis and
generate feedback. Software controls and synchronize the whole environment.
VR is used for many things today, including:
Gaming: Providing immersive game experiences.
Education: Allowing students to explore places like historical sites or the human body.
Training: Helping professionals like pilots and doctors practice their skills.
Virtual Tours: Letting people visit museums or real estate properties from home.

Nayana M Ass. Prof. SVIT

 3 Introduction to Virtual Reality and Virtual Environment

What is Computer Graphics?

Computer Graphics including digital images, animations, and interactive graphics used in various
sectors such as entertainment, education, scientific visualization, and virtual reality. Computer Graphics
can be used in UI design, rendering, geometric objects, animation, and many more. In most areas,
computer graphics is an abbreviation of CG.
Computer Graphics refers to several things
 The manipulation and the representation of the image or the data in a graphical manner. 
 Various technology is required for the creation and manipulation.
 Digital synthesis and its manipulation.

Types of Computer Graphics

 Raster Graphics: In raster, graphics pixels are used for an image to be drawn. It is also known
as a bitmap image in which a sequence of images is into smaller pixels. Basically, a bitmap 
indicates a large number of pixels together.
 Vector Graphics: In vector graphics, mathematical formulae are used to draw different types
of shapes, lines, objects, and so on.

Applications of Computer Graphics

There are many applications of computer graphics discussed below-
 Computer Graphics are used for the aided design of systems engineering and
architectural systems- These are used in electrical automobiles and electro-mechanical, and
electronic devices. For example gears and bolts.
 Computer Art – MS Paint.
 Presentation Graphics – It is used to summarize financial statistical scientific or economic
data. For example- Bar charts systems and line charts.
 Entertainment- It is used in motion pictures, music videos, and television gaming.
 Education and training- It is used to understand the operations of complex systems. It is also
used for specialized systems such as framing for captains, pilots, and so on. 
 Visualization- To study trends and patterns. For example- Analyzing satellite photos of earth. 

Why are Computer Graphics used?

Nayana M Ass. Prof. SVIT

 4 Introduction to Virtual Reality and Virtual Environment

Imagine a car manufacturing company that wants to showcase its vehicle sales over the past decade.
Storing and presenting this huge amount of data can be both time-consuming and memory-intensive.
Furthermore, it can be difficult for the average person to understand. In such cases, by using graphics
can be a more effective solution. By using charts and graphs to visually signify the data, it becomes
much easier to understand and analyses the data.

Interactive computer graphics utilize a two-way communication concept between users and computers.
The computer receives input signals from the user, and the picture is modified accordingly. When a
command is applied, the picture updates promptly.

Overview of Flight Simulation

Flight simulation recreates the experience of flying an aircraft through computer-generated
environments.
Purpose: Used for pilot training, aircraft design testing, and recreational flying.

Types:
 Full Flight Simulators (FFS) with motion systems.
 Fixed-Base Simulators (FBS) with no motion.
 Part-task Simulators for specific tasks (e.g., instrument training).

Components of a Flight Simulator

 Flight Dynamics Model (FDM): Mathematical models that simulate aircraft behavior based on
physical principles of aerodynamics and mechanics.
o Six Degrees of Freedom (6DoF): Three translational (X, Y, Z axes) and three rotational
(pitch, roll, yaw) motions.
o Equations of Motion: Newton’s laws applied to flight dynamics.
 Control Systems: Systems for controlling the aircraft, such as joystick/yoke, pedals, and throttle.
 Navigation and Avionics: Simulating the aircraft’s instruments and navigation systems. 
 Environmental Models: Weather conditions, atmospheric turbulence, and terrain.

Nayana M Ass. Prof. SVIT

 5 Introduction to Virtual Reality and Virtual Environment

Types of Simulations
 Training Simulations: Used for pilot training in both normal and emergency scenarios.
 Engineering Simulations: Used for testing new aircraft designs and systems.
 Flight Testing: Simulations that replicate flight conditions to reduce the need for actual test
flights.

Applications of Flight Simulations

 Pilot Training: Allows pilots to practice flying and respond to emergencies.
 Aircraft Design: Simulates the performance of new aircraft before production.
 Research: Investigating new materials, aerodynamics, and avionics systems.

Modern Advances in Flight Simulation

 Virtual Reality (VR) and Augmented Reality (AR): Enhancing the realism of simulations.
 Artificial Intelligence (AI): Automating some aspects of simulation or creating more adaptive
training environments.
 Distributed Simulations: Connecting multiple simulators for cooperative training (e.g., multi-
aircraft missions).

Why Use a Virtual Environment for ML?

 Isolation: Ensures that the dependencies of different projects do not interfere with each other. 
 Reproducibility: Helps replicate the environment on other machines for consistent results. 
 Dependency Management: Simplifies installing, updating, and uninstalling packages without
affecting the global system.
 Version Control: Different projects may require different versions of libraries, so virtual
environments allow flexibility.

Virtual environment requirement applications

Nayana M Ass. Prof. SVIT

 6 Introduction to Virtual Reality and Virtual Environment

 Used for training pilots in both normal flight operations and emergency procedures.

 Virtual environments allow medical professionals to practice surgeries and procedures without

risk to patients.

 Military personnel use virtual environments for combat training, mission rehearsal, and strategic

planning.

 Virtual environments are used to visualize buildings, structures, and urban developments before

construction begins.

 Virtual environments are used to test and refine vehicle and aircraft designs without physical

prototypes.

 Virtual environments can replicate classrooms, laboratories, or historical sites for enhanced

learning experiences.

 Virtual environments allow customers to explore and shop in virtual stores or try products

virtually.

Benefits of virtual reality

1. Immersive Learning: VR provides an immersive and realistic learning experience, allowing

users to interact with virtual environments and objects as if they were real.

2. Safe Training Environment: VR enables trainees to practice dangerous or high-risk scenarios

in a safe environment, reducing the risk of injury and equipment damage.

3. Repeatable Scenarios: Trainees can repeat VR scenarios as often as needed to refine skills and

build muscle memory, ensuring consistent and thorough training outcomes.

4. Customizable Simulations: VR allows training scenarios to be tailored to specific learning

objectives and challenges, enabling personalized and targeted skill development.

Nayana M Ass. Prof. SVIT

 7 Introduction to Virtual Reality and Virtual Environment

5. Data Collection and Assessment: VR systems can collect detailed performance data, enabling

trainers to assess trainee progress, identify strengths and weaknesses, and adapt training

accordingly.

Disadvantages of Virtual Reality

1. Motion Sickness: Some users may experience motion sickness or discomfort due to the sensory

disconnect between virtual and physical movements, leading to nausea and dizziness.

2. Cost and Accessibility: VR systems can be expensive to develop and maintain, making them

less accessible to organizations with limited budgets. High-quality hardware and software

requirements can also pose barriers to adoption.

3. Ethical Concerns: The immersive nature of VR can desensitize users to violence and blur the

line between reality and simulation, raising ethical concerns about its impact on perception and

behavior.

4. Learning Curve: Some users may struggle with the learning curve associated with using VR

equipment and navigating virtual environments, potentially affecting the efficiency of training

programs.

5. Isolation and Social Disconnect: Prolonged use of VR can lead to isolation from the real world

and reduced face-to-face interaction, potentially impacting social skills and relationships.

Augmented reality
Augmented reality is a new and evolving technology that lets its users experience a world added with
digital content like visual images, graphics, and other information.

What is the purpose of augmented reality?

Nayana M Ass. Prof. SVIT

 8 Introduction to Virtual Reality and Virtual Environment

Augmented reality is already helping creators build experiences that solve problems. It will continue to
grow and find its application in several futuristic technologies, marketing, and business operations.

What is augmented reality (AR)?

 Augmented reality is a new and evolving technology that lets its users experience a world added
with digital content like visual images, graphics, and other information.
 The word augmented is derived from a Latin word meaning “to add.” Essentially, AR enhances the
experience of the real world by adding elements to the existing world.
 The possibilities for using AR are enormous. I, therefore, tripped on some exciting information to find
out the history of AR, present-day usage of AR, and the future of AR.

Taxonomy:

The taxonomy focuses on technology used to provide the virtual or augmented reality as well as the
content presented to the user, including the type of gamification and how it is operated. It also
accommodates a large number of devices and approaches developed throughout the years and for
multiple industries, and provides a way to categorize them in order to clarify communication between
researchers, developers, and educators. Use of the taxonomy is then demonstrated in two case studies-a
virtual reality chemical plant for use in chemical engineering education and an augmented reality dog
for veterinary education.

Augmented reality (AR) is a technology that combines a user's view of the real world with a virtual
scene generated by a computer. It can include sound, touch, and smell. Some features and technologies
of AR include:

 Tracking

Tracking technology is important for AR because it identifies a user's position and maintains a specific
state. Sensors are used to track a user's location, head orientation, and hand position.

Nayana M Ass. Prof. SVIT

 9 Introduction to Virtual Reality and Virtual Environment

 Outlining

Outlining AR uses image recognition to outline shapes and boundaries instead of changing an entire
scene. It's often used to help drivers see road edges in low light and to guide pilots to landing strips.

 AR contact lenses

These wearable devices allow users to see digital information directly in their field of vision.

 AR in business

AR can be used to create unique customer experiences and increase user engagement. For example,
customers can view product variations in their homes, or companies can use AR training programs to
streamline onboarding.

 AR in advertising

AR advertisements are immersive and interesting, making them ideal for advertisers and viewers.

 AR in healthcare

AR can help healthcare professionals and doctors give the best possible care to patients.

Nayana M Ass. Prof. SVIT

10 Introduction to Virtual Reality and Virtual Environment

AR VR
The system augments the real-world Completely immersive virtual
scene environment
In AR User always have a sense of In VR, visual senses are under control of
presence in the real world the system
AR is 25% virtual and 75% real VR is 75% virtual and 25% real
This technology partially immerses the This technology fully immerses the user
user into the action into the action
AR requires upwards of 100 Mbps VR requires at least a 50 Mbps
bandwidth connection
No AR headset is needed. Some VR headset device is needed.
By using VR technology, VR user is
With AR, end-users are still in touch
isolated from the real world and
with the real world while interacting
immerses himself in a completely
with virtual objects nearer to them.
fictional world.
It is used to enhance both real and It is used to enhance fictional reality for
virtual worlds. the gaming world.

Challenges with AR
Hardware Limitations
 Challenge: Current AR hardware, such as headsets, glasses, and smartphones,
often lacks the processing power and battery life needed for prolonged, seamless
AR experiences.
Limited Content Availability
 Challenge: There is currently a limited amount of high-quality, useful content
designed specifically for AR applications.

Nayana M Ass. Prof. SVIT

11 Introduction to Virtual Reality and Virtual Environment

Privacy and Security Concerns

 Challenge: AR devices, especially those with cameras, pose privacy risks by
constantly capturing users' surroundings.

Technical Issues (Tracking, Mapping, and Calibration)

 Challenge: AR relies on accurate tracking of the user's environment to overlay
digital content, but technical limitations in tracking and mapping can lead to an
unstable or inaccurate AR experience.

User Interface (UI) and Interaction Challenges

 Challenge: Designing intuitive and user-friendly interfaces for AR interactions is
complex, as it involves blending the physical and digital worlds.

Cost of Development and Implementation

 Challenge: Developing AR applications and hardware is expensive, making it
challenging for businesses and industries to adopt AR on a large scale.

Social Acceptance and Adoption

 Challenge: AR’s widespread adoption faces hurdles due to concerns about the
social impact of AR devices, especially when used in public.

Cross-Platform Compatibility
 Challenge: Ensuring AR applications work seamlessly across different hardware
platforms and operating systems is difficult.

Nayana M Ass. Prof. SVIT

12 Introduction to Virtual Reality and Virtual Environment

AR systems and functionality

Augmented reality (AR) is a technology that overlays digital information onto the real
world to create an interactive experience. AR systems are made up of sensors,
processors, and displays, and they're designed to meet specific goals like user
interaction, mobility, and sensory stimuli.
Here are some ways AR systems are used:
 Manufacturing
AR can help industrial workers become more integrated with the systems and machines
they work with. For example, AR can replace paper manuals with digital instructions
that are overlaid on the operator's field of view. This can help reduce mental effort,
increase safety, and make machine maintenance more efficient.
 Shopping
AR can help shoppers visualize how an item would look in their home or on their
body. For example, shoppers can use AR to try on sunglasses or see how a sofa would
fit in their space.
 Medical
AR can be used to diagnose pathologies, facilitate blood sampling, and support surgical
interventions. For example, AR can project the exact position of veins for blood
sampling, or visualize the part of the body to be operated on during surgery.
 Artistic expression
AR can be used to create new worlds by fusing physical and digital elements. For
example, artists can use AR to create virtual masks, digital collages, and psychedelic
doodles.

Nayana M Ass. Prof. SVIT

13 Introduction to Virtual Reality and Virtual Environment

Augmented reality methods

Augmented reality (AR) is a technology that combines the real world with virtual
objects or images to create an interactive environment. There are several types of AR,
including:
 Marker-based: Also known as image recognition or recognition-based AR, this
type uses markers to activate an augmented experience. Markers can be paper-
based or physical objects that are easily recognized by cameras.
 Location-based: This type of AR uses GPS.
 Augmented reality on surfaces: Also called World tracking or SLAM.
 Augmented reality on spaces: Also called Spatial Tracking.
AR uses a variety of technologies, including:
 Digital cameras and other optical sensors
 Accelerometers
 GPS
 Gyroscopes
 Solid state compasses
 Radio-frequency identification (RFID)
AR has many applications, including:
 Remote maintenance
 Diagnostics
 Non-destructive testing
 Repairing
 Setup activities
 Shopping and retail
 Gaming simulations

Nayana M Ass. Prof. SVIT

14 Introduction to Virtual Reality and Virtual Environment

Visualization techniques for augmented reality

Here are some effective techniques:
1. Overlay Visualization: This technique superimposes digital content onto the real
world. For example, navigation apps might display arrows on the road, or furniture
apps might show how a piece of furniture looks in your room.
2. Spatial Anchoring: This involves placing virtual objects at specific locations in the
real world so that they remain in place as the user moves. It helps in creating stable
and contextually relevant AR experiences.
3. 3D Models and Animations: Using 3D models and animations can help visualize
complex data or concepts in a more intuitive way. For instance, medical apps might
use 3D models to show anatomy.
4. Contextual Information: AR can provide additional information about real-world
objects. For example, pointing your device at a historical landmark could display
information about its history.
5. Gesture Recognition: Users can interact with AR content through gestures, such as
pinching to zoom in or swiping to navigate. This technique enhances interactivity
and user control.
6. Real-time Data Integration: This involves integrating real-time data with the AR
experience. For instance, displaying real-time statistics or information overlays
during live events or performances.
7. Environmental Interaction: AR can be used to modify or interact with the physical
environment. For example, changing the color of a room's walls virtually or placing
virtual objects in specific locations in a room.
8. Head-up Displays (HUDs): These are used in AR glasses or helmets to project
information directly into the user's field of view, such as navigation instructions or
performance metrics.
9. Hybrid AR: Combining AR with other technologies like Virtual Reality (VR) or
Mixed Reality (MR) to create more immersive and interactive experiences.
10. User-Centric Design: Tailoring the visualization to the user’s needs and
preferences, ensuring that the AR content is relevant, accessible, and enhances the
user's experience.

Nayana M Ass. Prof. SVIT

15 Introduction to Virtual Reality and Virtual Environment

Enhancing interactivity in AR environments

1. Gesture Control: Implement gesture recognition to allow users to interact with AR
elements using hand movements, taps, swipes, or pinches. This makes the
experience more intuitive and hands-on.
2. Voice Commands: Integrate voice recognition to let users control AR elements or
trigger actions through spoken commands. This can be particularly useful in
scenarios where hands-free interaction is beneficial.
3. Haptic Feedback: Use haptic technology to provide tactile responses when
interacting with virtual objects. This adds a physical dimension to the AR
experience, making it feel more real.
4. Interactive 3D Models: Allow users to manipulate and explore 3D models from
different angles, zoom in/out, or rotate them. This is useful in educational apps,
design visualization, and gaming.
5. Multi-user Interaction: Support collaborative AR experiences where multiple users
can interact with the same virtual elements simultaneously. This can enhance social
interaction and teamwork in AR applications.
6. Real-time Data Integration: Allow users to interact with real-time data overlays.
For instance, in a sports AR app, users could interact with live game statistics or
player information.
7. Context-aware Interactions: Design interactions that respond to the user’s context
and environment. For example, a navigation app could provide turn-by-turn
directions based on the user’s real-time location and orientation.
8. Adaptive Content: Tailor AR content based on user behavior and preferences. For
instance, an educational AR app might adapt the difficulty level of tasks based on
the user’s progress.
9. Customizable Interfaces: Provide options for users to customize their AR interface,
such as adjusting the size or position of virtual elements, changing themes, or
selecting different interaction modes.
10. Augmented Feedback: Use visual, auditory, and spatial feedback to reinforce user
actions and provide guidance. For example, highlighting interactive elements or
providing sound cues when an action is successful.

Nayana M Ass. Prof. SVIT

16 Introduction to Virtual Reality and Virtual Environment

Evaluating AR systems
1. Usability
 Ease of Use: Assess how intuitive and user-friendly the AR system is. Are users
able to navigate and interact with the system without confusion?
 Learning Curve: Evaluate how quickly users can learn to use the AR system.
Shorter learning curves are generally preferable.
 Feedback and Help: Check if the system provides adequate feedback and help
options to assist users in understanding and using the system effectively.
2. Performance
 Speed and Responsiveness: Test the system's responsiveness and the speed at
which AR content loads and updates. Delays or lag can significantly impact the
user experience.
 Stability and Reliability: Ensure the system operates consistently without crashes
or significant bugs.
3. Visual and Audio Quality
 Clarity and Accuracy: Evaluate the clarity of the AR content and its accuracy in
overlaying on real-world objects. The virtual content should blend seamlessly with
the real world.
 Audio Integration: If the system includes audio elements, assess the quality and
synchronization of audio with visual content.
4. Interaction and Engagement
 User Interaction: Assess the effectiveness of interaction methods (e.g., gesture
control, voice commands) and how well they integrate with the AR experience.
 Engagement: Measure user engagement and interest. Are users motivated to
interact with and explore the AR content?
5. Contextual Relevance
 Content Relevance: Evaluate how well the AR content matches the user’s
environment and context. Relevant content enhances the overall experience.

Nayana M Ass. Prof. SVIT

17 Introduction to Virtual Reality and Virtual Environment

 Adaptability: Test how well the system adapts to different environments and
scenarios. Can it function effectively in various lighting conditions and physical
spaces?
6. User Experience (UX)
 Comfort and Usability: Assess whether the AR system is comfortable to use over
extended periods and if it minimizes physical strain or discomfort.
 Satisfaction: Collect user feedback on their satisfaction with the AR experience,
including any frustrations or areas for improvement.
7. Technical Specifications
 Hardware Compatibility: Ensure the AR system is compatible with a range of
hardware, including different types of AR devices (e.g., smartphones, AR glasses).
 Software Requirements: Check if the system requires specific software or updates
and whether it runs effectively on various operating systems.
8. Safety and Privacy
 Safety: Evaluate if the AR system incorporates safety features to prevent accidents
or distractions, especially when used in public or complex environments.
 Privacy: Assess how the system handles user data and privacy. Ensure it complies
with relevant data protection regulations.
9. Scalability and Integration
 Scalability: Test how well the AR system scales with increasing amounts of content
or users. Can it handle growth without performance degradation?
 Integration: Evaluate how easily the AR system integrates with other systems or
applications, if applicable.
10. Cost and Value
 Cost-effectiveness: Assess whether the system provides good value for its cost.
Consider both initial costs and any ongoing expenses.
 Return on Investment (ROI): If applicable, measure the system’s ROI by
evaluating its impact on business objectives or user productivity.

Nayana M Ass. Prof. SVIT