See discussions, stats, and author profiles for this publication at: [Link]

net/publication/378385270

3D Learning Experience Using Augmented Reality

Conference Paper · November 2023

DOI: 10.1109/IC-RVITM60032.2023.10435321

CITATION READS

1 93

4 authors, including:

Sindhu Manjunath
BMS College of Engineering
9 PUBLICATIONS 13 CITATIONS

SEE PROFILE

All content following this page was uploaded by Sindhu Manjunath on 26 June 2024.

The user has requested enhancement of the downloaded file.

2023 International Conference on the Confluence of Advancements in Robotics, Vision and Interdisciplinary Technology Management (IC-RVITM) | 979-8-3503-0608-8/23/$31.00 ©2023 IEEE | DOI: 10.1109/IC-RVITM60032.2023.10435321

3D LEARNING EXPERIENCE USING AUGMENTED

REALITY

Rajath K Rohith R Kashyap Roopesh Reddy C

Information Science and Engineering Information Science and Engineering Information Science and Engineering
BMS College of Engineering BMS College of Engineering BMS College of Engineering
Bengaluru, India Bengaluru, India Bengaluru, India
[Link]@[Link] rohith.kash01@[Link] roopeshreddy24@[Link]

Sindhu K
Information Science and Engineering
BMS College of Engineering
Bengaluru, India
[Link]@[Link]

Abstract: Technology-driven learning can significantly enhance AR also facilitates greater accessibility to educational
the learning effectiveness for students of all ages, including those content. With AR, students can access learning materials
with learning disabilities. The extensive utilization of from anywhere and at any time, enabling personalized and
multimedia elements, such as graphics, audio, and video, has self-paced learning. This adaptability is especially
demonstrated considerable improvements and increased advantageous for students with learning difficulties or
enthusiasm among learners. Augmented Reality serves as a link disabilities, as it caters to individual needs and preferences.
between theoretical and practical knowledge, enabling users to
experience a blend of computer-generated virtual environments An additional advantage of AR in education is its ability to
and real-world scenarios. create interactive virtual labs for STEM subjects. These
This project aims to create a mobile application featuring
virtual labs allow students to conduct experiments and
different subsections, such as the solar system, human anatomy, explore scientific concepts in a controlled environment,
and the skeletal framework. Utilizing AR technology, students eliminating the need for expensive equipment and
can visualize these sections as 3D models. The application minimizing potential risks. As a result, students can engage
provides an immersive learning experience by allowing students with complex topics that might otherwise be challenging to
to view objects as if they were real. Moreover, audio cues access.
accompany the models, enhancing the interest and enjoyment in
Moreover, AR can be employed to develop educational
learning. The development process involves using software like
games designed to teach specific subjects or skills. These
Unity and Vuforia, along with C# scripting in Unity to bring the
objects to life. The application employs the mobile phone's
interactive games make learning enjoyable and fun,
camera to scan material and generate 3D models of the desired motivating students to actively participate and learn.
section for learning. In conclusion, AR has the potential to revolutionize education
The primary target audience for this application is students, by offering engaging, interactive, and accessible learning
with a particular focus on those with learning disabilities. The experiences. Its ability to overlay digital information onto the
development process drew upon multiple references and real world creates immersive and captivating educational
research papers, which demonstrate its positive impact on opportunities, enhancing understanding and knowledge
students' learning curve. retention for all students. As a result, AR can significantly
enhance the quality of education across the board.
Keywords : Augmented Reality, Mobile Application, Unity3D,
Mobile AR Experience, Vuforia, 3D Visualization, Educational
App, Human Skeleton System, Solar System Simulation.

I. INTRODUCTION II. OBJECTIVE

Augmented reality (AR) is an innovative technology that The main objective of this study is to create and evaluate a
enhances a user's perception of the real world by mobile application that utilizes Augmented Reality (AR)
superimposing digital information onto it. Its potential to technology to improve the learning experience for students,
transform education lies in providing students with with a particular focus on those with learning disabilities. The
immersive and interactive learning experiences. paper aims to demonstrate the effectiveness of marker less
AR techniques, unified subject integration, audio cues, and
One major benefit of AR in education is its capacity to elevate
user interactivity in enhancing learning outcomes, student
engagement and interactivity in the learning process. By
engagement, and motivation. The research centers on
overlaying digital information onto the real world, students
can interact with virtual objects and simulations, creating a assessing the impact of the developed application, which
more realistic and captivating learning environment. This includes modules such as a 3D human skeletal model, a 3D
increased engagement can boost motivation and improve solar system model, and a 3D atomic model. The goal is to
students' comprehension and retention of the subject matter. evaluate how these modules help students visualize and

Authorized licensed use limited to: BMS College of Engineering. Downloaded on March 28,2024 at 09:48:13 UTC from IEEE Xplore. Restrictions apply.
comprehend complex subjects, ultimately enhancing their AR-based tools and techniques for CAD, including marker-
understanding and retention of the material. The research also based and marker less AR systems. It addresses challenges
includes a comparison of the developed application with related to accuracy, system calibration, and user interaction,
existing approaches, highlighting its unique contributions and concluding that AR integration in CAD can enhance design
advancements in providing an immersive and interactive processes, collaboration, and efficiency, though further
learning experience. research is needed to optimize its practical use.
M. E. Kouzi et al. [6] present an educational AR application
designed for elementary school students, with a focus on the
III. LITERATURE SURVEY human skeletal system. They aim to enhance students'
The paper by Yunqiang, Chen et al. [1] provides an insightful learning experience and engagement through AR technology.
overview of augmented reality (AR) technology, defining it The application overlays digital 3D models of the human
as the overlaying of virtual objects onto the real world to skeleton onto real-world objects using markers and a mobile
enhance user perception and interaction. The authors cover device's camera, allowing students to interact with the
key components and techniques, such as tracking, display models, rotate them, and access additional information. The
devices, and user interfaces, while also addressing challenges paper's findings support the use of AR as an effective
like real-time performance and occlusion handling. They educational tool for teaching complex subjects like anatomy
explore various application domains of AR, including to young learners.
entertainment, education, healthcare, and industry, making
the paper a valuable resource for understanding the Yulianti et al. [7] focus on the use of AR in Natural Science
fundamentals, challenges, and applications of AR education, specifically teaching topics related to the human
technology. framework. The study explores the effectiveness of AR as a
media tool in enhancing students' learning experience and
Patil, Sanket et al. [2] focus on the application of AR in understanding of human framework concepts. The authors
anatomy education, highlighting its potential benefits, such develop and implement an AR-based media application
as enhanced visualization, interactivity, and engagement. providing interactive 3D models and textual information on
They discuss different AR-based tools and applications the human framework. The findings suggest that AR
developed for anatomy learning, like interactive 3D models enhances students' engagement, motivation, and
and virtual dissection. The paper emphasizes the positive comprehension of the subject matter, emphasizing its
impact of AR on student learning outcomes and its potential potential in improving Natural Science education and
to revolutionize anatomical education. It also emphasizes the creating immersive and interactive learning environments.
need for further research and development to optimize the use
of AR in anatomy education. Septi Irwansyah et al. [8] explore the use of AR technology
to enhance the learning experience of molecular
Kurniawan, Michael H. et al. [3] explore the utilization of AR hybridization concepts. They describe the development of an
in mobile applications for learning human anatomy, AR-based media application specifically designed for
emphasizing its potential to enhance the understanding and learning molecular hybridization concepts. The application
visualization of anatomical structures. The paper focuses on overlays digital 3D models and textual information onto real-
the development of a mobile application with AR features for world objects through markers and a mobile device's camera.
interactive learning experiences. It highlights the benefits of The study evaluates the effectiveness of the AR-based media
AR in anatomy education, such as improved engagement, application through a user study, with results indicating a
spatial understanding, and accessibility. positive impact on students' understanding and retention of
molecular hybridization concepts compared to traditional
Hafiz et al. [4] investigate the use of mobile AR applications
methods.
to improve the learning experience of human anatomy and the
nervous system. The paper discusses the limitations of Guler et al. [9] focus on the application of AR in anatomy
traditional teaching methods and the potential of AR education, specifically learning the skeletal system. The
technology in overcoming these challenges. It describes the paper discusses the benefits of using AR technology to
development of a mobile AR application enabling users to enhance the learning experience by providing interactive and
interact with virtual 3D models of anatomical structures and immersive content. It describes the process of designing an
the nervous system. The application provides a dynamic and AR application for learning the skeletal system, involving the
immersive learning environment, allowing students to overlay of digital 3D models and textual information onto
visualize and manipulate anatomical structures in real-time. real-world objects. The paper emphasizes the potential of AR
The paper emphasizes the benefits of using mobile AR in in anatomy education and highlights its role in improving
anatomy education, including enhanced spatial student engagement and understanding of complex
understanding, improved engagement, and personalized anatomical concepts.
learning experiences. Additionally, the paper addresses
challenges and considerations in developing such Abdinejad et al. [10] explore student perceptions regarding
applications, including content creation, usability, and device the use of AR and 3D visualization technologies in chemistry
compatibility. education. The study investigates how these technologies
impact students' understanding, engagement, and overall
Tumkor et al. [5] focus on the integration of AR technology learning experience in chemistry. The authors develop an
into the computer-aided design (CAD) process, exploring AR-based application allowing students to visualize chemical
potential benefits and challenges. The authors discuss how structures and reactions in three dimensions. The findings
AR allows designers to visualize digital 3D models in real- indicate that students have positive perceptions of AR and 3D
world environments, leading to better spatial understanding visualization technologies, reporting increased motivation,
and improved design evaluation. The paper examines various

Authorized licensed use limited to: BMS College of Engineering. Downloaded on March 28,2024 at 09:48:13 UTC from IEEE Xplore. Restrictions apply.
enhanced comprehension of complex concepts, and improved home scene, is designed by creating a canvas and adding user
spatial understanding. interface components, such as buttons and text. Within the
Kuçuk S et al. [11] investigate the effects of learning anatomy home scene, three buttons represent separate modules that
through mobile AR on achievement and cognitive load. The users can engage with. When a specific button is clicked, the
study explores how AR technology impacts students' corresponding module is loaded, enabling users to interact
academic performance and cognitive load during anatomy with the rendered scenes for educational purposes.
learning. The findings suggest that learning through mobile Additionally, the application includes a Quit button that
AR leads to improved achievement and reduced cognitive allows users to exit the application. We explore the
load compared to traditional learning methods, supporting its transformative impact of Augmented Reality (AR) on
potential as an effective educational tool for anatomy student learning within the context of our mobile
learning. application. By seamlessly integrating digital content into
the real-world environment, our AR models of the solar
Nincarean et al. [12] explore the potential of mobile AR
technology in education, discussing its unique features and system, human skeleton, atomic structure, and periodic table
capabilities, such as portability, real-time interaction, and facilitate a hands-on and visually immersive learning
overlaying digital content onto the real world. The paper experience. The application allows students to visualize
examines various educational applications of mobile AR, complex concepts, promoting a deeper understanding of
including language learning, science education, history, and abstract subjects.
art. It highlights the benefits of mobile AR in promoting Through interactive and personalized learning paths, AR
active learning, enhancing student engagement, and adapts to individual student needs, enhancing engagement
improving knowledge retention, while also addressing and motivation. Our research highlights the practical
challenges and limitations, such as technological application of theoretical knowledge, demonstrating the
requirements and potential distractions. potential of AR to bridge the gap between theory and real-
Macariu et al. [13] focus on the use of AR technology in world scenarios. Additionally, the collaborative aspects of
chemistry education, exploring potential benefits like AR foster teamwork and communication skills among
enhanced student engagement, interactive visualizations of students.
chemical structures and reactions, and hands-on learning
experiences. The paper discusses various AR-based tools and
applications for chemistry education, emphasizing their
effectiveness in improving students' understanding and
retention of complex chemical concepts, while also
acknowledging the need for further research to explore long-
term effects and address technical challenges.
Salazar et al. [14] explore the use of AR technology to
enhance the learning experience of the solar system. The
study discusses the development of an AR application
enabling users to interact with virtual 3D models of planets
and celestial objects. The research highlights the benefits of
using AR for solar system education, such as improved
understanding, increased engagement, and the ability to
visualize complex concepts.
In comparison to existing works in the field of AR-based Fig. 1. Proposed Architecture
educational applications, our project aims to address several
limitations to provide a more comprehensive and effective Fig. 2. represents the flow of the 3D Atomic Model. To create
learning experience. While many previous AR applications the 3D Atomic Model and Periodic Table of Elements, Unity
have shown promising results, they often faced the following was utilized as the development platform. The process
limitations: Marker-Based Techniques, Limited Subject involved importing the Vuforia engine package into the
Integration, Lack of Interactivity, Lack of audio cues, Chemistry scene, and then importing the UniGLTF v1.27
Platform Dependencies. package to bring in the atomic models of elements in GLTF
Proposed project addresses these limitations by adopting format. Within the scene, a canvas was created to
marker less techniques, allowing for a more practical and accommodate five buttons positioned below the periodic
versatile user experience. Furthermore, we have incorporated table.
all the subjects within a unified application, providing a
cohesive and seamless experience for users.

IV. IMPLEMENTATION

Fig. 1. represents the system architecture of the proposed

work. The AR SmartEd application is developed using
Unity3D and incorporates various packages and assets,
including the Vuforia engine, UniGLTF v1.27, models,
textures, and materials. The initial scene, referred to as the

Fig. 2. Flow of 3D Atomic structure

Authorized licensed use limited to: BMS College of Engineering. Downloaded on March 28,2024 at 09:48:13 UTC from IEEE Xplore. Restrictions apply.
 UniGLTF v1.27 package to import the GLTF skeleton model.
Each of the five elements (Hydrogen, Helium, Carbon, Labels were then added to all the bones of the skeleton for
Nitrogen, and Oxygen) was added as a 3D model within the identification. A canvas was created to include buttons for the
Chemistry scene. To ensure proper functionality, a C# skull, rib cage, and limbs within the scene. Another canvas
script was attached to the buttons, enabling the was set up with a panel, text, and a 3D model to display bone-
corresponding scenes with 3D models to be displayed upon related information when a button is clicked. To provide
clicking the respective button. This allowed users to additional information, audio clips containing details about
interact with the atomic models and explore their structures the bones were generated using an online AI tool. These
in an immersive and educational manner. audio sources and the canvas with information were attached
as onClick functionality to the buttons. Finally, C# scripts
were written to ensure the proper functioning of all these
functionalities within the scene.

V. RESULTS
We were able to build an AR based application which is an
enhancement of the existing applications. The existing
applications don't have audio cues, all the modules grouped
together or marker less based. All these considerations were
considered while building the application. The AR SmartEd
application has 3 different modules grouped together:
Human Skeleton System, Atomic Model, and Solar System.
The application has also audio cues which respond on touch.
Fig. 5 represents the home scene of our project, serving as the
Fig. 3. Flow of 3D Solar System application's initial page. It showcases buttons for three
interactive modules, allowing users to engage with each of
Fig. 3. represents the flow of the 3D Solar System. The them. Additionally, there is a button to exit the application.
implementation of the 3D model of the Solar System in Unity
involved several steps. First, the Vuforia engine package was
imported into the Solar System scene, followed by importing
the UniGLTF v1.27 package to bring in the 3D models of all
the planets in GLTF format. After importing the models, a
scene was created where all the planets were positioned to
form the Solar System. A canvas with text elements was
added to provide labels for each planet within the Solar
System. C# scripts were written for each planet to enable
them to rotate around the sun and rotate themselves at
appropriate speeds. To provide information about each
planet, a canvas with a drop-down menu containing a list of
planet names was created. C# scripts were implemented to
display relevant information when a specific planet is
selected from the drop-down menu. Additionally, audio clips
with information about each planet were generated using an
online AI tool, and these audio sources were attached to the
corresponding planet names in the drop-down list.

Fig. 5. Homepage of the Application

Fig. 6. represents a visually captivating 3D representation of

the solar system. It offers detailed information about the sun
and enables users to explore specific planets by selecting
them from a dropdown menu. Furthermore, the module
includes audio narration to enhance students' learning
experience.

Fig. 4. Flow of 3D Skeletal

Fig. 4. represents the flow of the 3D Skeletal System. The

implementation of the 3D Skeleton model in Unity involved
several steps. Initially, the Vuforia engine package was
imported intolicensed
Authorized the Skeleton
use limitedscene,
to: BMSfollowed by importing
College of Engineering. the on March 28,2024 at 09:48:13 UTC from IEEE Xplore.
Downloaded Restrictions apply.
 Fig. 8. AR Periodic Table

Fig. 9. represents a real-time 3D representation of the skeletal

system. It features labeled bones, and users can access
information about each bone and listen to audio descriptions
by clicking on three provided buttons.

Fig. 6. AR Solar System

Fig. 7. represents a 3D atomic model specifically focused on

carbon. This model provides a visual depiction of the
element's protons, neutrons, and electrons. Users can also
access atomic models of other elements by clicking on
corresponding buttons.
Fig. 9. AR Human Skeletal System

VI. CONCLUSION

Augmented Reality (AR) has emerged as a powerful

educational tool with its capacity to visualize real-time
objects in 3D. Its applications in medical, science, CAD
education, and research are evident, offering interactive and
immersive experiences that foster better understanding of
complex subjects, improved information retention, and the
development of problem-solving skills. AR's potential to
enhance accessibility for students with disabilities or
language barriers and encourage creativity and innovation
further underscores its value in education. However, the
successful integration of AR requires thoughtful planning.
Considerations include the cost and availability of AR
technology, teacher training, and ongoing support. While the
benefits of AR are evident, its effectiveness in education
hinges on its seamless integration into the learning
environment.
It is vital to acknowledge potential drawbacks as well. Over-
Fig. 7. AR Atomic Model reliance on screens may diminish hands-on learning and
critical thinking. Additionally, concerns about privacy,
Fig. 8. represents a dynamic 3D view of the periodic table. security, and unequal access to technology among students
from diverse socioeconomic backgrounds warrant careful
Users can interact with this table by rotating it 360 degrees,
attention.
allowing for a comprehensive exploration of the elements
and their properties. In conclusion, augmented reality (AR) holds immense
promise for elevating student learning and engagement. Our
application facilitates captivating learning experiences in
anatomy, complex chemical reactions, and structures. As AR
continues to evolve, its role in education is likely to expand
in the years ahead. Teachers can enhance student learning
by gaining a basic understanding of AR's potential and its
application within our app. Additionally, teachers can
participate in workshops, seminars, and other educational
events focused on AR, enhancing their expertise in using
our application effectively and contributing to the
improvement
Authorized licensed use limited to: BMS College of Engineering. Downloaded on of09:48:13
March 28,2024 at students'
UTClearning
from IEEEabilities.
Xplore. Restrictions apply.
 REFERENCES

[1] Yunqiang Chen et al 2019 J. Phys.: Conf. Ser. 1237 potential for education." Procedia-social and
022082 behavioral sciences 103 (2013): 657-664.
[2] Sanket Patil , Anup Rao , Neeraj Pardeshi , Mahesh [13] Macariu, Camelia, Adrian Iftene, and Daniela Gîfu.
Gavhane, Dr. Dattatray Waghole, 2021, "Learn chemistry with augmented reality." Procedia
Augmented Reality in Anatomy,International Computer Science 176 (2020): 2133-2142.
Journal of Engineering Research and Technology [14] Salazar, José Luis Herrera, Renzo Pacheco-Quispe,
(IJERT) Volume 10, Issue 04 (April 2021), Juan Donayre Cabeza, Miriam Janeth Herrera
[3] Michael H Kurniawan, Suharjito, Diana, Gunawan Salazar, and Johny Pretell Cruzado. "Augmented
Witjaksono, Human Anatomy Learning Systems reality for solar system learning." In 2020 IEEE
Using Augmented Reality on Mobile ANDESCON, pp. 1-4. IEEE, 2020.
Application,Procedia Computer Science,Volume
135,2018,ISSN 1877-
0509,[Link]
[4] Hafiz, Rubaiya & Hasan, Jahidul & Hakim, Md.
(2020). Enhancement of Human Anatomy and
Nervous System Learning using Mobile Augmented
Reality Application. International Journal of
Engineering and Advanced Technology. 9. 2461-
2466. 10.35940/ijeat.C5916.029320.
[5] Tumkor, Serdar & Aziz, Elsayed & Esche, Sven &
Chassapis, C.. (2013). Integration of Augmented
Reality into the CAD Process. 10.18260/1-2--
19798.
[6] M. E. Kouzi, A. Mao and D. Zambrano, "An
Educational Augmented Reality Application for
Elementary School Students Focusing on the
Human Skeletal System," 2019 IEEE Conference on
Virtual Reality and 3D User Interfaces (VR), 2019,
pp. 1594-1599, doi: 10.1109/VR.2019.8798058.
[7] Yulianti, Y & Wardhani, L & Hakim, Renaldy &
Aji, S & nur hudha, Muhammad. (2021).
Augmented Reality (AR) subject Natural Science
media for human framework topics. IOP Conference
Series: Materials Science and Engineering. 1098.
032032. 10.1088/1757-899X/1098/3/032032.
[8] Septi Irwansyah, Ferli & Asyiah, Efa & Ch, Ida.
(2019). Augmented Reality-based Media on
Molecular Hybridization Concepts Learning.
Tadris: Jurnal Keguruan dan Ilmu Tarbiyah. 4. 227-
236. 10.24042/tadris.v4i2.5239.
[9] Güler, Osman & Yucedag, Ibrahim. (2019).
Augmented Reality in Anatomy Education and
Designing an Augmented Reality Application for
Learning Skeleton System.
[10] Abdinejad, M., Talaie, B., Qorbani, H.S. et al.
Student Perceptions Using Augmented Reality and
3D Visualization Technologies in Chemistry
Education. J Sci Educ Technol 30, 87–96 (2021).
[Link]
[11] Küçük S, Kapakin S, Göktaş Y. Learning anatomy
via mobile augmented reality: Effects on
achievement and cognitive load. Anat Sci Educ.
2016 Oct;9(5):411-21. doi: 10.1002/ase.1603. Epub
2016 Mar 7. PMID: 26950521
[12] Nincarean, Danakorn, Mohamad Bilal Alia, Noor
Dayana Abdul Halim, and Mohd Hishamuddin
Abdul Rahman. "Mobile augmented reality: The

Authorized licensed use limited to: BMS College of Engineering. Downloaded on March 28,2024 at 09:48:13 UTC from IEEE Xplore. Restrictions apply.

View publication stats