Extreme Gradient Boosting for Genome Disorder Prediction
Extreme Gradient Boosting for Genome Disorder Prediction
CERTIFICATE
This is to certify that the project work entitled “VISUAL GEOMETRY GROUP 19
METHOD FOR ALZHEIMER DISEASE CLASSIFICATION” is being submitted for the
partial fulfilment of the requirements for the award of the degree of Master of Technology in
Computer Science and Engineering, at BVC Engineering College, Odalarevu, is a
bonafide work done by D.N.V. Pavan Manikanta(21221D5802) under my guidance during
the academic year 2021-2023 and it has been found suitable for acceptance according to the
requirement of the University.
The results embodied in this thesis have not been submitted to any other University or
Institute for the award of any degree.
External Examiner
ACKNOWLEDGEMENT
We profoundly grateful to express our deep sense of gratitude and respect towards our guide
Dr. MEERASHARIF SHEIK, [Link].,Ph.D Professor of CSE Department, Bonam Venkata
Chalamayya Engineering College(A),Odalarevu, for his excellent guidance right from selection of
the project and his valuable suggestions throughout the project work. His constant encouragement
and support has been the cause of our success, in completing this thesis in the college.
Last but not least, we own all our success to our FAMILY MEMBERS, CLASS MATES
AND TEACHERS from our childhood, whose vision, love, and inspiration made us to reach out
for these glories.
With the increasing complexity and scale of web applications, cybersecurity has become a
critical concern. Web vulnerabilities such as SQL injection, cross-site scripting (XSS), and
CSRF (Cross-Site Request Forgery) pose significant threats to data security and user privacy.
Traditional methods of vulnerability detection often struggle to keep pace with evolving attack
techniques and the dynamic nature of web applications.
This project focuses on leveraging machine learning techniques to enhance web vulnerability
detection. By analyzing patterns in web traffic, input validation, and application behaviour,
machine learning models can effectively identify anomalous activities that may indicate
potential vulnerabilities. The project aims to develop and deploy a scalable solution that
integrates seamlessly into existing web application frameworks.
• Data Collection and Preprocessing: Gathering and preprocessing web traffic data,
including HTTP requests and responses.
• Feature Engineering: Extracting meaningful features from raw data to train machine
learning models.
• Deployment and Integration: Integrating the detection system into web servers.
LIST OF CONTENTS
CONTENTS PAGE NO
CHAPTER - 1 INTRODUCTION ....................................................................................................... 1
5.5Model Diagram............................................................................................................................... 26
CHAPTER - 1
INTRODUCTION
In an age where information serves as the lifeblood of our digital society, the demand
for real-time access to relevant and accurate data has never been more pressing. Conventional
web search engines, while foundational, struggle to keep pace with the lightning-fast evolution
of online content, often resulting in outdated or irrelevant search results. Recognizing this
challenge, we proudly introduce the Real-time Web Search Engine, a cutting-edge solution
poised to redefine the landscape of information retrieval.
At its core, the Real-time Web Search Engine represents a paradigm shift in how we
interact with and consume online information. By leveraging state-of-the-art technologies such
as continuous crawling, dynamic indexing, and adaptive ranking algorithms, this innovative
platform ensures that users receive the most up-to-date and contextually relevant search results
instantaneously.
Unlike traditional search engines that rely on periodic updates and static ranking
algorithms, the Real-time Web Search Engine operates in real-time, constantly scouring the
web for fresh content and dynamically adjusting search rankings based on recency, relevance,
and user engagement metrics. This dynamic approach not only ensures the freshness of search
results but also enhances the overall search experience by delivering personalized and
contextually relevant information tailored to the user's preferences and browsing history.
Moreover, the Real-time Web Search Engine goes beyond mere search functionality,
offering a suite of features designed to empower users in their quest for knowledge and
information. From real-time notifications for trending topics and breaking news to personalized
search experiences and responsive user interfaces, this platform is engineered to meet the
evolving needs and expectations of today's digital-savvy users.
In this paper, we delve into the intricate architecture, functionality, and underlying
principles of the Real-time Web Search Engine, exploring how it leverages cutting-edge
technologies to deliver unparalleled speed, accuracy, and relevance in information retrieval.
We also examine the potential implications and applications of this revolutionary platform
across various domains, from journalism and research to e- commerce and social media.
3. Design Restrictions
Python is a dynamically typed language. This means that you do not need to declare
variable types when writing code content. It uses to duck typing. what is that? Well, it just
means that if it looks like a duck, then it must be a duck. This is easy for programmers in the
coding process, and it will generate runtime errors.
5. Simple
We are not kidding. Python's simplicity is indeed a problem. I don't do Java, I'm more
of a Python person. To me, its syntax is so simple that Java code seems unnecessary.
Fig 1.1 Open Python website to download the python latest version
Now check the latest and correct version of your operating system.
Step-3: You can select the yellow Download Python for Windows3.7.4 button, or you can
scroll download click the download of the corresponding version. Here, we are downloading
the latest version of Python for Window 3.7.4.
Step-4: Scroll down the page until you find the "File" option.
Step5: Here you will see different versions of Python and operating systems.
• To download Windows 32bit Python, you can select the built-in Windows X86 Zip file,
WindowsX86 executable installer or WindowsX86 installer on the Web.
• TodownloadWindows64 bit Python, you can select any option of the three options. Zip File
Embeddable Windows X866, Windows X8664 executable installer or Windows X8664
installer based on the web.
Here you will install the installer based on the Windows X8664 website. Here, the first part of
the Python version was completed. Now we will go in advance the second part when installing
PythonI. Note: You can click on the option of the release of the version to know the changes or
updates made in the version.
Step-3: Click on Install Now After the installation is successful. Click on Close.
With these above three steps on python installation, you have successfully and correctly
installed Python. Now is the time to verify the installation.
Note: The installation process might take a couple of minutes.
Fig 1.9 Type Python -V to check the python is correctly installed or not
Step-4: Let us test whether the python is correctly installed. Type python– V and press Enter.
Step-5: You will get the answer as 3.7.4
Note: If you have any of the earlier versions of Python already installed. You must first uninstall
the earlier version and then install the new one.
Fig 1.10 Click on IDLE (Python3.7 64-bit) and launch the program
Step-5: Name the file and save as type should be Python files.
Click on SAVE. Here I have named the files as Hey World.
• Supervised Learning – This involves learning from a training dataset with labeled
data using classification and regression models. This learning process continues until
the required level of performance is achieved.
• Unsupervised Learning – This involves using unlabelled data and then finding the
underlying structure in the data in order to learn more and more about the data itself
using factor and cluster analysis models.
• Semi-supervised Learning – This involves using unlabelled data like Unsupervised
Learning with a small amount of labeled data. Using labeled data vastly increases the
learning accuracy and is also more cost-effective than Supervised Learning.
• Reinforcement Learning – This involves learning optimal actions through trial and
error. So the next action is decided by learning behaviors that are based on the current
state and that will maximize the reward in the future.
Machine Learning can review large volumes of data and discover specific trends and
patterns that would not be apparent to humans. For instance, for an e-commerce website like
Amazon, it serves to understand the browsing behaviors and purchase histories of its users to
help cater to the right products, deals, and reminders relevant to them. It uses the results to
reveal relevant advertisements to them.
With ML, you don’t need to babysit your project every step of the way. Since it means
giving machines the ability to learn, it lets them make predictions and also improve the
algorithms on their own. A common example of this is anti-virus softwares; they learn to
filter new threats as they are recognized. ML is also good at recognizing spam.
3. Continuous Improvement
Machine Learning algorithms are good at handling data that are multi-dimensional
and multi-variety, and they can do this in dynamic or uncertain environments.
5. Wide Applications
You could be an e-tailer or a healthcare provider and make ML work for you. Where it
does apply, it holds the capability to help deliver a much more personal experience to
customers while also targeting the right customers.
1. Data Acquisition
Machine Learning requires massive data sets to train on, and these should be
inclusive/unbiased, and of good quality. There can also be times where they must wait for
new data to be generated.
ML needs enough time to let the algorithms learn and develop enough to fulfill their
purpose with a considerable amount of accuracy and relevancy. It also needs massive
resources to function. This can mean additional requirements of computer power for you.
3. Interpretation of Results
Another major challenge is the ability to accurately interpret results generated by the
algorithms. You must also carefully choose the algorithms for your purpose.
4. High error-susceptibility
Machine Learning is autonomous but highly susceptible to errors. Suppose you train an
algorithm with data sets small enough to not be inclusive. You end up with biased predictions
coming from a biased training set. This leads to irrelevant advertisements being displayed to
customers. In the case of ML, such blunders can set off a chain of errors that can go
undetected for long periods of time. And when they do get noticed, it takes quite some time to
recognize the source of the issue, and even longer to correct it.
CHAPTER - 2
LITERATURE SURVEY
2.1 Improving security using extensible lightweight static analysis
AUTHOR: D. Evans and D. Larochelle
In modern software systems, security vulnerabilities often stem from common
programming errors such as buffer overflows, format string vulnerabilities, and improper input
validation. These flaws are well-documented and understood within the security community,
yet they continue to appear frequently in production code. This persistence highlights a gap not
in knowledge, but in the practical integration of security analysis into everyday software
development.
The paper introduces an extensible and lightweight static analysis tool designed to
detect a range of such vulnerabilities early in the development lifecycle. Unlike heavyweight
formal verification tools that may require complex setup and deep understanding, this tool
focuses on being developer-friendly—easy to deploy, understand, and customize—making it
more likely to be adopted in real-world projects.
The tool works by analyzing source code without executing it (static analysis) and
identifying patterns or code structures that are commonly associated with security risks. The
extensibility of the tool allows developers to define new checks or adapt it to the specific coding
practices and security policies of their organization.
One of the main advantages of the approach is its ability to catch potential security
issues with minimal overhead, enabling developers to address problems before they become
deeply embedded in the system. The authors demonstrate the effectiveness of the tool through
case studies, showing how it can uncover serious vulnerabilities in widely used software.
This paper introduces Mayhem, a powerful automated system designed to discover exploitable
vulnerabilities in binary executable programs. Unlike traditional tools that might detect
potential flaws without confirming exploitability, Mayhem goes a step further—it generates
working shell-spawning exploits for each vulnerability it finds, ensuring that the reported
bugs are both critical and actionable.
One of the key strengths of Mayhem is its ability to operate directly on raw binary code,
without requiring access to source code or debugging symbols. This makes it highly versatile
and applicable to real-world, closed-source applications. However, analyzing binaries presents
significant challenges, especially in exploring numerous execution paths without
overwhelming system memory and dealing with symbolic memory indices, where memory
addresses used in the program depend on user inputs.
CHAPTER - 3
SYSTEM ANALYSIS
3.1 Existing System
In recent years, deep learning has become a prominent method in the field of machine
learning, known for its ability to learn complex patterns from high-dimensional data through
multi-layer neural networks. Unlike traditional approaches that rely on manual feature
engineering, deep learning models automatically extract useful features, making them highly
effective across various domains.
Several deep learning architectures have been successfully applied in diverse areas:
• Convolutional Neural Networks (CNNs) for image and pattern recognition.
• Recurrent Neural Networks (RNNs) for sequence and time-series data.
• Deep Belief Networks (DBNs) for unsupervised learning tasks.
These models have achieved state-of-the-art performance in applications such as:
• Computer Vision – image classification, object detection.
• Speech Recognition – real-time voice processing.
• Natural Language Processing (NLP) – sentiment analysis, machine translation.
Given these successes, researchers have begun applying deep learning techniques to
vulnerability detection in software and web applications. These models analyze raw code or
network traffic to identify potential security flaws such as buffer overflows, injection attacks,
and memory corruption vulnerabilities.
3.1.1 Drawbacks
• Data Challenges: Training deep learning models requires large, well-labelled datasets,
which are often unavailable or difficult to obtain in the cybersecurity domain.
• Overfitting Risks: Due to the complexity of neural networks, models may overfit the
training data and fail to generalize to new, unseen vulnerabilities.
CHAPTER – 4
REQUIREMENT ANALYSIS
Operating System
A stable and compatible operating system is necessary for seamless execution of development
tools and ML libraries:
• Windows 10/11 (64-bit) – Common development environment for Python and ML.
• Linux (Ubuntu 20.04+, Debian, CentOS, etc.) – Preferred for performance, open-
source tools, and better Python package compatibility.
• macOS (11.0 Big Sur and above) – Supported, though some ML tools may require
additional configuration.
Programming Languages
These libraries must be installed in your Python environment (using pip or conda) for various
functionalities:
Optional Tools
• Docker – Containerize your application for portability.
• Makefile / Bash Scripts – Automate repetitive tasks (training, testing, packaging, etc.).
Summary Checklist
CHAPTER - 5
SOFTWARE DESIGN
In the context of Machine Learning for Web Vulnerability Detection, a DFD can be
used to visualize the flow of data within the system, including how web content is fetched,
indexed, ranked, and presented to users.
Level 0 (Context Diagram)
• External Entities:
o Web Users: Interact with the web application.
o ML Model: Provides vulnerability detection.
• Processes:
o Web Application: Handles data and detection.
• Data Stores:
o Input Data: Stores collected data from web applications.
o Model Output: Stores vulnerability detection results.
Level 1 DFD
Data Collection & Preprocessing:
• Collects and preprocesses web data.
• Stores in Input Data.
Model Training:
• Extracts features and trains the model.
• Stores the trained model in Trained Model.
Vulnerability Detection:
• Uses the trained model to predict vulnerabilities.
• Stores results in Model Output.
Additional Notes:
• Data Flow: Arrows indicating the flow of data between processes, data stores, and
external entities.
• Entities: External entities like web application users and the ML model interact with the
system.
• Data Stores: Represent repositories where data is stored temporarily or permanently.
This structured approach helps visualize how data moves through your system, from initial
data collection to vulnerability detection using machine learning. Adjust the diagram based
on specific components and processes relevant to your project implementation
Actors:
1. Admin
• Manages users, monitors reports, and controls the ML model lifecycle.
2. User
• Analyzes detected vulnerabilities and validates predictions.
3. Web User / Client
• Submits URLs or HTTP request data for scanning.
4. ML Model (System Component)
• Performs training and prediction operations
CHAPTER - 6
IMPLEMENTATION
6.1 Implementation
Machine learning technique is widely used for data analysis to build prediction models.
Machine learning techniques, which are widely used these days, can be divided into three
categories: supervised learning [10], unsupervised learning and reinforcement learning. To
conclude, a supervised learning method can only learn from labelled training data, and on the
contrary, unsupervised learning does not require the access to the label of data. Especially,
reinforcement learning does not have a restriction on using labelled and unlabelled data. This
method is designed to learn from feedback that is retrieved from its interaction with the
environment. After considering the advantages and disadvantages of different types of machine
learning methods, decided to use supervised learning for this research. Supervised learning
algorithms can be used to train a model of class labels distribution, and this model is able to
predict class labels for testing instances. An example of supervised learning algorithms process
flowchart is shown in Figure 1, this whole process is also called classification. This is the
foundation of designed prediction model as well. It is essential to select which classification
method to use for a certain problem.
There is a review on several widely used supervised learning algorithms in [2]. To decide which
classifiers are more suitable for this research, first look into their pros and cons. In paper [2],
the author pointed out that comprehensibility of Decision Tree makes this classifier helpful for
understanding why an instance is assigned to a certain class, and Decision Tree is a suitable
choice when dealing with discrete features. Linear Discriminant Analysis (LDA) and Naive
Bayes are both statistical learning algorithms, which can provide a probability about labelling
an instance. Moreover, in order to meet the requirement of this research, accuracy, tolerance to
noise, the risk of being overfitting [20] and explanation ability are some vital aspects to
consider when selecting classifiers. These models are considered in this research.
Afterward, each token is encoded in the complete binary AST to pre-defined numerical tuples
and finally represent a one-dimensional numerical array of the corresponding function-level
source code. This source code concatenating the assigned numerical tuples from the root node
to leaves in order. It justifies each step-in detail in the following parts, along with examples.
TOKENIZATION
The source code is cleaned by removing its unnecessary elements such as comments,
whitespaces, tabs, newlines, etc. Then, the remaining part is converted into a series of tokens,
where a token is a sequence of characters that can be treated as a unit in the grammar of the
corresponding programming language. This can be achieved by using a laxer developed
explicitly for the language of the source code.
regression of SVM is expressed as follows. Set the sample set as (y1,x1),….(yl, xl), x £
Rn, y £ R and use a linear equation to represent the regression function. f(x)=wT ϕ(x) + b
(5) The essence of formula (5) are often considered a constrained optimization problem,
and its expression is as follows In formula (6), Φ(w, £, b) = |w|2 + C(∑ + ∑ *) (6) C refers
to the penalty factor and £ and £* represent the upper and lower limits of the relief
variable, respectively. The Formssula (6) is used to solved the Lagrangian constraint
equation, which is shown as follows. ᾱ, ᾱ*= arg min { ∑ ∑ ( αi – αi*) (αj – αj*) (ϕ( ) ( ))
∑ ( αi – αi*) + ∑ ( αi – αi*)£} (7) sin formula (7), ϕ(x) is a kernel function. If ϕ(xi) ϕ(xj)=
xi xj, then it represents a linear support vector machine; otherwise, it is a nonlinear support
vector machine. The solution expressions of the sum of the coefficients to be determined,
the regression coefficients, and the constant terms are as follows. The Ŵ separate the
vulnerable and non-vulnerable codes given in equation (8). Ŵ = ∑ ( αi – αi*) ƀ = - Ŵ [ +
] (8) These formulas are used to separate the vulnerable and non-vulnerable codes.
2. Neural Networks
Fig 6.4 Code Static Analysis and Neural Network Training Principle
Next, the training sample of the NVD data set is used to train the TFI-DNN vulnerability
automatic classification model, and then the vulnerability test set is used to evaluate the model
performance. The whole process includes the subsequent steps: sample code construction,
feature extraction, word vector generation, and neural network model training and
classification. Among them, vulnerability feature extraction mainly involves the way to select
appropriate granularity to represent software programs and vulnerability detection shown on
figure 5. Since deep learning or neural networks take vectors as input; it like to represent
programs as vectors that are semantically meaningful for vulnerability detection. Use “bridge”
act as intermediate representation between a program and vector representation, which is that
the actual input to deep learning. Vulnerability feature extraction is to rework programs into
some intermediate representation which will preserve (some of) the semantic relationships
between the programs’ elements (e.g., data dependency and control dependency). Word vector
generation is predicated on feature extraction, applying the foremost mainstream word vector
generation technology in order that intermediate representation is often transformed into a
vector representation, that is, the actual input to neural networks. Neural network training
classification involves two stages of coaching and detection. The training phase takes the
source code extracted from the historical code base as input, whose output is neural network
of fine tuned model parameters. In the detection phase, the code vector representation extracted
from the new software program is taken as input, and therefore the output is that the
classification result.
{%block contents%}
<div class="Modern-Slider">
<div class="img-fill">
<div class="text-content">
<p>
{%csrf_token%}
<div class="form-group">
</div>
<div class="form-group">
</div>
{% if messages %}
{% endfor %}
{% endif %}
</form>
</p>
</div>
</div>
</div>
</div>
</div>
{%endblock%}
[Link]
{%load static%}
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<link
href="[Link]
,900&display=swap" rel="stylesheet">
</head>
<body>
<div id="preloader">
<div class="jumper">
<div></div>
<div></div>
<div></div>
</div>
</div>
<header class="">
<div class="container">
<span class="navbar-toggler-icon"></span>
</button>
<li class="nav-item">
</li>
<li class="nav-item">
</li>
<li class="nav-item">
</li>
<li class="nav-item">
</li>
</ul>
</div>
</div>
</nav>
</header>
{%block contents%}
{%endblock%}
<div class="services">
<div class="container">
<div class="row">
<div class="col-md-12">
<div class="section-heading">
</div>
</div>
</div>
</div>
</div>
<div class="sub-footer">
<div class="container">
<div class="row">
<div class="col-md-12">
</div>
</div>
</div>
</div>
cleared[[Link]] = 1; // you could use true and false, but that's more typing
[Link]='#fff';
</script>
</body>
</html>
[Link]
{%extends '[Link]'%}
{%block contents%}
<div class="Modern-Slider">
<div class="img-fill">
<div class="text-content">
<h6>Preventing CSRF</h6>
</div>
</div>
</div>
</div></div>{%endblock%}
CHAPTER – 7
TESTING
OUTPUT
CHAPTER – 8
RESULTS
CHAPTER – 9
CONCLUSION
In this study, a novel source code representation method was proposed to effectively transform
raw source code into a structured format suitable for machine learning (ML) algorithms. The
core of the approach involves extracting the Abstract Syntax Tree (AST) of a given source code
fragment and converting it into a numerical array representation. This transformation not only
preserves the syntactic structure but also retains the semantic meaning embedded in the code,
ensuring that the essential information required for deeper analysis is maintained.
By representing source code in this numerical format, the method enables the application of
various ML techniques to analyze and understand code in ways that go beyond traditional static
analysis. Specifically, this approach facilitates tasks such as vulnerability prediction, similarity
analysis, and code completion by leveraging the power of modern ML models.
Furthermore, the effectiveness of this source code representation can be enhanced by
employing advanced machine learning models like Support Vector Machines (SVM) and
Neural Networks. These models can improve the accuracy of vulnerability detection, while
also aiding in the localization and interpretability of vulnerabilities within the code. The ability
to not only detect but also pinpoint and explain the presence of security flaws makes this
method highly valuable for secure software development.
Future work may explore the application of this representation technique across different
programming languages and more complex codebases. Additionally, incorporating techniques
such as attention mechanisms and graph-based neural networks may further enrich the
structural understanding and boost model performance for code-related ML tasks.
The motivation behind this method stems from the growing need to apply machine learning
techniques to source code for a variety of intelligent tasks such as vulnerability prediction,
code similarity detection, and code completion. By converting the hierarchical and context-
rich AST into a machine-readable format, we unlock the potential to analyze source code
through powerful ML algorithms that can learn patterns, detect anomalies, and even suggest
improvements.
Future Enhancements
There are several promising directions for future work to expand and refine the current
approach:
1. Exploring Alternative Applications of Code Representation Techniques
While the current study focuses on vulnerability prediction, the underlying source code
representation technique has potential applications beyond this domain. Future research
could investigate its use in tasks such as:
o Code Similarity Analysis: Identifying structurally or semantically similar code
blocks across different projects.
o Code Completion: Assisting developers by predicting the next logical segment
of code based on the context, improving productivity in code editors or IDEs.
These alternative objectives could validate the versatility and robustness of the
proposed representation methodology.
2. Enhancing-Vulnerability-Localization-and-Interpretability
Another important direction is to improve the localization of vulnerabilities within the
codebase—pinpointing the exact lines or functions responsible for security flaws.
Additionally, incorporating model interpretability mechanisms (such as attention maps
or explainable AI techniques) could help developers understand why certain code
segments are flagged, thereby fostering trust and encouraging adoption in real-world
development environments.
3. Cross-Language-Generalization
A key challenge in vulnerability prediction is the model's ability to generalize across
programming languages. Future work could focus on adapting and evaluating the
proposed method's transferability—training a model on one language (e.g., Python) and
applying it to another (e.g., Java or C++). This would involve leveraging multilingual
code representations or pretraining on large cross-language corpora, thereby making
the system more flexible and broadly usable.
REFERENCES
1. M. Dowd, J. McDonald, and J. Schuh, The Art of Software Security Assessment: Identifying
and Preventing Software Vulnerabilities. Reading, MA, USA: Addison-Wesley, 2006.
2. S. B. Kotsiantis, I. Zaharakis, and P. Pintelas, “Supervised machine learning: A review of
classification techniques,” Emerging artificial intelligence applications in computer
engineering, vol. 160, pp. 3–24, 2007.
3. R. S. Ross, ‘‘Information security,’’ Joint Task Force Transformation Initiative, Guide
Conducting Risk Assessments, NIST Special Publication, Gaithersburg, MD, USA, Tech. Rep.
800-30 Revision 1, 2012.
4. A. M. Delaitre, B. C. Stivalet, P. E. Black, V. Okun, T. S. Cohen, and A. Ribeiro, ‘‘Sate V
report: Ten years of static analysis tool expositions,’’ NIST, Gaithersburg, MD, USA, Tech.
Rep. SP-500 326, 2018.
5. ZEKI BILGIN “Vulnerability Prediction From Source Code Using Machine Learning”,
Received July 28, 2020, accepted August 9, 2020, date of publication August 14, 2020, date of
current version August 26, 2020.
i
CHAPTER 4 : DESIGN ENGINEERING
4.1 General 20
4.2 UML Diagrams 20
4.2.1 Use Case Diagram 21
4.2.2 Class Diagram 22
4.2.3 Object Diagram 23
4.2.4 Component Diagram 24
4.2.5 Deployment Diagram 25
4.2.6 Sequence Diagram 26
4.2.7 Collaboration Diagram 27
4.2.8 Statechart Diagram 28
4.2.9 Activity Diagram 29
4.3 Data Flow Diagram 30
4.4 System Architecture 31
ii
8.3.5 Integration Testing 53
8.3.6 Acceptance Testing 53
CHAPTER 9 : APPLICATIONS AND FUTURE ENHANCEMENT
9.1 General 54
9.2 Applications 54
9.3 Future Enhancements 55
CHAPTER 10 : CONCLUSION
10.1 Conclusion 56
REFERENCES 57
iii
ABSTRACT
Genetic illness prediction is an important and timely issue in the realm of biomedical
science. Mutations in the genome are the root cause of many diseases with significant global
mortality rates, including Alzheimer's, cancer, diabetes, cystic fibrosis, leigh syndrome, and
others. Theoretical and explanatory approaches to predicting genetic abnormalities have been
developed through prior research. Genetic data has expanded to practically include the entire
genome and protein, and methods based on deep learning and machine learning have been
created to forecast genomic abnormalities in response. Concurrently with the introduction of
machine learning techniques, deep learning methods also emerged. Studies on the forecasting
of genetic anomalies have previously employed a variety of learning strategies, including
supervised, unsupervised, and semi-supervised approaches. Most of these studies used
genetic sequence data to make predictions about binary dilemmas. These methods produced
dubious results since they were less accurate and relied on binary class prediction algorithms,
which ignore the pasts of individuals with genetic anomalies. The majority of the approaches
relied on RNA gene sequences, which led to frequent issues when dealing with auction data.
Here, we use the XGBoost Algorithm to foretell genome multiclass disease from a huge
dataset utilising an advanced genome disorder prediction model (AGDPM). AGDPM
outperformed the trained XGBoost Algorithm in every category, with an average accuracy
of 92.65% in both the training and testing phases of the study. Therefore, the state-of-the-art
genome disorder prediction model can reliably predict genome disorder and analyse a large
quantity of patient genome disorder data thanks to the incorporation of a multi-class
prediction technique. Multiple statistical performance metrics demonstrate that AGDPM may
accurately predict diseases caused by a single gene, mitochondrial genes, and multiple genes.
As a result, AGDPM will help biomedical researchers manage mortality rates and anticipate
genetic disorders.
iv
LIST OF FIGURES
LIST OF SYMBOLS
v
_______________________________________________________
NOTATION
[Link] NAME NOTATION DESCRIPTION
Class Name
1. Class Represents a collection
of similar entities
+ public -attribute grouped together.
-private -attribute
# protected
+operation
+operation
NAME Associations represents
Class A Class B
2. Association +operation static relationships
between classes. Roles
Class A Class B
represents the way the
two classes see each
other.
It aggregates several
3. Actor classes into a single
classes.
vi
Used for additional process
Relation uses
5. communication.
(uses)
Extends relationship is
6. Relation extends used when one use case is
(extends) similar to another use case
but does a bit more.
vii
13. Use case Interact ion between the
Uses case system and external
environment.
Represents physical
14. Component modules which are a
collection of components.
Represents physical
15. Node modules which are a
collection of components.
viii
Represents the vertical
19. Object Lifeline dimensions that the object
communications.
ix
CHAPTER 1
INTRODUCTION
1.1 GENERAL
It is estimated that nearly 2,000 different human diseases can be traced back to a single faulty
gene, classifying them as monogenic syndromes. The genes responsible for each condition
exhibit various manifestations, leading to a diverse range of phenotypic outcomes. Therefore,
establishing phenotype-gene correlations is crucial for researchers and medical professionals
in deciphering the fundamental genetic mechanisms behind these disorders. Identifying
disease-causing genes aids in patient diagnosis and provides insight into the complex network
of genetic interactions. Essentially, a potential genetic disease can be detected by analyzing
causative mutant genotypes during the gene identification process. Genetic anomalies, such
as single nucleotide changes, additions or deletions, and complete gene loss, can all impact
disease-causing genes. Traditional approaches to identifying pathogenic genes include
positional cloning, linkage analysis, and mutation analysis. Initially, linkage analysis on
human pedigrees helps locate the chromosomal interval associated with the disease,
identifying candidate genes in the region. Next, positional cloning involves sequencing a set
of candidate genes within this interval, combining spatial and transcriptional mapping.
Human genetic disorders are inherited conditions arising from genetic or chromosomal
abnormalities present from conception. These disorders fall into two primary categories:
single-gene diseases and complex disorders. Single-gene diseases result from a mutation in
a single gene and are passed down easily from one generation to the next, referred to as
Mendelian diseases. Complex diseases, on the other hand, result from a combination of
environmental, behavioral, and lifestyle factors, with genetic defects contributing only a
small fraction to the overall phenotype. Single-gene disorders can originate in any gene, but
they share common genetic and psychosocial care needs, allowing for informed decisions on
risk management and support for affected individuals. Mitochondrial diseases, caused by
alterations in mitochondrial DNA rather than nuclear DNA, are inherited solely from the
1
mother. These diseases can present with symptoms such as lactic acidosis, stroke-like
episodes, eye abnormalities, and encephalopathy. Inherited disorders have various
underlying causes, and many conditions result from a combination of genetic alterations and
environmental factors. Complex genetic disorders, such as diabetes, Alzheimer's, and cancer,
illustrate the multifaceted nature of polygenic illnesses.
1.2 OBJECTIVE
2
• To explore that one complex genetic disorder can underlie conditions such as
diabetes, Alzheimer's, and cancer.
• To consider machine learning as an alternative to conventional methods of genetic
prediction, noting that advancements in this field, along with growing data sets and
computing power, have made deep learning increasingly popular.
• To utilize deep learning methods in statistical genetics to identify interactions
between multiple loci without assuming additivity, addressing the high
dimensionality of factors and improving the prediction of their relative importance.
In the realm of genetics and medical research, forecasting genome disorders is crucial.
Although Deep Neural Networks (DNNs) have demonstrated significant potential in
addressing this challenge, their effectiveness can be hindered by overfitting. Convolutional
Neural Networks (CNNs) face limitations due to the increased spatial correlation of zeroed-
out values in output feature maps. To combat overfitting, dropout is commonly used. The
current recommendation is to utilize Checkerboard Dropout, a structured dropout method
designed to enhance performance and generalization while addressing the spatial correlation
issue. However, despite its benefits, Checkerboard Dropout may still encounter problems that
require further refinement.
1.3.1 Disadvantage of Existing System
Recommendation for Overfitting Solution
The recommendation is to use Checkerboard Dropout as an effective strategy to address the
overfitting problem in deep learning models. Overfitting occurs when a model performs
exceptionally well on training data but struggles to generalize to new, unseen data. This issue
is particularly prominent in Convolutional Neural Networks (CNNs) where the spatial
correlation of zeroed-out values in output feature maps can hinder performance and
generalization. Checkerboard Dropout offers a targeted solution by introducing structured
dropout, which systematically removes features to reduce the likelihood of overfitting and
improve the model's ability to generalize
3
Checkerboard Dropout: A Structured Dropout Technique
Checkerboard Dropout is a structured dropout technique designed to address the issues of
randomness and spatial correlation that commonly affect neural networks. Unlike traditional
dropout methods that randomly eliminate individual features, Checkerboard Dropout
removes contiguous blocks of features, creating a more organized pattern of dropout. This
approach helps mitigate the spatial correlation problem by ensuring that removed features do
not follow an unpredictable, random pattern. As a result, it enhances model generalization
and performance by promoting more robust learning. Despite its advantages, it is important
to note that Checkerboard Dropout may still face challenges that require further refinement
and investigation.
4
1.4 LITERATURE SURVEY
Title: Network-Based Methods for Human Disease Gene Prediction
Year: 2011
Description:
5
Title: ImageNet Classification with Deep Convolutional Neural Networks
Year: 2012
6
Title: First Glimpses of the Neurobiology of Autism Spectrum Disorder
Author: S. J. Sanders
Year: 2015.
Description:
In this comprehensive review, S. J. Sanders delves into the early insights into the
neurobiological underpinnings of autism spectrum disorder (ASD). The paper meticulously
examines the genetic landscape of ASD, highlighting significant advances in identifying
specific genetic mutations and variations that are associated with the disorder. It discusses
how these genetic findings contribute to a broader understanding of how ASD affects brain
development and function, exploring the implications of these genetic insights for
understanding the etiology of the disorder. Sanders reviews research on brain structure and
connectivity, noting how abnormalities in these areas may relate to the core symptoms of
ASD. The paper also addresses the role of environmental factors and their interaction with
genetic predispositions, providing a nuanced view of the complex interplay between genetics
and environmental influences. Additionally, it outlines the progress made in identifying
potential biomarkers for ASD, which could pave the way for improved diagnostic methods
and targeted therapies. By synthesizing recent research and presenting an overview of key
studies, Sanders provides a valuable resource for researchers and clinicians seeking to
understand the neurobiological basis of ASD and offers insights into future research
directions aimed at unraveling the complexities of this multifaceted disorder.
7
Title: Biological Insights from 108 Schizophrenia-Associated Genetic Loci
Year: 2014.
Description:
This study published in Nature provides an in-depth analysis of 108 genetic loci associated
with schizophrenia. The research focuses on elucidating the biological mechanisms
underlying schizophrenia by examining the genetic variants identified through large-scale
genome-wide association studies (GWAS). The paper highlights how these genetic loci
contribute to the understanding of the disorder's etiology, including their effects on brain
structure, function, and molecular pathways. By integrating genetic data with functional
annotations and gene expression profiles, the authors provide valuable insights into the
biological processes disrupted in schizophrenia. The findings offer a clearer picture of the
genetic architecture of the disorder and suggest potential pathways for future research and
therapeutic interventions. This comprehensive analysis underscores the complexity of
schizophrenia’s genetic basis and the importance of continued research in uncovering the
mechanisms driving this severe mental illness.
8
Title: Uncovering Disease-Disease Relationships Through the Incomplete Interactome
Year: 2015
Description:
This paper, published in Science, explores the relationships between different diseases
through the lens of the incomplete interactome—a network of protein interactions that is not
fully mapped. The authors propose a novel approach to uncovering disease-disease
relationships by integrating partial interactome data with disease association information.
They demonstrate that by analyzing the connections between proteins involved in different
diseases, it is possible to identify previously unknown relationships between diseases. The
study provides insights into how interactions within this incomplete network can reveal
shared molecular pathways and mechanisms across various diseases. The findings have
significant implications for understanding the comorbidities and underlying biological
connections between different health conditions, potentially guiding future research and
therapeutic strategies. The approach highlights the value of network-based analyses in
revealing complex disease relationships that are not apparent through traditional methods.
9
1.5 PROPOSED SYSTEM
Complex multiple gene abnormalities can lead to a diverse array of symptoms, encompassing
multifactorial genome disorders, mitochondrial gene inheritance disorders, and single-gene
inheritance disorders. Recent advancements in genomic technology have enabled more
precise acquisition of genetic data. Large-scale genetic studies, including those focused on
multifactorial genome disorders (MGD) and single-gene inheritance disorders (SGID), have
identified hundreds of individuals with various abnormalities. However, despite the vast
amount of data generated by these studies, identifying the specific genes responsible for the
diseases remains challenging. Additionally, since mitochondrial DNA is inherited
maternally, mothers are the primary source of mitochondrial disorders in their children, as
the organelles are maintained through fertilization.
10
High Prediction Accuracy with XGBoost Algorithm
The suggested model, utilizing the XGBoost algorithm, achieved an impressive 92.65%
prediction accuracy based on patients' clinical feature data. This high level of accuracy
demonstrates the model's effectiveness in processing and analyzing complex clinical
information, leading to reliable and precise predictions. The XGBoost algorithm's robustness
and accuracy significantly contribute to the system's overall performance.
11
CHAPTER 2
PROJECT DESCRIPTION
2.1 GENERAL
The paper explores advancements in predictive modeling for genetic disorders using modern
machine learning techniques. It focuses on leveraging deep learning methodologies,
particularly Convolutional Neural Networks (CNNs), to enhance the accuracy and efficiency
of predicting multifactorial and single-gene abnormalities.
The study addresses challenges such as overfitting and spatial correlation in feature maps,
proposing solutions like Checkerboard Dropout to mitigate these issues and improve model
generalization. It highlights the use of advanced algorithms, including XGBoost, to achieve
high prediction accuracy, optimize computational performance, and reduce space
complexity.
Furthermore, the paper discusses the integration of gradient descent methods for loss
minimization and the independence of feature engineering processes to streamline model
development. It underscores the significance of recent genomic technologies in providing
precise genetic data and the difficulty of pinpointing disease-causing genes despite the
availability of large-scale genetic studies.
2.2 METHODOLOGIES
12
➢ Data preparation
➢ Model Selection
➢ Analysis and prediction
➢ Accuracy on the test set
➢ Saving the trained model
13
• Status: Whether the person or patient is alive or deceased.
• Respiratory Rate (breaths/min): The rate of breathing controlled by the brain's
respiratory center.
• Heart Rate (rates/min): The frequency of heartbeats per minute.
• Test 1: Status of Test 1.
• Test 2: Status of Test 2.
• Test 3: Status of Test 3.
• Test 4: Status of Test 4.
• Test 5: Status of Test 5.
• Parental Consent: Indicates if parental assent was provided for participation.
• Follow-up Level: Indicates whether follow-up is high or low.
• Gender: Male, Female, or Indeterminate.
• Birth Asphyxia: Condition where insufficient oxygen is received during childbirth.
• Autopsy Reveals Birth Defect (if any): Findings from an autopsy regarding birth
defects.
• Place of Birth: The birthplace.
• Information about Folic Acid (peri-conceptional): Data on folic acid, a vitamin
important for new cell production.
• H/O Serious Maternal Disease: Impact of serious maternal disease on the patient's
mother.
• H/O Radiation Exposure (x-ray): Indicates if the patient has been exposed to
radiation.
• H/O Substance Abuse: Indicates if a parent has struggled with drug addiction.
• Assisted Conception (IVF/ART): Type of infertility therapy used.
• Previous Pregnancy Abnormalities: History of abnormalities in prior pregnancies.
• Number of Prior Abortions: Total number of prior abortions.
• Birth Defects: Indicates if the patient has birth defects.
• White Blood Cell Count: Number of white blood cells per microliter.
14
• Blood Test Result: Categorized as Normal, Slightly Abnormal, Unclear, or
Abnormal.
• Symptom 1: Presence of Symptom 1.
• Symptom 2: Presence of Symptom 2.
• Symptom 3: Presence of Symptom 3.
• Symptom 4: Presence of Symptom 4.
• Symptom 5: Presence of Symptom 5.
• Genetic Disorder: Professional detection of genetic disorders.
• Type of Disorder: Subclass of the disorder.
3. Data Preparation: Prepare the data for training by cleaning and organizing it. This
involves eliminating duplicates, correcting errors, addressing missing values, normalizing
the data, converting data types as needed, and removing any other potential inconsistencies.
Randomize the data to ensure that any effects from the specific order in which it was collected
or processed are minimized. Next, conduct further exploratory analysis, which includes
visualizing the data to identify any significant class imbalances or relationships between
variables, while being cautious of potential biases. Finally, split the data into training and
assessment sets to facilitate model evaluation.
4. Model selection: After utilizing the XGBoost and Support Vector Machine methods,
which produced accuracy of 98% and 80% on the train set, respectively, we developed this
method.
5. Analyze and prediction: Out of the entire dataset, we only chose two attributes:
• A description of the health values is given.
• Outcome: indicates the type of genetic condition that the patient or individual has.
6. Accuracy on test set: We obtained accuracy of 92.65% & 41.40% on the test set.
7. Saving the Trained Model: You're ready to deploy your trained and validated model
when you follow these steps: First, save your model as a `.pkl` file using a library like Pickle.
Ensure that Pickle is properly configured in your environment. Once confirmed, import the
model and create a `.pkl` file for export, which will allow you to deploy the model in a
production setting.
15
2.3 TECHNIQUE USED OR ALGORITHM USED
16
CHAPTER 3
REQUIREMENTS ENGINEERING
3.1 GENERAL
The interpretation of the handwriting character by developing techniques and methods such
as improvement of character classification techniques. The accurate and rapid classification
for accurate information retrieval, sound classification, stock price forecasting.
The hardware requirements may serve as the basis for a contract for the implementation of
the system and should therefore be a complete and consistent specification of the whole
system. They are used by software engineers as the starting point for the system design. It
shows what the system do and not how it should be implemented.
• Processor - Pentium - IV
• Speed - 1.1 GHz
• Ram - 256 MB
• Hard Disk - 20 GB
• Key Board - Standard Windows Keyboard
• Mouse - Two or Three Button Mouse
• Monitor - SVGA
The software requirements document is the specification of the system. It should include both
a definition and a specification of requirements. It is a set of what the system should do rather
than how it should do it. The software requirements provide a basis for creating the software
requirements specification. It is useful in estimating cost, planning team activities,
17
performing tasks and tracking the teams and tracking the team’s progress throughout the
development activity.
HARDWARE REQUIREMENTS
SOFTWARE REQUIREMENTS
The functional requirements for the proposed system involve developing a predictive model
using XGBoost, a robust machine learning algorithm known for its high performance,
scalability, and accuracy. The system must effectively handle and process large datasets
related to genetic diseases, ensuring accurate prediction and classification outcomes. The
model will incorporate regularised objective functions (L1 and L2), focusing on minimising
the convex loss function and penalising model complexity. The system must be capable of
integrating new regression trees to predict residuals from previous iterations, refining the
final prediction. The end goal is to create a reliable and efficient tool for analyzing genetic
data and predicting disease outcomes using the XGBoost algorithm.
18
3.5 NON-FUNCTIONAL REQUIREMENTS
Usability
The system is designed with completely automated process hence there is no or less user
intervention.
Reliability
The system is more reliable because of the qualities that are inherited from the chosen
platform java. The code built by using python is more reliable.
Performance
This system is developing in the high level languages and using the advanced front-end and
back-end technologies it will give response to the end user on client system with in very less
time.
Supportability
The system is designed to be the cross platform supportable. The system is supported on a
wide range of hardware and any software platform, which is built into the system.
Implementation
The system is implemented in web environment using Django framework. The server is used
as the web server and windows xp professional is used as the platform. Interface the user
interface is based on Django provides web application.
19
CHAPTER 4
DESIGN ENGINEERING
4.1 GENERAL
Design Engineering deals with the various UML [Unified Modeling language]
diagrams for the implementation of project. Design is a meaningful engineering
representation of a thing that is to be built. Software design is a process through which the
requirements are translated into representation of the software. Design is the place where
quality is rendered in software engineering. Design is the means to accurately translate
customer requirements into finished product.
20
4.2.1 USE CASE DIAGRAM
EXPLANATION
Use-case diagrams describe the high-level functions and scope of a system. These diagrams
also identify the interactions between the system and its actors. The use cases and actors in
use-case diagrams describe what the system does and how the actors use it, but not how the
system operates internally.
21
4.2.2 CLASS DIAGRAM
EXPLANATION
In this class diagram In software engineering, a class diagram in the Unified Modeling
Language (UML) is a type of static structure diagram that describes the structure of a system
by showing the system's classes, their attributes, operations (or methods), and the
relationships among objects.
22
4.2.3 OBJECT DIAGRAM
EXPLANATION
Object is an instance of a class in a particular moment in runtime that can have its own state
and data values. Likewise a static UML object diagram is an instance of a class diagram; it
shows a snapshot of the detailed state of a system at a point in time, thus an object diagram
encompasses objects and their relationships which may be considered a special case of a class
diagram or a communication diagram.
23
4.2.4 COMPONENT DIAGRAM
EXPLANATION
In the Unified Modeling Language, a component diagram depicts how components are wired
together to form larger components and or software systems. They are used to illustrate the
structure of arbitrarily complex systems. User gives main query and it converted into sub
queries and sends through data dissemination to data aggregators. Results are to be showed
to user by data aggregators. All boxes are components and arrow indicates dependencies.
24
4.2.5 DEPLOYMENT DIAGRAM
EXPLANATION
The Unified Modeling Language (UML) is the standard language that many software
engineers and business professionals use to create a broad overview for complex systems. A
deployment diagram is one type of diagram created with this language. Along with our UML
diagramming tool, use this guide to learn more about deployment diagrams.
25
4.2.6 SEQUENCE DIAGRAM
EXPLANATION
A sequence diagram is a type of interaction diagram because it describes how—and
in what order—a group of objects works together. These diagrams are used by software
developers and business professionals to understand requirements for a new system or to
document an existing process.
26
4.2.7 COLLABORATION DIAGRAM
EXPLANATION
A collaboration diagram, also known as a communication diagram, is an illustration
of the relationships and interactions among software objects in the Unified Modelling
Language (UML).
27
4.2.8 STATE CHART DIAGRAM
EXPLANATION
These terms are often used interchangeably. So simply, a state diagram is used to model the
dynamic behavior of a class in response to time and changing external stimuli. We can say
that each and every class has a state but we don’t model every class using State diagrams.
We prefer to model the states with three or more states.
28
4.2.9 ACTIVITY DIAGRAM
EXPLANATION
An activity diagram is a type of Unified Modeling Language (UML) flowchart that shows
the flow from one activity to another in a system or process. It's used to describe the different
dynamic aspects of a system and is referred to as a 'behavior diagram' because it describes
what should happen in the modeled system.
29
4.3. DATA FLOW DIAGRAM
EXPLANATION
The above figure 4.10 is a sequence that starts with User data input, followed by array
conversion. Next, model is loaded and applied on the converted data. Then, the genome
disorder detection is done.
30
4.4 SYSTEM ARCHITECTURE
EXPLANATION
The above figure is a system architecture in which data processing is done and on the entire
dataset, feature extraction is performed which results in a feature set. The dataset is divided
into training and test sets. Finally, the XGBoost model is applied to the data for accurate
outputs.
31
CHAPTER 5
DEVELOPMENT TOOLS
5.1 GENERAL
Python
History of Python
Python was developed by Guido van Rossum in the late eighties and early nineties at the
National Research Institute for Mathematics and Computer Science in the Netherlands.
Python is derived from many other languages, including ABC, Modula-3, C, C++, Algol-
68, Smalltalk, and Unix shell and other scripting languages.
Python is copyrighted. Like Perl, Python source code is now available under the GNU
General Public License (GPL).
Python is now maintained by a core development team at the institute, although Guido van
Rossum still holds a vital role in directing its progress.
Importance of Python
• Python is Interpreted − Python is processed at runtime by the interpreter. You do
not need to compile your program before executing it. This is similar to PERL and
PHP.
• Python is Interactive − You can actually sit at a Python prompt and interact with
the interpreter directly to write your programs.
32
• Python is Object-Oriented − Python supports Object-Oriented style or technique of
programming that encapsulates code within objects.
Features of Python
• Easy-to-learn − Python has few keywords, simple structure, and a clearly defined
syntax. This allows the student to pick up the language quickly.
• Easy-to-read − Python code is more clearly defined and visible to the eyes.
• A broad standard library − Python's bulk of the library is very portable and cross-
platform compatible on UNIX, Windows, and Macintosh.
• Interactive Mode − Python has support for an interactive mode which allows
interactive testing and debugging of snippets of code.
• Portable − Python can run on a wide variety of hardware platforms and has the same
interface on all platforms.
• Extendable − You can add low-level modules to the Python interpreter. These
modules enable programmers to add to or customize their tools to be more efficient.
• GUI Programming − Python supports GUI applications that can be created and
ported to many system calls, libraries and windows systems, such as Windows MFC,
Macintosh, and the X Window system of Unix.
• Scalable − Python provides a better structure and support for large programs than
shell scripting.
33
Apart from the above-mentioned features, Python has a big list of good features, few are
Listed below −
• It provides very high-level dynamic data types and supports dynamic type checking.
• It can be easily integrated with C, C++, COM, ActiveX, CORBA, and Java.
• pandas - Python data analysis library, including structures such as data frames.
• scikit-learn - the machine learning algorithms used for data analysis and data mining
tasks.
34
CHAPTER 6
IMPLEMENTATION
import pandas as pd
import numpy as np
import os
import cv2
import [Link] as plt
import warnings
from [Link] import Input, Lambda, Dense, Flatten, Dropout
from [Link] import Model
import xgboost as xgb
from [Link] import image#, image_dataset_from_directory
from [Link] import ImageDataGenerator
from [Link] import Sequential
from tensorflow import keras
import tensorflow
#import scipy
#print("Num GPUs Available: ", len([Link].list_physical_devices('GPU')))
# Set the seed value for experiment [Link].
seed = 1842
[Link].set_seed(seed)
[Link](seed)
# Turn off warnings for cleaner looking notebook
[Link]('ignore')
35
#SPLITTING DATA FOR TRAINING AND TESTING SET
target_size=(176,208),
subset="training",
class_mode='categorical')
validation_dataset =
image_generator.flow_from_directory(directory='genome_disorder_prediction /train',
target_size=(176,208),
subset="validation",
class_mode='categorical')
image_generator_submission = ImageDataGenerator(rescale=1/255)
submission = image_generator_submission.flow_from_directory(
directory=''genome_disorder_prediction/test',
target_size=(176,208),
class_mode=None)
#OUTPUT
36
Found 1279 images belonging to 4 classes.
batch_1_img = train_dataset[0]
for i in range(0,4):
img = batch_1_img[0][i]
lab = batch_1_img[1][i]
[Link](img)
[Link](lab)
[Link]('off')
[Link]()
#ANN
[Link](optimizer='adam',
loss=[Link](),
37
metrics=[[Link](name='auc')])
callback = [Link](monitor='val_loss',
patience=3,
restore_best_weights=True)
#OUTPUT
#OUPTUT
Loss: 0.46110430359840393
Accuracy: 0.9752264022827148
[Link](0.2),
38
[Link](0.2),
[Link](0.2),
[Link](optimizer='adam',
loss=[Link](),
metrics=[[Link](name='auc')])
callback = [Link](monitor='val_loss',
patience=4,
restore_best_weights=True)
#OUTPUT
#OUTPUT
39
Loss: 0.3963065445423126
Accuracy: 0.9703787565231323
#CNN
model = [Link]([
[Link].MaxPooling2D(),
[Link].MaxPooling2D(),
[Link](),
[Link].MaxPool2D(),
[Link](),
[Link].MaxPool2D(),
[Link](0.2),
40
[Link](),
[Link].MaxPool2D(),
[Link](0.2),
[Link](),
[Link](512, activation='relu'),
[Link](),
[Link](0.7),
[Link](128, activation='relu'),
[Link](),
[Link](0.5),
[Link](64, activation='relu'),
[Link](),
[Link](0.3),
[Link](
optimizer='adam',
loss=[Link](),
metrics=[[Link](name='auc')]
41
def exponential_decay(lr0, s):
def exponential_decay_fn(epoch):
return exponential_decay_fn
lr_scheduler = [Link](exponential_decay_fn)
checkpoint_cb = [Link]("'Alzheimer_disease_classification
_cnn.h5",
save_best_only=True)
early_stopping_cb = [Link](patience=5,restore_best_weights=True)
history = [Link](
train_dataset,
validation_data=validation_dataset,
epochs=1
#OUTPUT
42
#DETERMING LOSS AND ACCURACY
#OUTPUT
Loss: 5.077194690704346
Accuracy: 0.407303124666214
train_labels
#OUTPUT
43
...
# LABEL NAMES
train_images.shape
#OUTPUT
train_labels.shape
#OUTPUT
(32, 4)
# DATA VISUALIZATION
Len= 4
Wid=4
for i in [Link](0,8):
44
axes[i].imshow(train_images[i])
axes[i].set_title(label_names[[Link](train_labels[i])])
axes[i].axis('off')
plt.subplots_adjust(wspace=0.5)
xgb_model = [Link](
objective='binary:logistic',
eval_metric='logloss',
use_label_encoder=False
#Code
param_grid = {
45
grid_search = GridSearchCV(estimator=xgb_model, param_grid=param_grid,
scoring='roc_auc', cv=5, verbose=1)
grid_search.fit(X_train, y_train)
best_params = grid_search.best_params_
best_model = grid_search.best_estimator_
y_pred = best_model.predict(X_test)
y_proba = best_model.predict_proba(X_test)[:, 1]
#OUTPUT
Accuracy: 0.87
Confusion Matrix:
[[150 20]
[ 18 112]]
46
6.2 TEST CASES
Testcase 1
Column Name Description
Test Case ID TC_001
Test Objective Evaluate the model’s ability to correctly
identify genome disorders with high
accuracy.
Test Requirement The model should achieve an accuracy of at
least 85% on the test dataset.
Pass/Fail Criteria Pass.
Actions Taken Train the XGBoost model with the provided
training data, then evaluate its performance
on the test set. Record and compare the
accuracy against the required threshold.
Segmentation Errors N/A
Test Environment PC
Image Characteristics Describe the characteristics of the uploaded
scans (e.g., slice thickness, resolution,
contrast).
Other Potential Issues N/A
47
CHAPTER 7
SNAPSHOTS
7.1 SNAPSHOTS
The above Figure 7.1 shows Accessing [Link] redirects users to the
corresponding web page.
#MAIN PAGE
48
Figure 7.3 Disorder Subclass Detection
49
Figure 7.4 Genome Disorder Detection
The above figure 7.4 shows the genome disorder detection classes
50
CHAPTER 8
SOFTWARE TESTING
8.1 GENERAL
The purpose of testing is to discover errors. Testing is the process of trying to discover
every conceivable fault or weakness in a work product. It provides a way to check the
functionality of components, sub-assemblies, assemblies, and a finished product It is the
process of exercising software with the intent of ensuring that the Software system meets its
requirements and user expectations and does not fail unacceptably. There are various types
of tests. Each test type addresses a specific testing requirement.
51
and/or system configuration. Unit tests ensure that each unique path of a business process
performs accurately to the documented specifications and contains clearly defined inputs and
expected results.
52
8.3.5 INTEGRATION TESTING
Software integration testing is the incremental integration testing of two or more
integrated software components on a single platform to produce failures caused by interface
defects.
The task of the integration test is to check that components or software applications, e.g.
components in a software system or – one step up – software applications at the company
level – interact without error.
8.3.6 ACCEPTANCE TESTING
User Acceptance Testing is a critical phase of any project and requires significant
participation by the end user. It also ensures that the system meets the functional
requirements.
53
CHAPTER 9
APPLICATIONS AND FUTURE ENHANCEMENT
9.1 General
Genetic disorders pose a significant challenge in biomedical science due to their complexity
and the substantial impact they have on global health. Accurate prediction and classification
of these disorders are critical for effective diagnosis and treatment. This paper focuses on
enhancing the prediction of genome disorders by employing an advanced Gradient Boosting
model, specifically the XGBoost Algorithm, to analyze a comprehensive dataset of genetic
information. By leveraging this approach, we aim to achieve high prediction accuracy and
reliability in identifying single-gene, mitochondrial, and multifactorial genetic disorders. Our
goal is to advance the field of genetic disorder prediction and improve clinical outcomes
through more precise and actionable insights.
9.2 Applications
Genetic Disorder Diagnosis: The algorithm helps in the classification and prediction of
genetic disorders by analyzing complex genetic data, assisting in early diagnosis and targeted
interventions.
54
9.3 FUTURE ENHANCEMENT
Expanding this study to include additional genetic disorders and incorporating more
advanced prediction models could significantly enhance its scope and impact. By integrating
a broader range of genetic disorders, the research can provide a more comprehensive
understanding of the genetic factors influencing various conditions. This expansion would
also facilitate the development of more precise diagnostic tools and personalized treatment
strategies. Additionally, incorporating cutting-edge prediction models, such as ensemble
methods or hybrid approaches that combine different machine learning techniques, could
improve the accuracy and reliability of predictions. These advancements would contribute to
more effective early detection and management of genetic disorders, ultimately benefiting
patient outcomes and advancing the field of genetic research.
55
CHAPTER 10
CONCLUSION
10.1 CONCLUSION
56
REFERENCES
[2] B. Irom, ‘‘Genetic disorders: A literature review,’’ Genet. Mol. Biol. Res., vol. 4, no. 2,
p. 30, 2020.
[4] S. J. Sanders, ‘‘First glimpses of the neurobiology of autism spectrum disorder,’’ Current
Opinion Genet. Develop., vol. 33, pp. 80–92, Aug. 2015.
[5] Europe PMC Funders Group, ‘‘Biological insights from 108 schizophrenia-associated
genetic loci,’’ Nature, vol. 511, no. 7510, pp. 421–427, Jul. 2014.
[8] M. Vidal, M. E. Cusick, and A. L. Barabási, ‘‘Interactome networks and human disease,’’
Cell, vol. 144, no. 6, pp. 986–998, Mar. 2011.
[9] X. Wang, N. Gulbahce, and H. Yu, ‘‘Network-based methods for human disease gene
prediction,’’ Briefings Funct. Genomics, vol. 10, no. 5, pp. 280–293, 2011.
[10] T.-P. Nguyen and T. B. Ho, ‘‘Detecting disease genes based on semi-supervised learning
and protein–protein interaction networks,’’ Artif. Intell. Med., vol. 54, no. 1, pp. 63–71, Jan.
2012.
57
[11] P. Yang, X. L. Li, J. P. Mei, C. K. Kwoh, and S. K. Ng, ‘‘Positive-unlabeled learning
for disease gene identification,’’ Bioinformatics, vol. 28, no. 20, pp. 2640–2647, 2012.
[13] P. Han, P. Yang, P. Zhao, S. Shang, Y. Liu, J. Zhou, X. Gao, and P. Kalnis, ‘‘GCN-MF:
Disease-gene association identification by graph convolutional networks and matrix
factorization,’’ in Proc. 25th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, Jul.
2019, pp. 705–713.
[14] X. Zeng, Y. Liao, Y. Liu, and Q. Zou, ‘‘Prediction and validation of disease genes using
HeteSim scores,’’ IEEE/ACM Trans. Comput. Biol. Bioinf., vol. 14, no. 3, pp. 687–695, May
2017.
[15] H. Zhou and J. Skolnick, ‘‘A knowledge-based approach for predicting gene–disease
associations,’’ Bioinformatics, vol. 32, no. 18, pp. 2831–2838, Sep. 2016.
[16] Y. Li, H. Kuwahara, P. Yang, L. Song, and X. Gao, ‘‘PGCN: Disease gene prioritization
by disease and gene embedding through graph convolutional neural networks,’’ bioRxiv, vol.
2019, Jan. 2019, Art. no. 532226, doi: 10.1101/532226.
[17] K. Yang, Y. Zheng, K. Lu, K. Chang, N. Wang, Z. Shu, J. Yu, B. Liu, Z. Gao, and X.
Zhou, ‘‘PDGNet: Predicting disease genes using a deep neural network with multi-view
features,’’ IEEE/ACM Trans. Comput. Biol. Bioinf., vol. 19, no. 1, pp. 575–584, Jan. 2022,
doi: 10.1109/TCBB.2020.3002771.
58
[19] K. Yang, R. Wang, G. Liu, Z. Shu, N. Wang, R. Zhang, J. Yu, J. Chen, X. Li, and X.
Zhou, ‘‘HerGePred: Heterogeneous network embedding representation for disease gene
prediction,’’ IEEE J. Biomed. Health Informat., vol. 23, no. 4, pp. 1805–1815, Jul. 2019.
[20] K. Yang, N. Wang, G. Liu, R. Wang, J. Yu, R. Zhang, J. Chen, and X. Zhou,
‘‘Heterogeneous network embedding for identifying symptom candidate genes,’’ J. Amer.
Med. Inform. Assoc., vol. 25, Nov. 2018.
59
[27] M. Saleem, S. Abbas, T. M. Ghazal, M. A. Khan, N. Sahawneh, and M. Ahmad, ‘‘Smart
cities: Fusion-based intelligent traffic congestion control system for vehicular networks using
machine learning techniques,’’ Egyptian Informat. J., vol. 6, pp. 1–10, Apr. 2022.
[30] N. Taleb, S. Mehmood, M. Zubair, I. Naseer, B. Mago, and M. U. Nasir, ‘‘Ovary cancer
diagnosing empowered with machine learning,’’ in Proc. Int. Conf. Bus. Anal. Technol.
Secur. (ICBATS), Feb. 2022, pp. 1–6.
60
ged
by Ratna Varun
20
3
9
8
8
6
37
4
3
2
31
36
24
34
15
46
4
4
3
40
32
1
4
17
28
22
1
19
35
18
18
1
1
43
11
44
41
20
21
42
1
1
13
13
10
7
7
10
10
12
14
12
14
29
22
45
26
26
39
3
25
23
27
33
30
38
5
1
5
6
6
1
6
ged
ORIGINALITY REPORT
16 %
SIMILARITY INDEX
11%
INTERNET SOURCES
4%
PUBLICATIONS
11%
STUDENT PAPERS
PRIMARY SOURCES
1
Submitted to Jawaharlal Nehru Technological
University
2%
Student Paper
2
Submitted to Vel Tech University
Student Paper 2%
3
Submitted to University of Hertfordshire
Student Paper 1%
4
[Link]
Internet Source 1%
5
[Link]
Internet Source 1%
6
[Link]
Internet Source 1%
7
[Link]
Internet Source 1%
8
Submitted to Jawaharlal Nehru Technological
University Kakinada
<1 %
Student Paper
9
Submitted to University of Greenwich
Student Paper <1 %
10
[Link]
Internet Source <1 %
11
Submitted to Westcliff University
Student Paper <1 %
12
[Link]
Internet Source <1 %
13
[Link]
Internet Source <1 %
14
Submitted to University of Strathclyde
Student Paper <1 %
15
[Link]
Internet Source <1 %
16
[Link]
Internet Source <1 %
17
Submitted to University of Illinois at Urbana-
Champaign
<1 %
Student Paper
18
Submitted to Ghana Technology University
College
<1 %
Student Paper
19
Submitted to Victorian Institute of Technology
Student Paper <1 %
20
[Link]
Internet Source <1 %
21
Submitted to Florida Gulf Coast University
Student Paper <1 %
22
Poornachandra Sarang. "Artificial Neural
Networks with TensorFlow 2", Springer
<1 %
Science and Business Media LLC, 2021
Publication
23
[Link]
Internet Source <1 %
24
[Link]
Internet Source <1 %
25
Submitted to Infile
Student Paper <1 %
26
Mehdi Ghayoumi. "Generative Adversarial
Networks in Practice", CRC Press, 2023
<1 %
Publication
27
[Link]
Internet Source <1 %
28
Submitted to SASTRA University
Student Paper <1 %
29
Submitted to University of Wales, Lampeter
Student Paper <1 %
30
[Link]
Internet Source <1 %
31
[Link]
Internet Source <1 %
32
Sujith Samuel Mathew, Mohammad Amin
Kuhail, Maha Hadid, Shahbano Farooq. "The
<1 %
Object-Oriented Approach to Problem Solving
and Machine Learning with Python", CRC
Press, 2025
Publication
33
[Link]
Internet Source <1 %
34
[Link]
Internet Source <1 %
35
[Link]
Internet Source <1 %
36
[Link]
Internet Source <1 %
37
H.L. Gururaj, Francesco Flammini, S. Srividhya,
M.L. Chayadevi, Sheba Selvam. "Computer
<1 %
Science Engineering", CRC Press, 2024
Publication
38
Holmberg, Angela L.. "Bottom-Up Designs and
Syntheses of Sustainable Block Polymers.",
<1 %
University of Delaware, 2020
Publication
39
[Link]
Internet Source <1 %
40
[Link]
Internet Source <1 %
41
[Link]
Internet Source <1 %
42
[Link]
Internet Source <1 %
43
[Link]
Internet Source <1 %
44
B. Sundaravadivazhagan, S. Poonkuntran,
Thendral Puyalnithi. "Deep Learning for Smart
<1 %
Healthcare - Trends, Challenges and
Applications", CRC Press, 2024
Publication
45
Mrinal Kanti Bhowmik. "Computer Vision -
Object Detection in Adversarial Vision", CRC
<1 %
Press, 2024
Publication
46
Yogendra Narayan Pandey, Ayush Rastogi,
Sribharath Kainkaryam, Srimoyee
<1 %
Bhattacharya, Luigi Saputelli. "Machine
Learning in the Oil and Gas Industry",
Springer Science and Business Media LLC,
2020
Publication
Abstract. Genetic illness prediction is an important and timely issue in the realm
of biomedical science. Mutations in the genome are the root cause of many
diseases with significant global mortality rates, including Alzheimer's, cancer,
diabetes, cystic fibrosis, leigh syndrome, and others. Theoretical and explanatory
approaches to predicting genetic abnormalities have been developed through
prior research. Genetic data has expanded to practically include the entire genome
and protein, and methods based on deep learning and machine learning have been
created to forecast genomic abnormalities in response. Concurrently with the
introduction of machine learning techniques, deep learning methods also
emerged. Studies on the forecasting of genetic anomalies have previously
employed a variety of learning strategies, including supervised, unsupervised,
and semi-supervised approaches. Most of these studies used genetic sequence
data to make predictions about binary dilemmas. These methods produced
dubious results since they were less accurate and relied on binary class prediction
algorithms, which ignore the pasts of individuals with genetic anomalies. The
majority of the approaches relied on RNA gene sequences, which led to frequent
issues when dealing with auction data. Here, we use the XGBoost Algorithm to
foretell genome multiclass disease from a huge dataset utilising an advanced
genome disorder prediction model (AGDPM). AGDPM outperformed the trained
XGBoost Algorithm in every category, with an average accuracy of 92.65% in
both the training and testing phases of the study. Therefore, the state-of-the-art
genome disorder prediction model can reliably predict genome disorder and
analyse a large quantity of patient genome disorder data thanks to the
incorporation of a multi-class prediction technique. Multiple statistical
performance metrics demonstrate that AGDPM may accurately predict diseases
caused by a single gene, mitochondrial genes, and multiple genes. As a result,
AGDPM will help biomedical researchers manage mortality rates and anticipate
genetic disorders.
Keywords: AGDPM, XGBoost, RNA, Deep Learning, DNN, SGID, MGID and CNN
1 Introduction
It is estimated that almost 2,000 different human diseases can be traced back to a
single faulty gene, making them monogenic syndromes. The underlying genes for each
illness present themselves in somewhat different ways, resulting in a wide range of
phenotypic manifestations. Therefore, establishing phenotype-gene correlations is a
crucial biological activity that aids researchers and medical professionals in
2 Objective
The AGDPM used numerous statistical performance parameters to predict the results
of the multifactorial gene inheritance disease simulation. Furthermore, genetic illnesses
might be multifactorial, which means that genetic factors contribute to the development
of only a subset of the phenotypes associated with the disorder. Diseases with multiple
causal factors, or risk factors, include those caused by both genetic predisposition and
environmental influences. A mutation in a single gene is the sole cause of a single gene
disorder. The wide variety of single-gene illnesses is due to the fact that they might
originate in any gene. Despite their clinical distinctions, all single-gene illnesses are
inherited, share a common biological basis, and require the same fundamental genetic
and counselling services. the ability to make educated decisions about risk management
strategies and provide emotional and practical assistance to those who are ill, whether
they are young or old. It's associated with alterations in mitochondrial DNA that doesn't
come from the nucleus. There are between five and ten circular strands of
deoxyribonucleic acid that make up each mitochondrial genome. After becoming
fertilised eggs, they keep their organelles in tact. Therefore, mothers always end up
becoming the source of their children's illnesses. The symptoms of mitochondrial
disease are lactic acidosis, stroke-like episodes, eye abnormalities, and encephalopathy.
These diseases, which are frequently the result of interplays between environmental
and nutritional factors, may involve many mutations. It's sometimes called complicated
illness or polygenic disease. One complex genetic disorder underlies diabetes,
Alzheimer's, and cancer. An alternative to conventional methods of genetic prediction
is machine learning. Due to advancements in the area, as well as growing data sets and
computing power, deep learning has become increasingly popular in recent years.
These methods are useful in statistical genetics because they enable the identification
of interactions between several loci without the need to assume additivity and because
of the high dimensionality with which they operate, making it difficult to predict the
relative importance of various factors.
New advances in genomic technology have made it possible to acquire genetic data
with greater [Link] of people with abnormalities have been found in many
large-scale genetic studies, including those for MGD and SGID. Despite the mountain
of data our study has produced, pinpointing the specific disease-causing genes has
proven challenging. After becoming fertilised eggs, they keep their organelles in tact.
Therefore, mothers always end up becoming the source of their children's illnesses.
3 Related Works
New advances in genomic technology have made it possible to acquire genetic data
with greater precision. Hundreds of people with abnormalities have been found in
numerous large-scale genetic studies, including those for MGD and SGID [4, 5].
Finding the specific disease-causing genes has been challenging despite the abundance
of data from this investigation [6]. The fact that different disturbances within a single
disorder module often produce similar phenotypes, as well as the close relationships
between proteins and phenomena networks (where genes are appended endpoints if
they indicate associated phenotypic states), suggest that genetic information is
particularly useful [7]. connection between transcription factor networks and the
genome [8]. Furthermore, anomalies observed in interactome distant neighbours create
unique phenotypes [6]. There are methods out there for predicting disease based on
genes that take into account all of these factors. In this investigation, a binary support
vector machine was used to aggregate data from several sources. Binary learning
algorithms, both adaptive and maladaptive [10, 11], have been proposed as a means of
4 Methodology
In order to effectively treat genetic illnesses, early diagnosis is crucial for both
clinicians and the biomedical industry. In this investigation, we suggest AGDPM for
the early diagnosis of multi-class genetic anomalies. The training model of the
XGBoost algorithm and the AGDPM are used to illustrate the investigation's flow. This
method will use a streamlit framework to promote user involvement since it anticipates
output that includes mitochondrial gene inheritance illnesses, single-gene inheritance
disorders, and multifactorial gene inheritance disorders without the need for a
physician.
Modules Name:
• Data gathering,
• dataset creation,
• data preparation, model selection,
• analysis, and prediction,
• accuracy on the test set
• saving the trained model
Module Description:
1) Data Collection:
This is the first step in the real process of collecting data and creating a machine
learning model. This is an important stage since the amount and quality of data we are
able to gather will determine how effectively the model works.
Manual interventions, online scraping, and other techniques are used in data collection.
2) Dataset:
The collection contains 22084 unique bits of data. The 45 columns in the dataset are
described in detail below.
1. Patient Id: Patient Id with "Genetic Disorder" written on it.
2. Patient Age: The age of the patient or the user
3. Mother's side genes - maternal genes, whether or not they are present.
4. Inherited from father to father: Parents use DNA to pass on characteristics or traits
to their children, such as blood type and eye colour.
5. Maternal gene: Genes that produce or deposit RNA or protein byproducts in the
oocyte, or are found in the fertilised egg or embryo prior to the onset of zygotic gene
expression, are known as maternal genes.
6. Paternal gene: Paternal inheritance is the term used to describe any characteristic that
a father passes on to his offspring.
The measurement of the amount of red, white, and platelet-rich blood in the body is
called the blood cell count (mcL).
8. Patient First Name, which is the patient's surname
9. Father's name and family name
10. Name of mother and father
11. Age of mother - age of mother 12. Age of father - age of father
13. Institution Name: The hospital's or institution's name
14. Institute's Location: Hospital or Institutional
15. Status: Is the person or patient still living or has passed away?
16. Respiratory Rate (breaths/min): The brain's respiratory centre controls and
determines how quickly people breathe.
17. Heart Rate (rates/min): The frequency of the heartbeat, also called the beats per
minute, or bpm, is established by counting the number of heartbeats (also called pulse
rate, or heart rate) that transpire each minute.
18. Test 1: Is it finished?
19. Test 2: Is it finished?
20. Test 3: Is it finished?
21. Test 4: Is it finished?
22. Test 5: Is it finished?
23. Parental consent - Also known as parental involvement laws, parental consent laws
require one or more parents to provide their assent or notify their child before the child
is allowed to legally participate in a particular activity.
24. Check if fellow-up is at a high or low level.
25. Gender: Male, Female, or Indeterminate
26. Birth asphyxia - Asphyxia, also called asphyxiation, is a condition in which
breathing irregularities allow the body to get insufficient oxygen. asphyxia during
childbirth
27. Autopsy reveals birth defect (if any) - An autopsy, also called an obduction, an
autopsiacadaverum, a post-mortem examination, or a necropsy, is a surgical procedure
that involves a thorough examination of a corpse through dissection to determine the
manner, mode, and cause of death as well as to evaluate any disease or injury that may
be present for instructional or research purposes.
28. Place of Birth: The birthplace
29. Information about folic acid (peri-conceptional): Folic acid is a form of vitamin B.
It aids the body in producing new, healthy cells.
30. H/O serious maternal disease - Indicates an unanticipated result of labour and
delivery that had a major impact on the patient's mother in the short or long term 31.
H/O radiation exposure (x-ray) - Indicates whether the patient has ever been exposed
to radiation
32. H/O substance abuse - Indicates if a parent has previously struggled with drug
addiction.
33. Assisted Conception: IVF/ART - Indicates the kind of infertility therapy
34. Previous pregnancy abnormalities - any history of unexplained things in prior
pregnancies Certainly or no
35. Number of prior abortions – total amount of prior abortions
3) Data Preparation:
Compile the data and prepare it for training. Eliminate duplicates, correct errors, deal
with missing numbers, normalise, convert data types, and other potential clutter.
By randomising the data, the effects of the particular order in which we collected and/or
otherwise processed our data are erased.
Conduct additional exploratory analysis, such as visualising data to find significant
class imbalances or relationships between variables (beware of bias!).
separated into sets for assessments and training.
4) Model Selection:
After utilising the XGBoost and Support Vector Machine methods, which produced
accuracy of 98% and 80% on the train set, respectively, we developed this method.
XGBOOST Algorithm:
The regularised (L1 and L2) objective function in XgBoost consists of a convex loss
function (based on the difference between the predicted and target outputs) and a
penalty term for model complexity (i.e., the regression tree functions), both of which
must be minimised for the method to be effective. New trees are added to the training
process to predict the errors or residuals from earlier trees, and these trees are blended
with the original trees to get the final prediction.
Because of its high performance, scalability, and accuracy, XGBoost is widely utilised
in image classification, text mining, and recommender systems applications. Input
features used by AGDPM include data on genetic diseases.
7 System Architecture
8 System Architecture
10
11
9 Future Enhancement
Further genetic disorders and more prediction models can be added to this
study in the future.
10 Conclusion
12
11 References
1. Mc Kusick-Nathans Institute of Genetic [Link] Mendelian Inheritance in Man
Johns Hopkins University School of Medicine. Accessed: Nov.1, [Link]:
[Link]/omim.
2. B. Irom, ‘‘Genetic disorders: A literature review,’’ Genet. Mol. Biol. Res., vol. 4, no. 2, p.
30, 2020.
3. [Link], I. Sutskever, and G. [Link], ‘‘ImageNet classification with deep
convolutional neural networks,’’ Commun. ACM, vol. 60, no. 2, pp. 84–90, Jun. 2012.
4. S. J. Sanders, ‘‘First glimpses of the neurobiology of autism spectrum dis-order,’’ Current
Opinion Genet. Develop. vol. 33, pp. 80–92, Aug. 2015.
5. Europe PMC Funders Group, ‘‘Biological insights from 108 schizophrenia-associated
genetic loci,’’ Nature, vol. 511, no. 7510, pp. 421–427, Jul. 2014.
6. [Link], A. Sharma, M. Kitsak, S. D. Ghiassian, M. Vidal, J. Loscalzo, and A.-L. Barabasi,
‘‘Uncovering disease-disease relationships through the incomplete interactome,’’ Science,
vol. 347, no. 6224, Feb. 2015, Art. no. 1257601.
7. A. L. Barabási, N. Gulbahce, and J. Loscalzo, ‘‘Network medicine: A network-based
approach to human disease,’’ Nature Rev. Genet., vol. 12, pp. 56–68, Oct. 2011.
8. M. Vidal, M. E. Cusick, and A.L. Barabási,‘‘Interactome networks and human disease,’’
Cell, vol. 144, no. 6, pp. 986–998, Mar. 2011.
9. [Link], [Link], and H. Yu, ‘‘Network-based methods for human disease gene
prediction,’’ Briefings [Link], vol. 10, no. 5, pp. 280 293, 2011.
10. T.-P. Nguyen and T.B. Ho, ‘‘Detecting disease genes based on semi-supervised learning and
protein–protein interaction networks,’’ Artif. Intell. Med., vol. 54, no. 1, pp. 63–71, Jan.
2012.
11. P. Yang, X. L. Li, J. P. Mei, C. K. Kwoh, and S. K. Ng, ‘‘Positive-unlabeled learning for
disease gene identification,’’ Bioinformatics, vol. 28, no. 20, pp. 2640–2647, 2012.
12. A. Rishabh. Of Genomes and Genetics HackerEarth Machine Learning Challenge. Kaggle.
Accessed:Oct. 27, 2021. Available: [Link]
genetics-hackerearth-ml-challenge.
13. P. Han, P. Yang, P. Zhao, S. Shang, Y. Liu, J. Zhou, X. Gao, and P. Kalnis, ‘‘GCN-MF:
Disease-gene association identification by graph convolutional networks and matrix
factorization,’’ in Proc. 25th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, Jul.
2019, pp. 705–713.
14. X. Zeng, Y. Liao, Y. Liu, and Q. Zou,‘‘Prediction and validation of disease genes using
HeteSim scores,’’ IEEE/ACM Trans. Comput. Biol. Bioinf., vol. 14, no. 3, pp. 687–695,
May 2017.
15. H. Zhou and J. Skolnick,‘‘A knowledge-based approach for predicting gene–disease
associations,’’ Bioinformatics, vol. 32, no. 18, pp. 2831–2838, Sep. 2016.
16. Y. Li, H. Kuwahara, P. Yang, L. Song, and X. Gao, ‘‘PGCN: Disease gene prioritization by
disease and gene embedding through graph convolutional neural networks,’’ bioRxiv, vol.
2019, Jan. 2019, Art. no. 532226, doi: 10.1101/532226.
17. K. Yang, Y. Zheng, K. Lu, K. Chang, N. Wang, Z. Shu, J. Yu, B. Liu, Z. Gao, and X. Zhou,
‘‘PDGNet: Predicting disease genes using a deep neural net-work with multi-view
features,’’ IEEE/ACM Trans. Comput. Biol. Bioinf., vol. 19, no. 1, pp. 575–584, Jan. 2022,
doi: 10.1109/TCBB.2020.3002771.
18. M. Alshahrani and R. Hoehndorf, ‘‘Semantic disease gene embeddings (SmuDGE):
Phenotype-based disease gene prioritization without pheno-types,’’ Bioinformatics, vol. 34,
no. 17, pp. i901–i907, Sep. 2018.
19. K. Yang, R. Wang, G. Liu, Z. Shu, N. Wang, R. Zhang, J. Yu, J. Chen, X. Li, and X. Zhou,
‘‘HerGePred: Heterogeneous network embedding represen-tation for disease gene
prediction,’’ IEEE J. Biomed. Health Informat., vol. 23, no. 4, pp. 1805–1815, Jul. 2019.
13
20. K. Yang, N. Wang, G. Liu, R. Wang, J. Yu, R. Zhang, J. Chen, and X. Zhou,
‘‘Heterogeneous network embedding for identifying symptom candidate genes,’’ J. Amer.
Med. Inform. Assoc., vol. 25 Nov. 2018.
21. Y. Liu, H.Q. Qu, X. Chang, L. Tian, J. Qu, J. Glessner, P. M. A. Sleiman, and H.
Hakonarson, ‘‘Machine learning reduced gene/non-coding RNA features that classify
schizophrenia patients accurately and highlight insightful gene clusters,’’ Int. J. Mol. Sci.,
vol. 22, no. 7, p. 3364, Mar. 2021.
22. Y. Liu, H.Q. Qu, F. D. Mentch, J. Qu, X. Chang, K. Nguyen, L. Tian, [Link], P. M. A.
Sleiman, and H. Hakonarson, ‘‘Application of deep learning algorithm on whole genome
sequencing data uncovers structural variants associated with multiple mental disorders in
African American patients,’’ Mol. Psychiatry, vol. 27, no. 3, pp. 1469–1478, Mar. 2022, doi:
10.1038/s41380-021-01418-1.
23. Rectifier/ (Neural/ Networks). Accessed:Nov. 4, 2021.
24. Statistics#03—Standard Deviation and Variance. Accessed: Nov. 4, [Link]:
[Link]
9724f33b58df.
25. Softmax Activation Function—How It Actually Works. Accessed: Nov.4, 2021. Available:
[Link]
d292d335bd78
26. A.-U. Rahman, S. Abbas, M. Gollapalli, R. Ahmed, S. Aftab, M. Ahmad, M.A. Khan, and
A. Mosavi, ‘‘Rainfall prediction system using machine learning fusion for smart cities,’’
Sensors, vol. 22, no. 9, p. 3504, May 2022.
27. M. Saleem, S. Abbas, T. M. Ghazal, M. A. Khan, N. Sahawneh, and [Link], ‘‘Smart
cities: Fusion-based intelligent traffic congestion con-trol system for vehicular networks
using machine learning techniques,’’ Egyptian Informat. J., vol. 6, pp. 1–10, Apr. 2022.
28. M. W. Nadeem, H. G. Goh, M. A. Khan, M. Hussain, M. F. Mushtaq, and V. A.
Ponnusamy,‘‘Fusion-based machine learning architecture for heart disease prediction, ’’
Comput. Master. Continue vol. 67, no. 2, pp. 2481–2496, 2021.
29. S. Y. Siddiqui, A. Athar, M. A. Khan, S. Abbas, Y. Saeed, M. F. Khan, and M. Hussain,
‘‘Modelling, simulation and optimization of diagnosis cardiovascular disease using
computational intelligence approaches,’’[Link]. Imag. Health Informat., vol. 10, no. 5, pp.
1005–1022, May 2020.
30. N. Taleb, S. Mehmood, M. Zubair, I. Naseer, B. Mago, and M. U. Nasir, ‘‘Ovary cancer
diagnosing empowered with machine learning,’’ in Proc. Int. Conf. Bus. Anal. Technol.
Secur. (ICBATS), Feb. 2022, pp. 1–6.
31. A.-U. Rahman, A. Alqahtani, N. Aldhafferi, M. U. Nasir, M. F. Khan, M.A. Khan, and A.
Mosavi, ‘‘Histopathologic oral cancer prediction using oral squamous cell carcinoma biopsy
empowered with transfer learning,’’ Sensors, vol. 22, no. 10, p. 3833, May 2022.