Scribd
Upload
4 views8 pages

Document Classification with Sparse Features

The presentation discusses the classification of text documents using sparse features and machine learning algorithms. It highlights the importance of document classification in managing large volumes of data, emphasizing the use of a TF-IDF-weighted sparse matrix for feature encoding. The conclusion notes that machine learning and NLP significantly reduce manual effort in document classification, though the codebase remains unavailable due to data sensitivity.

Uploaded by

208r1a6773
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
4 views8 pages

Document Classification with Sparse Features

The presentation discusses the classification of text documents using sparse features and machine learning algorithms. It highlights the importance of document classification in managing large volumes of data, emphasizing the use of a TF-IDF-weighted sparse matrix for feature encoding. The conclusion notes that machine learning and NLP significantly reduce manual effort in document classification, though the codebase remains unavailable due to data sensitivity.

Uploaded by

208r1a6773
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd

PRESENTATION ON

CLASSIFICATION OF TEXT DOCUMENTS USING SPARSE


FEATURES

Under the guidance of


Mrs . Sandhya Reddy
By
[Link]
&
team-12
Outline of the
Presentation
 INTRODUCTION
 PROBLEM STATEMENT
 OBJECTIVES
 METHODOLOGY
 CONCLUSION
INTRODUCTION
 Even in today’s technological era most of the business is done
using documents and the amount of paper work involved will
vary from industry to industry.
 Document classification is a process of assigning categories or
classes to documents to make them easier to
manage,search,filter or analyze.
 It is an example of Natural Language Processing(NLP).
Document classification comes in handy to automatically sort
articles or texts and route them to a relevant team.
PROBLEM STATEMENT

CLASSIFICATION OF TEXT DOCUMENTS


USING SPARSE FEATURES
OBJECTIVES :
An approach to classify documents and the paragraphs within
the documents using text classifiers with Machine Learning
Algorithms
And other techniques.

This uses a TF-IDF-weighted documents-term sparse matrix to


encode
the features and demonstrate various classifiers that can
efficiently handle sparse matrices.
METHODOLOGY
Loading and vectorizing the 20 news group
text dataset

Analysis of a bag-of-words document


classifier

Model with metadata stripping

Benchmarking classifiers

Plot accuracy,training and test time of each


classifier
Findings
 The domain we considered for the project is to look at the
documents from organisations rely on different ways to
collect,classify and store data to perform further analysis.
 However,it’s highly impossible for human agents to
manage such large volumes data or documents.
 It not only helps us in saving information but also helps us
find these documents whenever required. It applies
intelligent techniques such as Machine learning and Deep
Learning to classify documents automatically get these text
patterns and categorize the documents and the
corresponding paragraphs into the identified categories.
Conclusion
 Machine learning and Natural Language Processing has
been doing wonders in many fields, we see first hand, how
it helped to reduce the manual effort and automated the
task of Document Classification. The solution is not only
fast, but also very accurate.
 Because of the sensitive nature of data used in this
process. The code base is not available. I will rework the
codebase on some dummy data .

You might also like