Scribd
Upload
6 views2 pages

N-Gram Word Prediction Model Guide

The document outlines a procedure for implementing word prediction using the N-Gram language model. It details steps including data preprocessing, tokenization, n-gram generation, probability calculation, and model testing in Python. The result indicates that the N-Gram model effectively predicts the next word based on historical sequences.

Uploaded by

727722euai051
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
6 views2 pages

N-Gram Word Prediction Model Guide

The document outlines a procedure for implementing word prediction using the N-Gram language model. It details steps including data preprocessing, tokenization, n-gram generation, probability calculation, and model testing in Python. The result indicates that the N-Gram model effectively predicts the next word based on historical sequences.

Uploaded by

727722euai051
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

EX.

NO : 4 WORD PREDICTION USING N GRAM MODELING


DATE :

AIM :
To implement word prediction using the N-Gram language model.

ALGORITHM :
STEP 1:Data Preprocessing: Collect and clean the text dataset by removing special
characters, extra spaces, and converting text to lowercase.
STEP 2:Tokenization: Split the text into individual words or tokens.
STEP 3:Building N-Grams: Generate n-grams (bigrams, trigrams, etc.) from the
tokenized text.
STEP 4:Probability Calculation: Compute conditional probabilities of words given
previous words using frequency counts.
STEP 5:Prediction Model: Given an input sequence, determine the most probable
next word based on maximum likelihood estimation.
STEP 6:Smoothing (if needed): Apply smoothing techniques like Laplace smoothing
to handle unseen n-grams.
STEP 7:Implementation & Testing: Implement the model in Python and test its
accuracy with different input sequences.

PROGRAM:
import nltk
from [Link] import ngrams
from collections import Counter
[Link]('punkt')
text = """Artificial intelligence is the future of technology.
The future of AI is bright and promising.
AI is transforming the world with automation and intelligence."""
tokens = nltk.word_tokenize([Link]())
bigrams = list(ngrams(tokens, 2))
bigram_freq = Counter(bigrams)
def predict_next_word(prev_word):
candidates = {pair[1]: freq for pair, freq in bigram_freq.items() if pair[0] ==
prev_word}
if not candidates:
return "No prediction available"
return max(candidates, key=[Link])
print("Predicted word after 'the':", predict_next_word("the"))
print("Predicted word after 'ai':", predict_next_word("ai"))
print("Predicted word after 'future':", predict_next_word("future"))

OUTPUT :

RESULT :
The N-Gram model successfully predicts the next word based on historical
word sequences.

You might also like