0% found this document useful (0 votes)
12 views6 pages

System Design Masterclass Overview

The document outlines functional requirements for a real-time content moderation system across social media and email platforms. It emphasizes the need for high accuracy and precision in flagging harmful content, while also addressing scalability and latency concerns. Additionally, it discusses the architecture for data ingestion, processing, and deployment using AWS services.

Uploaded by

Rohan Bandekar
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
12 views6 pages

System Design Masterclass Overview

The document outlines functional requirements for a real-time content moderation system across social media and email platforms. It emphasizes the need for high accuracy and precision in flagging harmful content, while also addressing scalability and latency concerns. Additionally, it discusses the architecture for data ingestion, processing, and deployment using AWS services.

Uploaded by

Rohan Bandekar
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

FB) Mista/whatsapp (Mez)

Aguda-Social
media -

Youtube/google (mail)

Functional Requirements

ficient -
scanning -

Analyse
miages
tent
,
email posts
,

videos
,

↓ Harmfulcontent n pate spech , explicit


conte,
is

misinformation (GenA)

to Real-time
-
processing Flag homeful Content
-

Wout e second

to Reporting positive /false negatives


-
Use False

fi Moderation
content
dashboard
-
flagged
Let a sample
moderated
by
unlerators

requirement
Now
actional
precision (790 %)
D
e High
Accuracy
avoid overblocking
-

② Scalable -daily posts


③ Latency -seconds
② Privacy

officient
Guestinations
-

Fin
Datrage a

Depr 50 hours
-
-

[Link]

chatypt
- con

Pipeline
-
1

Social media
All

/SIM
,

email sever Processing pipeline


user uploced

3
Test Review
2 sentiment
-
claip text
Teatpost
T
good
Data
- removeSpan Analyser bad

positive
-

Tugeshou resize wig Muggingface


heral
entract
metadate [Link]
ne
Y
classification&sort=trending
,
↓ Amazon

a
[Link]

Sagemakea
An
[Link]
run small Code)
Ans
Recognition (defect explicit
-
- mage)
Vidus
model
Most the

Th Aws sagemaker deployment o


niference

Oh
A
Model
=
soft
Libraries

Anarydate (optional
Sing
-

Athema
Aus
-

wi
sentiment and
& I
7
>
-
-
NLTK NER
Inference (deployment
-
-

[ -
-
J =
clean the date

El -
>
- -

] .
[ Labels ,
Checka
A (free 2 paid services)
-

Metrics
-
Sdictionary u".
- Killa
bug
with morte
spray

Sa

leaving
formers]
[
based Machine
model

27 -
Research
papers
-

google bran

self
Attention
wan]
C
is
The

"
need
all
"Attention
you is
ML
[Link]

&
Arianstar moder
Y prett a lot
of
lent
tranied on

It was

to winipedia
is

-
Bos
Contin detection system
of Harmful
Architecture

Dale
source

Ingestion (AP2)

(Ans S3)
Storage
notebook)
Preprocess

/Lambda sagemake,

(preproced data Analytics


Store

↓ (Aus Anna)
ML
training- (saganakeIntiment analyses
Creditional)
Bedrock (Amantitan)
(lama) Facebook
-

mug face
-
>

Deployment Saga e

te

Dashboarding (Tableau /Power B1/Ams


Quicksignt

Posts bured---
Images
flagges ,

You might also like