0% found this document useful (0 votes)
8 views18 pages

Machine Learning Techniques Overview

The document discusses various machine learning techniques including regression, decision trees, ensemble methods, and dimensionality reduction. It provides brief descriptions and examples of techniques like linear regression, logistic regression, decision trees, random forests, dimensionality reduction, and more.

Uploaded by

karim_bude
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
8 views18 pages

Machine Learning Techniques Overview

The document discusses various machine learning techniques including regression, decision trees, ensemble methods, and dimensionality reduction. It provides brief descriptions and examples of techniques like linear regression, logistic regression, decision trees, random forests, dimensionality reduction, and more.

Uploaded by

karim_bude
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

ak'ne igring

Reof aastiente
to cnhanta
evoy Statisi Ca tethnigues
lemo yma nte base on
o oia
nove lamsns
M
Reinfos(ement
unsurevise
sufenisel. amin
Laning Moder talke altions
tyming mocei rolniny in eriyorren hen
LaLen aa era

Regecson
(ogittabon

Ayent

heißs ans we & he qUertior.


change i Y
ho charge inhuerer

Simple ingar Regosion,


bil a delenten t vasabe
vaiable
one inletenlen

ar

b)e s Lole OF ine

Enoo/pe:io te > obsenve Vevve (Y) -foecn vare(Y)


oodiray
Vegoegion mole toier

Sragbt tine:

blw ad
aey-b*

nupie
a
leleoent van osie
'mohpie' idelenbeni
hen) 0ne indelenbent
one

bert tine
y Reys ess ion Cocf o elesa
R-sgvorel (R2) ,
oo'moler evalvaion
minoion

onry
sim re
bla
ranges

hlgh er
z(y-9)
odelerle vaniaber inctot
AJing (f chone o.0
Vanabie

Unnetesf ay Re vaue
A noler. coit higher
pefesxe in ML.
on
Asotion
xEvavaion matiy

mpan AbsovH
MAE :

mCan s2
y Root
g-y:
4

emoo (MAC)
Mfan aborwre enderen
Coet

aeiage
(MS
Amse

bpunsaes

even
Rmse
inWrpo erable
belawse it

nolienr pescent
he
fontion
by erming gual:eo (ost

the

groden des rent


AS UralWon

Nomadtt
bwdelodae

choc

tpf at on fautoy (VeE) a way


Va an (e
Cheus fo
above
castEtaMon
R
eguess i on

Ytgvesion
pecision

Svalvati on mhiN - AruYau,


evcuvaton Meric
ot
eylr Ptdecing saloy
Gnpoyees
(1ogi mo ben)
(oges ic Regsssion

simi1an

logithe
sigmoid ANntlon!
Snlon
a matemaiu
ho mobabiit
prdtod vasvg
abich Pelica

(osion

foi ve taut (F PR)


negaDve Yat ( NR)

FN R faso
A(vTay
Vavatiorn

Ireeiiiy

ASSUH'ons

perendent vamable
Obsewaon
(v0Ss vaidoion

A eseaming
(Yoss vuidaron

Taning se
Hylerig.

Hyfesfaraers Bestbylexiarprgos

moler
ha'niny

Dctsi on

*Root nale
Oecision noe
Leaf noe

Pouning!. deph by, tdoing

banchef of deci's iorn

vlre -fsoning
los- Puning
in decision Toeet
a1goimm

(HA 8D

ey cmlure
EOYORy:

Gaserble
tombine sQvetal ba e moles

o1de
roler
oyfes ensembo

Ba99in 9
Bo ajihg
Stacking
Bagsing simitaro mean of
polu toore en
prdichionc

Sybse a
o bsewaong.
das a'ses ai

random
be sPiit
GHd on
the
avercying
origino
bootnatle/ dier dataies.
int
datare
Avenege
both

random

Eees inro9es,

Sloa
inetfe Ci ve
targ
fovS
decieion tre.

ooaent
Seerol

a
[Link]'ent
bale on hSSa
boosingcgatm
onneires hyadiiono. graomi
"ohniigue.
overfiring
2ato
pro resçing
Hanliing

sule vised aMnh

Non Par amchic


seleCA

KNN
bared on

J'sare no of' Jora fonsin

nC ater
assio nymber

mole

Machinc
'Sselifor claegitorn

Tegsesion
bate?
SUm

near nooin

Radia
mahine

use in uns lenitom)

(ue
or pimeti onaiy!.
nnning Aine
ovorfi ntin 9
Dmengiongily Aeoutiont, o

(op

Shorae oys

lertommae

arcording
to

data. sfocit
Unclori6e
infm ati on
exttUi e, ovelaflng,. hiezavia!

oveslafing
H6aschi cal
Poobabitighc

nksae
bntatuSe6
ogtan donts
ychram hie
te
memo! silhoutbo
ofk noi chooso
Coth of
seleaing by
Jesa
been
,he ASign V
Poin chooso
'oe oath K
(ent
OF no
centoi y
inlo data ML
sulerviro un
SForce hat man
an
4'
inkote cinge
Parta a P
dunlost
seabom a sos
mapot
foom

("tiPs )
toaddataset
sng:
* df
Umnsr[Sex
+[ rokee
"tmoker'
(dr,col vUmns
dummieg dool.
dt Pget- "day" 'bime"],

coin
# ger ummies eXamie
analyis
ger. dummig
hen

Sefemae.

JEhead)
"eie"aris\)

Toain Test r tain. test-sPlit


SKIeasn. madel-selec Hon
Foom
test = tdan- test. sPit
testy Y t8ain, y.
toain,x. Stt o)
to test-siter O 2, 0and om,
(* y,
Model tsaining:
SKIa0 tineas mode ! inoTt inea Pegrerfo,
Foon

clat! betaute s Emildle


8LR is an objcct .

6,f. (ineas Regoession t )


LN8
Ln. it(*athain, y-toain)
Jata'
88eice (xtest)tyste
y-redrlns. ,

y-Psed
-test
y
imPoðt mean.S aoesiesA
[Link]
(y-test, y-Poed)
squase- sos
as mean-
Pointta)

SKleasn mersics imfof 2,-Sco


3eo
Point (82-s(o8e ly-testa y-

L'sPecies".Value- ovntt ()
de
"setosa")
df dflJEC"slec'es")! set
ol#oernçyng seto sa From ata
de [^sPeties "). Vave_toont t?

*label etobing he funtHon


en oding is (mal, abelen todes)
*d {" ve ssi to lo8"o, "viogini ta":}
# Ths is bina clas clogtifcab'on be (ause ,it contirs
0 and
AHng oom Categust o pubien'ty cdlu herf in ana ysin9
de ("speies",maP(d)
4 AF('secis"].
dfheadt)
esPeties" , a x !e)
(oluMo
# *edfdo o
y AF['s fe cies") i
toain bet it i fout ypesk- fo
# cboss validation ocv, K-fo
Starifie!
mehod, LoocV,
# holo Out
asn moel- serecHo n
Skie tvain, testSfit
X- boain,xtest, Y.t8ain, tesr .
ter 0:25, bandom -Statt o
(<Y,[Link]

X test
t Y test

¢Fdom
Skeasnineat- mode iRo ig tog'sieRgorsson
LO9- logi stickigoession
Log.-fit (x-tsa taain )

Aftes toaining evavate male


* -poed : (09-8PBedict(x-test)

w!smse ,mse,mac,
egyserion,
# metoicsr tine að a(ivda(y, detur , Potessoil,
matolx,
t metoicS- Confusion
Smlot confusion matolr,
sor
a tuta cy-s tode, seisi onStoreeau

tesr,y-PoedD)
* Point ((onfusien . matsx y.
(y test, [Link]))
&oint (attuta(y-SCose
BC(all- Stose (y test, y- oeo))
sPoit ( aing
A#ahern volve n difeycnn, 7ange - fare

tain , y.t8ain - molei taaining


.
CHon
x-test - Poedi
toaining inPost Randon Foses+ Clatife
[Link] sem blo
FoOm
RandomFosesClaesifiex ()
sf a
y-tsain)'ont)
f:fit (x tsain,
evalvelon

u`ing cbnfusion,, matoix


fsom skleasn
imfo., metsig
fed)
Poin (metocs, confusion matsi (ytest, y

# BF data ser
Is balante go
o heraise-Pecislon
seote"J valve-counts ()
4df"ba t di
we go with artut aty
diffeten (e
The
(y-test)
l08e
Poin (met (s. attusary
Hente its molesat (<i)
hold oU ehol)
4 20- 80 we
Varaon. techin fahoex.. m@hob os anaye!)
# CoOS
imPon

VouF (aOsSvau Stode (of, X,y, stoing:'arturay


cooSs-
cV:5)
HXf-mole, intelenlenr, y-delen ert
(oosVal
SkIea3n Psefsocessing imPog iomaxslale3
nme Min a Scaerc)
(Xo toain)
Var oese nmfit kàanseorn
pataFrame(slared.-vales
Staled-t8ain: P
x. tolumns)
(olumns t x.
[Link]

t3ansfom(X-tes)
valve(+D
SColed. test
* SCapd, test Values 1

tafsame (staledtesValus
#* Slale .test P. pa (olumnst x.(olumn

neighouo corfey
#model toaining usnq koeaver
[Link] imPout kNeghbons ClassiFe
*Foom
KonsKNeighboxs Classfiesc)
fie (X-stel ed- toain , y-tsain):
Knn
# eValvat
bic. .s(ae-tes)
Y-Poebi kno Poe
tutary Slobe ([Link], y. poedi)
Poor ( metaics. a
data
# coeaing syn hehc
datasets imfotvmakectqIfiaion
*Foom SKIeaxn
cias?heowon (0 Samiess lo0o, n. Feaises2,
X}Y make n,clusteas feo clas2
n-ClagseSr 2,
n-aedunbatt: o)

PataFtamo (x)[a)
Pd.
Pd. Datafoame (x) lol,
* sns. SKattesflot (x
"ypJ. Dataf:
SKIeaso. podel elpChon Imlo bocin -test. sPE
foom.
[Link], y. todh, [Link][hA 6s ain test-sPit
X-tDain, -Staeois)
sitero25,0ardom
Wfom
(y, test.
4

Yatrain)
YsVe fit (x. boain,
k
[Link] (X stesk)
Psedr clatsiiCason ePost
12
snofo
_ma tolyaftqtaty stoe
sonfusion
sélót (y-test, y- Psed)
Fitah'on-eRöst
(crarsiti
lor y-Ped)
(coDfusion, arix (y-test,
(y-test yfreH)):;
atrusacySore
piO} (
#hylesfocaineteð4ning
l- SeleHon iengotnod SeazchcV
foomtSKO?: mode
pdefnin9 PatarekYng
fasam-ga'd'e':[o', lo, o0,loöo
Sg'ammtte,orol,o-oo, oro0o .

S, vesbojpc3)
usam -qsid, sfit730e,cvs

Foom Skiasm,molel selecHon imfo d Saothcv,


Foom SKlaon Sum
#ASSUming you ha ve Jerne Pasam. gq id in
hyPeo fosamerèg yo want o n
koam - gaid:''oiy o]. keme: ina,
bbr)
[Link]. linfon
x9boost F0m
tandar
o)oSa o2, s'tes test- (X8,
tain dosa the
tai omai
on Al 4
togesH
ane
y, sestalng'
we
in
Valves when #
ing slal Fea 3aNge iftesent
estypdd)) (Yo som(ortubaty- Point
onsion Point(
teat, (
[Link]
atfon evalu
best-Pasams goid
On
esimatoa
fo utebest. can you
essmaot best
esHmats godbest- best goid:
best_Patams
asamst'
best
BeAcess
[Link]) ain, (x.
toqoidt
toaining
caa
:3)vesbose
obcoseoxchCV enaid

You might also like