lOMoARcPSD|35954677

MLT unit 2 notes - ...................................

Machine Learning Techniques (Dr. A.P.J. Abdul Kalam Technical University)

Scan to open on Studocu

Studocu is not sponsored or endorsed by any college or university

Downloaded by hidden leaf (hiddenleaf1347@[Link])
 lOMoARcPSD|35954677

12000

• •
•

4oo-o
•
g lo
2. 4- '

T ff U. ~ ~ OA-1

~ f.S..t~ ~[Link]- R~t)\A ThAA ~ iv..JJ~e& tv\~

[Y=HhX+l.11
W~ © Yj.J fw hf e,wJ. eM,) ViAAi abLe Wt Wa.c.J to rruL c1 . (~[Link])
. 0 X iA -rw j ~ ~ \/Mi tLb2t LUuJ. f1> t p-ridl th' f;xA l ~o G)
G) a. Jh -+¼ i ~~ L Bl t<A.t ~ ~ Qj ~ vJM.t °I> y
-b d ~~ x .: oJ
l
0 b .i& +"'-t -U9f t ~ 1M. Ji ...e , ~ -
1 -Ji,,,
~ e . lV\ 1 rx
o.. 0\M, .t,u,J-i ~ e vtJVI x.
1
0 u .ii tw ~~ lli.W [Link],u,t , vJl-ticJ,,., ~ +tu. ~
J~ ~ [Link] c)j (91/l,.
Downloaded by hidden leaf (hiddenleaf1347@[Link])
 lOMoARcPSD|35954677

500000- 0

~5o oo o
...........

"100000
c1.
-.I

:$
35 b 00 O 'O :E
3000000
~ 2500000

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

YI ( S41u. ;., ~Y
'

Xl (Jve.u)I
I /·l
2. I. g
3 2,J
+-
s
J.2
3, Q
-'
Iv~ att ~
Th.,vu ON 5 j-J-U¾& J.e ( ~ I, 2, 3, Lf, 5
91,t ~ ..M .-0 ~ "1 b~·
X1 y,- { XJ)
l.
X.,i · Y./
I I· 2 I /· 2-

2
I· g 4 3.c ..::,--

2-t q 7-~
3 ~ ,2.~
-..... 3.2 It
-4 J
3, g L5 17 .
5
1 Vi= 12·'
z. Cx i-J1-; 55 '2 XL ~t = 4-4-- t1-
Z.'1-{: 15 Av-,: 1
- 2
41 1 ~xi J,·
'1 ,Xt5 - 15
Yr -
= 11· i
.. .,.... ~ ~
i(Xc)
.. 5
5 --
-X -- 3 -
~::::.2.-52..
2.
(X e J == I }
44-- = P.g9
5

-
b =(J'tr)- (JXy) g. gg _ 1 1-2 · 52
- - 2- 1I - 1
lX riJ - Cx ) Y

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

4-t ~~ d +w Ydhtfi~f a,o [Y = f:!._.-1- ~ X I

'¾ w"::[Link].t
P-'u-4.r d-~ 7"" w~ be wt..u,, ITJ
I
1= D-54- + ·O·UX1
l = 0-5+-f ~.c.2..
I '1 == 5. " 7 ½-- .
'¾ - p

f rulJ <-tu I21-h """""' MBt,c/--1.,_ , I·

1 = 0 ·54- f O,t.,x IL
1

== 0 •5lf-,. 7-j~
~== g.l-f, ~
.J

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

~~ ' ~°:: ~. ,-H,, c fo1~1

-'; \ I I •• I

X ( 2, >'I g ) ' y ( 3 7, 5 I IO )
0

Lf I

'
' I
X ,y x2. X1
'
+
'
l
2 3
I' 28
4 1- I \ • ( ' I
'
3! 3"
5 "
~
'
~ I t, ' , . f ·, I
,I II 1\
go
i I\
j
' I ) '

'
I

I
\

<zx = 2-,., 22- iX 2 .:;/2t, f. X y=: v1+

'z' = . I - I \ (
l . \ I, I,
'
4 I \ \ '

'b = h(~XY) - ix 1 'f • I

YI c~x 1
) -(~X) 7. ( • • ; ' ' ,' I
I
I
\ 1 t
\ ' ., I I '

I I l .- \ I . I

=. 4 { 1+4) - 2o X 25
4- ( 120 ) - (2 O) l. . .

5 7i - 5bO _iL 7l :: Q .'f 5

::: fl, - 80
4-&o - ~ 4-oo

a = ~-Y) .( 2 X2 ) - (~X) ([Link])

[ Y>(2Y: '") - U")'"J

-- 2.5 ( 120 ) _ 2 o ( I V Lf )

y (1zo) - (2°)2.
1
-- j O b t, - 2_g g 0 ~c/ -
-- Jty; /
__..
2-
2
-- I· S" L
4-Bo - ~rro
Downloaded by hidden leaf (hiddenleaf1347@[Link])
 _...
41 ,., •
lOMoARcPSD|35954677 ~ - -

No

2 4- 2

oLu1u,J .

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

Difference between Linear Regression and Logistic Regression

Logistic Regression
Linear Regression

y=l •-
a,
::cra
·;:
.....C: Straight lin ~
y )-Curve Predicted YLies
QJ
"O
Predicted Ycan e:oeceed c QI
y
within
C:
Q.I
Oand 1 range "Cl
C:
0. QI
0 i:in:l 1 rJ ngc
l1J n.
a QI
0
~ Y=O
• y=O "'-~- . - ~ # - ¢- C'-"9>--- - ·

X X
Independent Variable Independent Variable

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

line ar R . Logistic Regression

egress1on

Line ar re . . Logistic Regression is used to predict the

conr gress1on Is used to predict the
set categorical depe nden t variable using a given se
of in~nuous depe nden t variable using a given
epen dent variables.
1
of independent variables.

line ar R • .- - -
solvi ng Regr essio n Logistic regression is used for solving
Problem_egress1on Is used for
Classification problems .

.
In L.I
~ear regression, we predict the value of In logistic Regression , we predict the value s of
cont inuo us variables. categorical variables.

In l_inear regre ssion , we find the best fit line, by In Logistic Regression, we find the S-cu rve by
whic h we can easi ly pred ict the output. which we can classify the samples.

-
Leas t squa re estim ation method is used for Maximum likelihood estimation meth od is used
estim ation of accu racy . for estimation of accuracy.

The output of Logistic Regression mus t be a

The outp ut for Line ar Regression must be a
Categorical value such as O or 1, Yes or No, etc
cont inuo us value, such as price, age, etc.

In Logistic regression, it is not required to have

In Line ar regre ssion , it is required that
the linear relationship between the depe nden t
relat ions hip betw een depe nden t variable and
and independent variable.
inde pend ent varia ble mus t be linear.

In logistic regression, there should not be

In linea r regre ssion , there may be collinearity
collinearity betw een the independent varia ble.
betw een the inde pend ent variables.

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

(f)
"-
-rP 2.o 3o

f(8)=~ ::::.o·3
p (A) /o o
P(AfltJ,) 2 :: o· L
:::_!!_
"""'\ f(AfB). l'fB) = P(flnB) 100

P fB/A). PIA) =- P(BnA) P(Aff3>= 0 -2 ::o.,-:;

o·]
R..u k JiWvl.t .i.-i bo~ ~ , . ~ .

f(lln8) "'p(A/8)- P(B) = PCB/A) · f(A)

pAt 0.)\. It ··) ~o+~
f ( A( B ) = p(BI A) . p(I+) e~ ~·a~/¼
PCB)

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

e I

~ ~~

~tt ·-~[Link] ~ b u tw [Link].ti4< 9i flM ~e,..t btUe.d 9\1\

fbtio" i, •. _ , .. ,
~ . ~""~ e 1 ~-H~ [Link]<J -fo +kl [Link]:.-1,U .
~ ~.Ptvru..l ~-~ Q.D

PC~ I ~) ~ rA) . [Link] J

=- p

~ - ~2
•
3•
PJ..iM.t tJo t P) l
; ' ~
Md Ne (o) J
p (P\o) :: P(DIP) · P(P)
. P( o)

f (o) :: .i. .. o ·5
(O -

P(olf)::. 3/y
~(-f);; 1L
Ic

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

.
.i.& +w plOvCVD 111exnro 0- ~fl<,,. ~
JJda j vi bupelWlJ> ~ LLJvtw 1 .

s~ A .i -r 1 ~ ~J11 w ;~ w~e,\., ~ t E~~S

.,/

Su.11wa
rorl
vJo.A,WJ tJ~ Wo>tW7 ~
2.
[Link] WQM,M. 1~
3 ~ s~
\
Rai ~
-i,
4 ~L t.~ w~ ...ur 5
\NCIMM,,,
(-O'QJ

hu ¥\Je.¾_ ~ ~ u J ;; & ~ w kt N T&1M'~

' t- 4 ~~
/J_
u j '1 ~
[Link]- "fO.U ..i.& Jte,U>)"lte.4
[Link]... LB\AAt+i """' . Tl ,u
r h -h, .
b Muf
tW e,u,,,1 IM
01A

w d, e. ,r
V t: W ~
ww
le-vvJ.l ti ~ 1 9'\IYl ~ w '-4 d« tr o.,J ·
A+[Link]~ 1-- -,1,u,{Y \} ~ U

~~ - : glU1 ~ ' [Link]~

, Ai<le<Mf : [Link], C
hi.
~ d l 7 ·. t J ~ '· £.ti'f-
vJliAA ·. _5 ~
[Link] ~ w~ ' u-oJ
~l: StUMe, ~ e
f: "":\,~frMi ·. L,.Jtui,t eb
~ e -< tf .u A ) t,[Link]
w ~ IA .t f
IAl«J<e-r Spart-,& T91M.. ™J°1'
'IVlAh . P tr o i~ \Jdh.
.e.& ·. ~~ , tJo. -

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

~
- ~Low l..luw 1 .C,·vu! s ~,-;,,,,,,, -
r [Link] 4 -
L
I

+aJc ~ Af+,,-ibufe

No ~ ~o~ v/JhLe
~{
~--::,, _ _
_ _
--L .
. . _ _ __

( ~ . .if [Link] ~
Vcdtte

) ~ -h, ~ ol- k u w. ()(" ~ )

.,(

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

I - ~ - - - · - - - 11 --- -

•
---. Protvv.)

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

r~
.(1) ~+i-ft.'
[Link]-i~ I
.•

~tw • ' ' 1

a.o W-t +!A. tw w ~-1 ,.<,p wf ~ 41otf.U4..I.I , w1M cJ.< 1•u: .:tt.O_k
·~.,, - a
~ lMA-y
&~ ~ 0
1\1\.A~ .
.
~ : cswi~, Wa>.WI, I l l ~ , ~ · w~, SaMu-)
Ci) Cn ~ -zj-1'9\A, .

\ ~d.tle_ +w . !Mff otf,.Ul.!A -lo ~ - u li (JJ,. rv-,ol't. ~ ,

- ON- tev\.&lclextJJ . ' .
11 f tl,c.t ~ ..U [Link]-1\J -e. (' !?i~ Sport =l(~) , ftM,lltAliu

~ tutti)~ -k, ~ ~ ~ -

® ~tW-11 ~o+wU() -

f>< ~ pP'M-f-illt ~ , updfttt ,j,w ~l)f/.!.Q,a.,i,O +t,

-1w· J..!w ~ 3w..tAA.ii1,.ti'°"' -iw:I .Milt ~ -Jw

·7. ~
.fot e_,w,t ~ l i e ~ 1 ~ .j1,., ~0~ d,oe,,

t\l)t ,vwcLl +w 7'"f ~ . .

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

• ~e el1M1~ JMtpo~ ~ ,~fw;I lAii~ ~

~ -h11-t'~~ ~ ·
~ Tkf Ve>iJ!OV\tprw ~wu ~ [Link].t ~ ~ ~e..J ·

(D O1Atpu:t +w .[Link] t ~ ~ [Link] I ~ VVe.& I911 spa-ct .

•
•
•

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

. ( \JVUi ~ ~p4Gl) . .
~f1Vlll ~o~
1
.i~./c4½( (~u~~, ~ ~) 1 ([Link]~,#Jo~

~ I -niJ ""[ , /,tir )

I I ( )-a,i'cf I k' y,-) I ( n.1.i d ) y.J~n-v,~J)
(~~I ?) I ( ~ J t.J(;WVW ) / (~ J J1.t'r) I ( ~ ?) . .
Tr«-l.,._i E~~
~ 1eMJ ~o ~ ~ s 14 r; ~

c Sun 1 , r J{ r ?, ~ ) f'..
~~,
~4).4.
r LI tJ
i

~ 1 ½fo~ cw 1~f~ .

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 ~. IcwucLW w:.u ~·~ ~¼ ~ I
lOMoARcPSD|35954677

G) ·r
~ ¼ + ir u. ii. e -tl<I ~ ~d-J. Ct,o aMA ~o
(AMA ~r W f'c b w w l~ - -
"to->t. [Link].. p«l&i+-1ve ~
11-\we fn-- spWf c ~ ~WW
W W ~ aU Va.luf6 61,
q~ ? ~ -h-ru'w' ~
@) +o-r e.w,, - I) ' ~ {W ~~
~e ~ ~ +o srWfic
?~ ~ IA J~ ~ 1/aJ»_e f nw i
~ -h·[Link]'d W-a ,i,,. IU U {J ~ I

~ H 11-<1 ½(,.,.,JuWe LJ.,; Y\'U....a;h'

11-p p
/IU. [Link] J<i-U, '°' --/--o ob-kti VJ
~V\.AJ ve,u;.,., .Apw fo, fo1~1 +I,,. -m,,;IA-<·a [ ~

flf'' f+1 r 1eAMf ~J,J~ wJ~ WMet +ort-UVJ

i ~

S u" '~ WMWv tv o ~ s· t,""- iJ.

IO [Link]) Sa..v,.,,.e
\j ~t.1
vJ ().J..,,w., -
~U M ~ \., {J ~ ~~ WMM.\. y~
- - - ~Q ,Vv \t

'(?U1
\

W4 1-<1~
~~ \[Link].
~r Mo
[Link] W4'1.,wt
I
(,Uf ~~ - (£OJ
'
~t yVJ
I

Downloaded by hidden leaf (hiddenleaf1347@[Link])

 lOMoARcPSD|35954677

1 ? 7
-r
L. • ' '

tJot
~ ltkAt)fet

[Link]~ W(l)(MA.. \-tit s

Ki
"+t
~ vJa.X-W\ ·
~

Downloaded by hidden leaf (hiddenleaf1347@[Link])