R for Data Science Lecture 5
Chang Liu
R for Data Science Lecture 5
Contents
Regularized Regression 3
Ridge penalty . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Lasso penalty . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Elastic Net Regression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
K-nearest Neighbors Algorithm 46
Decision Tree 49
Bagging (extension: Random forest) 53
Unique Value 56
Length 57
Gsub 59
sampling 61
Stratified Sampling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
Cluster Sampling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
Systematic Sampling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
Chang Liu 2
R for Data Science Lecture 5
Regularized Regression
Linear models (LMs) provide a simple, yet effective, approach to predictive modeling. Moreover,
when certain assumptions required by LMs are met (e.g., constant variance), the estimated
coefficients are unbiased and, of all linear unbiased estimates, have the lowest variance. However,
in today’s world, data sets being analyzed typically contain a large number of features. As the
number of features grow, certain assumptions typically break down and these models tend to
overfit the training data, causing our out of sample error to increase. Regularization methods
provide a means to constrain or regularize the estimated coefficients, which can reduce the
variance and decrease out of sample error.
Ridge penalty
library(tidyverse)
## -- Attaching packages --------------------------------------- tidyverse 1.3.1 --
Chang Liu 3
R for Data Science Lecture 5
## v ggplot2 3.3.6 v purrr 0.3.4
## v tibble 3.1.6 v dplyr 1.0.8
## v tidyr 1.1.4 v stringr 1.4.0
## v readr 2.1.1 v forcats 0.5.1
## Warning: package 'dplyr' was built under R version 4.0.5
## -- Conflicts ------------------------------------------ tidyverse_conflicts() --
## x dplyr::filter() masks stats::filter()
## x dplyr::lag() masks stats::lag()
#define response variable
y <- mtcars$hp
#define matrix of predictor variables
x <- [Link](mtcars[, c('mpg', 'wt', 'drat', 'qsec')])
Next, we’ll use the glmnet() function to fit the ridge regression model and specify alpha=0.
Note that setting alpha equal to 1 is equivalent to using Lasso Regression and setting alpha to
some value between 0 and 1 is equivalent to using an elastic net.
library(glmnet)
## Loading required package: Matrix
##
## Attaching package: 'Matrix'
## The following objects are masked from 'package:tidyr':
##
## expand, pack, unpack
## Loaded glmnet 4.0-2
#fit ridge regression model
model <- glmnet(x, y, alpha = 0)
#view summary of model
summary(model)
Chang Liu 4
R for Data Science Lecture 5
## Length Class Mode
## a0 100 -none- numeric
## beta 400 dgCMatrix S4
## df 100 -none- numeric
## dim 2 -none- numeric
## lambda 100 -none- numeric
## [Link] 100 -none- numeric
## nulldev 1 -none- numeric
## npasses 1 -none- numeric
## jerr 1 -none- numeric
## offset 1 -none- logical
## call 4 -none- call
## nobs 1 -none- numeric
Next, we’ll identify the lambda value that produces the lowest test mean squared error (MSE)
by using k-fold cross-validation.
Fortunately, glmnet has the function [Link]() that automatically performs k-fold cross vali-
dation using k = 10 folds.
#perform k-fold cross-validation to find optimal lambda value
cv_model <- [Link](x, y, alpha = 0)
#find optimal lambda value that minimizes test MSE
best_lambda <- cv_model$[Link]
best_lambda
## [1] 13.27979
#produce plot of test MSE by lambda value
plot(cv_model)
Chang Liu 5
R for Data Science Lecture 5
5000 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4
Mean−Squared Error
3000
1000
2 4 6 8 10
Log(λ)
best_model <- glmnet(x, y, alpha = 0, lambda = best_lambda)
coef(best_model)
## 5 x 1 sparse Matrix of class "dgCMatrix"
## s0
## (Intercept) 470.705022
## mpg -3.280904
## wt 18.505501
## drat -2.468512
## qsec -17.298734
Chang Liu 6
R for Data Science Lecture 5
Lasso penalty
#define response variable
y <- mtcars$hp
#define matrix of predictor variables
x <- [Link](mtcars[, c('mpg', 'wt', 'drat', 'qsec')])
Next, we will use the glmnet() function to fit the lasso regression model and specify alpha=1.
Note that setting alpha equal to 0 is equivalent to using ridge regression and setting alpha to
some value between 0 and 1 is equivalent to using an elastic net.
To determine what value to use for lambda, we’ll perform k-fold cross-validation and identify
the lambda value that produces the lowest test mean squared error (MSE).
Note that the function [Link]() automatically performs k-fold cross validation using k = 10
folds.
Chang Liu 7
R for Data Science Lecture 5
library(glmnet)
#perform k-fold cross-validation to find optimal lambda value
cv_model <- [Link](x, y, alpha = 1)
#find optimal lambda value that minimizes test MSE
best_lambda <- cv_model$[Link]
best_lambda
## [1] 2.928367
#produce plot of test MSE by lambda value
plot(cv_model)
4 4 4 4 4 4 3 3 3 3 3 3 3 3 3 3 3 3 2 2 2 0
5000
Mean−Squared Error
3000
1000
−2 −1 0 1 2 3 4
Log(λ)
We can also use the final lasso regression model to make predictions on new observations.
#find coefficients of best model
best_model <- glmnet(x, y, alpha = 1, lambda = best_lambda)
coef(best_model)
## 5 x 1 sparse Matrix of class "dgCMatrix"
Chang Liu 8
R for Data Science Lecture 5
## s0
## (Intercept) 483.169999
## mpg -2.981768
## wt 21.029736
## drat .
## qsec -19.286215
#define new observation
new = matrix(c(24, 2.5, 3.5, 18.5), nrow=1, ncol=4)
#use lasso regression model to predict response value
predict(best_model, s = best_lambda, newx = new)
## 1
## [1,] 107.3869
Chang Liu 9
R for Data Science Lecture 5
Elastic Net Regression
#[Link]("dplyr")
#[Link]("glmnet")
#[Link]("ggplot2")
#[Link]("caret")
library(glmnet)
library(caret)
## Warning: package 'caret' was built under R version 4.0.5
## Loading required package: lattice
##
## Attaching package: 'caret'
Chang Liu 10
R for Data Science Lecture 5
## The following object is masked from 'package:purrr':
##
## lift
# X and Y datasets
Y <- mtcars %>%
select(disp) %>%
scale(center = TRUE, scale = FALSE) %>%
[Link]()
X<- mtcars %>%
select(-disp) %>%
[Link]()
# Model Building : Elastic Net Regression
control <- trainControl(method = "repeatedcv",
number = 5,
repeats = 5,
search = "random",
verboseIter = TRUE)
# Training ELastic Net Regression model
elastic_model <- train(disp ~ .,
data = cbind(Y, X),
method = "glmnet",
preProcess = c("center", "scale"),
tuneLength = 25,
trControl = control)
## + Fold1.Rep1: alpha=0.63950, lambda=0.004507
## - Fold1.Rep1: alpha=0.63950, lambda=0.004507
## + Fold1.Rep1: alpha=0.04530, lambda=0.016509
## - Fold1.Rep1: alpha=0.04530, lambda=0.016509
## + Fold1.Rep1: alpha=0.97420, lambda=0.004648
## - Fold1.Rep1: alpha=0.97420, lambda=0.004648
## + Fold1.Rep1: alpha=0.34773, lambda=0.060861
## - Fold1.Rep1: alpha=0.34773, lambda=0.060861
## + Fold1.Rep1: alpha=0.51433, lambda=0.001761
## - Fold1.Rep1: alpha=0.51433, lambda=0.001761
## + Fold1.Rep1: alpha=0.31833, lambda=0.479416
## - Fold1.Rep1: alpha=0.31833, lambda=0.479416
Chang Liu 11
R for Data Science Lecture 5
## + Fold1.Rep1: alpha=0.74806, lambda=0.327981
## - Fold1.Rep1: alpha=0.74806, lambda=0.327981
## + Fold1.Rep1: alpha=0.14914, lambda=0.028964
## - Fold1.Rep1: alpha=0.14914, lambda=0.028964
## + Fold1.Rep1: alpha=0.84515, lambda=0.897325
## - Fold1.Rep1: alpha=0.84515, lambda=0.897325
## + Fold1.Rep1: alpha=0.93503, lambda=0.082985
## - Fold1.Rep1: alpha=0.93503, lambda=0.082985
## + Fold1.Rep1: alpha=0.38077, lambda=1.148290
## - Fold1.Rep1: alpha=0.38077, lambda=1.148290
## + Fold1.Rep1: alpha=0.84280, lambda=0.045415
## - Fold1.Rep1: alpha=0.84280, lambda=0.045415
## + Fold1.Rep1: alpha=0.98348, lambda=0.006142
## - Fold1.Rep1: alpha=0.98348, lambda=0.006142
## + Fold1.Rep1: alpha=0.78895, lambda=0.042054
## - Fold1.Rep1: alpha=0.78895, lambda=0.042054
## + Fold1.Rep1: alpha=0.52859, lambda=0.428235
## - Fold1.Rep1: alpha=0.52859, lambda=0.428235
## + Fold1.Rep1: alpha=0.73053, lambda=0.015889
## - Fold1.Rep1: alpha=0.73053, lambda=0.015889
## + Fold1.Rep1: alpha=0.90284, lambda=0.445782
## - Fold1.Rep1: alpha=0.90284, lambda=0.445782
## + Fold1.Rep1: alpha=0.32570, lambda=0.081177
## - Fold1.Rep1: alpha=0.32570, lambda=0.081177
## + Fold1.Rep1: alpha=0.75140, lambda=0.561138
## - Fold1.Rep1: alpha=0.75140, lambda=0.561138
## + Fold1.Rep1: alpha=0.03599, lambda=0.001115
## - Fold1.Rep1: alpha=0.03599, lambda=0.001115
## + Fold1.Rep1: alpha=0.25504, lambda=2.954617
## - Fold1.Rep1: alpha=0.25504, lambda=2.954617
## + Fold1.Rep1: alpha=0.86475, lambda=0.043683
## - Fold1.Rep1: alpha=0.86475, lambda=0.043683
## + Fold1.Rep1: alpha=0.10863, lambda=0.154091
## - Fold1.Rep1: alpha=0.10863, lambda=0.154091
## + Fold1.Rep1: alpha=0.98116, lambda=7.405037
## - Fold1.Rep1: alpha=0.98116, lambda=7.405037
## + Fold1.Rep1: alpha=0.94388, lambda=0.002046
## - Fold1.Rep1: alpha=0.94388, lambda=0.002046
Chang Liu 12
R for Data Science Lecture 5
## + Fold2.Rep1: alpha=0.63950, lambda=0.004507
## - Fold2.Rep1: alpha=0.63950, lambda=0.004507
## + Fold2.Rep1: alpha=0.04530, lambda=0.016509
## - Fold2.Rep1: alpha=0.04530, lambda=0.016509
## + Fold2.Rep1: alpha=0.97420, lambda=0.004648
## - Fold2.Rep1: alpha=0.97420, lambda=0.004648
## + Fold2.Rep1: alpha=0.34773, lambda=0.060861
## - Fold2.Rep1: alpha=0.34773, lambda=0.060861
## + Fold2.Rep1: alpha=0.51433, lambda=0.001761
## - Fold2.Rep1: alpha=0.51433, lambda=0.001761
## + Fold2.Rep1: alpha=0.31833, lambda=0.479416
## - Fold2.Rep1: alpha=0.31833, lambda=0.479416
## + Fold2.Rep1: alpha=0.74806, lambda=0.327981
## - Fold2.Rep1: alpha=0.74806, lambda=0.327981
## + Fold2.Rep1: alpha=0.14914, lambda=0.028964
## - Fold2.Rep1: alpha=0.14914, lambda=0.028964
## + Fold2.Rep1: alpha=0.84515, lambda=0.897325
## - Fold2.Rep1: alpha=0.84515, lambda=0.897325
## + Fold2.Rep1: alpha=0.93503, lambda=0.082985
## - Fold2.Rep1: alpha=0.93503, lambda=0.082985
## + Fold2.Rep1: alpha=0.38077, lambda=1.148290
## - Fold2.Rep1: alpha=0.38077, lambda=1.148290
## + Fold2.Rep1: alpha=0.84280, lambda=0.045415
## - Fold2.Rep1: alpha=0.84280, lambda=0.045415
## + Fold2.Rep1: alpha=0.98348, lambda=0.006142
## - Fold2.Rep1: alpha=0.98348, lambda=0.006142
## + Fold2.Rep1: alpha=0.78895, lambda=0.042054
## - Fold2.Rep1: alpha=0.78895, lambda=0.042054
## + Fold2.Rep1: alpha=0.52859, lambda=0.428235
## - Fold2.Rep1: alpha=0.52859, lambda=0.428235
## + Fold2.Rep1: alpha=0.73053, lambda=0.015889
## - Fold2.Rep1: alpha=0.73053, lambda=0.015889
## + Fold2.Rep1: alpha=0.90284, lambda=0.445782
## - Fold2.Rep1: alpha=0.90284, lambda=0.445782
## + Fold2.Rep1: alpha=0.32570, lambda=0.081177
## - Fold2.Rep1: alpha=0.32570, lambda=0.081177
## + Fold2.Rep1: alpha=0.75140, lambda=0.561138
## - Fold2.Rep1: alpha=0.75140, lambda=0.561138
Chang Liu 13
R for Data Science Lecture 5
## + Fold2.Rep1: alpha=0.03599, lambda=0.001115
## - Fold2.Rep1: alpha=0.03599, lambda=0.001115
## + Fold2.Rep1: alpha=0.25504, lambda=2.954617
## - Fold2.Rep1: alpha=0.25504, lambda=2.954617
## + Fold2.Rep1: alpha=0.86475, lambda=0.043683
## - Fold2.Rep1: alpha=0.86475, lambda=0.043683
## + Fold2.Rep1: alpha=0.10863, lambda=0.154091
## - Fold2.Rep1: alpha=0.10863, lambda=0.154091
## + Fold2.Rep1: alpha=0.98116, lambda=7.405037
## - Fold2.Rep1: alpha=0.98116, lambda=7.405037
## + Fold2.Rep1: alpha=0.94388, lambda=0.002046
## - Fold2.Rep1: alpha=0.94388, lambda=0.002046
## + Fold3.Rep1: alpha=0.63950, lambda=0.004507
## - Fold3.Rep1: alpha=0.63950, lambda=0.004507
## + Fold3.Rep1: alpha=0.04530, lambda=0.016509
## - Fold3.Rep1: alpha=0.04530, lambda=0.016509
## + Fold3.Rep1: alpha=0.97420, lambda=0.004648
## - Fold3.Rep1: alpha=0.97420, lambda=0.004648
## + Fold3.Rep1: alpha=0.34773, lambda=0.060861
## - Fold3.Rep1: alpha=0.34773, lambda=0.060861
## + Fold3.Rep1: alpha=0.51433, lambda=0.001761
## - Fold3.Rep1: alpha=0.51433, lambda=0.001761
## + Fold3.Rep1: alpha=0.31833, lambda=0.479416
## - Fold3.Rep1: alpha=0.31833, lambda=0.479416
## + Fold3.Rep1: alpha=0.74806, lambda=0.327981
## - Fold3.Rep1: alpha=0.74806, lambda=0.327981
## + Fold3.Rep1: alpha=0.14914, lambda=0.028964
## - Fold3.Rep1: alpha=0.14914, lambda=0.028964
## + Fold3.Rep1: alpha=0.84515, lambda=0.897325
## - Fold3.Rep1: alpha=0.84515, lambda=0.897325
## + Fold3.Rep1: alpha=0.93503, lambda=0.082985
## - Fold3.Rep1: alpha=0.93503, lambda=0.082985
## + Fold3.Rep1: alpha=0.38077, lambda=1.148290
## - Fold3.Rep1: alpha=0.38077, lambda=1.148290
## + Fold3.Rep1: alpha=0.84280, lambda=0.045415
## - Fold3.Rep1: alpha=0.84280, lambda=0.045415
## + Fold3.Rep1: alpha=0.98348, lambda=0.006142
## - Fold3.Rep1: alpha=0.98348, lambda=0.006142
Chang Liu 14
R for Data Science Lecture 5
## + Fold3.Rep1: alpha=0.78895, lambda=0.042054
## - Fold3.Rep1: alpha=0.78895, lambda=0.042054
## + Fold3.Rep1: alpha=0.52859, lambda=0.428235
## - Fold3.Rep1: alpha=0.52859, lambda=0.428235
## + Fold3.Rep1: alpha=0.73053, lambda=0.015889
## - Fold3.Rep1: alpha=0.73053, lambda=0.015889
## + Fold3.Rep1: alpha=0.90284, lambda=0.445782
## - Fold3.Rep1: alpha=0.90284, lambda=0.445782
## + Fold3.Rep1: alpha=0.32570, lambda=0.081177
## - Fold3.Rep1: alpha=0.32570, lambda=0.081177
## + Fold3.Rep1: alpha=0.75140, lambda=0.561138
## - Fold3.Rep1: alpha=0.75140, lambda=0.561138
## + Fold3.Rep1: alpha=0.03599, lambda=0.001115
## - Fold3.Rep1: alpha=0.03599, lambda=0.001115
## + Fold3.Rep1: alpha=0.25504, lambda=2.954617
## - Fold3.Rep1: alpha=0.25504, lambda=2.954617
## + Fold3.Rep1: alpha=0.86475, lambda=0.043683
## - Fold3.Rep1: alpha=0.86475, lambda=0.043683
## + Fold3.Rep1: alpha=0.10863, lambda=0.154091
## - Fold3.Rep1: alpha=0.10863, lambda=0.154091
## + Fold3.Rep1: alpha=0.98116, lambda=7.405037
## - Fold3.Rep1: alpha=0.98116, lambda=7.405037
## + Fold3.Rep1: alpha=0.94388, lambda=0.002046
## - Fold3.Rep1: alpha=0.94388, lambda=0.002046
## + Fold4.Rep1: alpha=0.63950, lambda=0.004507
## - Fold4.Rep1: alpha=0.63950, lambda=0.004507
## + Fold4.Rep1: alpha=0.04530, lambda=0.016509
## - Fold4.Rep1: alpha=0.04530, lambda=0.016509
## + Fold4.Rep1: alpha=0.97420, lambda=0.004648
## - Fold4.Rep1: alpha=0.97420, lambda=0.004648
## + Fold4.Rep1: alpha=0.34773, lambda=0.060861
## - Fold4.Rep1: alpha=0.34773, lambda=0.060861
## + Fold4.Rep1: alpha=0.51433, lambda=0.001761
## - Fold4.Rep1: alpha=0.51433, lambda=0.001761
## + Fold4.Rep1: alpha=0.31833, lambda=0.479416
## - Fold4.Rep1: alpha=0.31833, lambda=0.479416
## + Fold4.Rep1: alpha=0.74806, lambda=0.327981
## - Fold4.Rep1: alpha=0.74806, lambda=0.327981
Chang Liu 15
R for Data Science Lecture 5
## + Fold4.Rep1: alpha=0.14914, lambda=0.028964
## - Fold4.Rep1: alpha=0.14914, lambda=0.028964
## + Fold4.Rep1: alpha=0.84515, lambda=0.897325
## - Fold4.Rep1: alpha=0.84515, lambda=0.897325
## + Fold4.Rep1: alpha=0.93503, lambda=0.082985
## - Fold4.Rep1: alpha=0.93503, lambda=0.082985
## + Fold4.Rep1: alpha=0.38077, lambda=1.148290
## - Fold4.Rep1: alpha=0.38077, lambda=1.148290
## + Fold4.Rep1: alpha=0.84280, lambda=0.045415
## - Fold4.Rep1: alpha=0.84280, lambda=0.045415
## + Fold4.Rep1: alpha=0.98348, lambda=0.006142
## - Fold4.Rep1: alpha=0.98348, lambda=0.006142
## + Fold4.Rep1: alpha=0.78895, lambda=0.042054
## - Fold4.Rep1: alpha=0.78895, lambda=0.042054
## + Fold4.Rep1: alpha=0.52859, lambda=0.428235
## - Fold4.Rep1: alpha=0.52859, lambda=0.428235
## + Fold4.Rep1: alpha=0.73053, lambda=0.015889
## - Fold4.Rep1: alpha=0.73053, lambda=0.015889
## + Fold4.Rep1: alpha=0.90284, lambda=0.445782
## - Fold4.Rep1: alpha=0.90284, lambda=0.445782
## + Fold4.Rep1: alpha=0.32570, lambda=0.081177
## - Fold4.Rep1: alpha=0.32570, lambda=0.081177
## + Fold4.Rep1: alpha=0.75140, lambda=0.561138
## - Fold4.Rep1: alpha=0.75140, lambda=0.561138
## + Fold4.Rep1: alpha=0.03599, lambda=0.001115
## - Fold4.Rep1: alpha=0.03599, lambda=0.001115
## + Fold4.Rep1: alpha=0.25504, lambda=2.954617
## - Fold4.Rep1: alpha=0.25504, lambda=2.954617
## + Fold4.Rep1: alpha=0.86475, lambda=0.043683
## - Fold4.Rep1: alpha=0.86475, lambda=0.043683
## + Fold4.Rep1: alpha=0.10863, lambda=0.154091
## - Fold4.Rep1: alpha=0.10863, lambda=0.154091
## + Fold4.Rep1: alpha=0.98116, lambda=7.405037
## - Fold4.Rep1: alpha=0.98116, lambda=7.405037
## + Fold4.Rep1: alpha=0.94388, lambda=0.002046
## - Fold4.Rep1: alpha=0.94388, lambda=0.002046
## + Fold5.Rep1: alpha=0.63950, lambda=0.004507
## - Fold5.Rep1: alpha=0.63950, lambda=0.004507
Chang Liu 16
R for Data Science Lecture 5
## + Fold5.Rep1: alpha=0.04530, lambda=0.016509
## - Fold5.Rep1: alpha=0.04530, lambda=0.016509
## + Fold5.Rep1: alpha=0.97420, lambda=0.004648
## - Fold5.Rep1: alpha=0.97420, lambda=0.004648
## + Fold5.Rep1: alpha=0.34773, lambda=0.060861
## - Fold5.Rep1: alpha=0.34773, lambda=0.060861
## + Fold5.Rep1: alpha=0.51433, lambda=0.001761
## - Fold5.Rep1: alpha=0.51433, lambda=0.001761
## + Fold5.Rep1: alpha=0.31833, lambda=0.479416
## - Fold5.Rep1: alpha=0.31833, lambda=0.479416
## + Fold5.Rep1: alpha=0.74806, lambda=0.327981
## - Fold5.Rep1: alpha=0.74806, lambda=0.327981
## + Fold5.Rep1: alpha=0.14914, lambda=0.028964
## - Fold5.Rep1: alpha=0.14914, lambda=0.028964
## + Fold5.Rep1: alpha=0.84515, lambda=0.897325
## - Fold5.Rep1: alpha=0.84515, lambda=0.897325
## + Fold5.Rep1: alpha=0.93503, lambda=0.082985
## - Fold5.Rep1: alpha=0.93503, lambda=0.082985
## + Fold5.Rep1: alpha=0.38077, lambda=1.148290
## - Fold5.Rep1: alpha=0.38077, lambda=1.148290
## + Fold5.Rep1: alpha=0.84280, lambda=0.045415
## - Fold5.Rep1: alpha=0.84280, lambda=0.045415
## + Fold5.Rep1: alpha=0.98348, lambda=0.006142
## - Fold5.Rep1: alpha=0.98348, lambda=0.006142
## + Fold5.Rep1: alpha=0.78895, lambda=0.042054
## - Fold5.Rep1: alpha=0.78895, lambda=0.042054
## + Fold5.Rep1: alpha=0.52859, lambda=0.428235
## - Fold5.Rep1: alpha=0.52859, lambda=0.428235
## + Fold5.Rep1: alpha=0.73053, lambda=0.015889
## - Fold5.Rep1: alpha=0.73053, lambda=0.015889
## + Fold5.Rep1: alpha=0.90284, lambda=0.445782
## - Fold5.Rep1: alpha=0.90284, lambda=0.445782
## + Fold5.Rep1: alpha=0.32570, lambda=0.081177
## - Fold5.Rep1: alpha=0.32570, lambda=0.081177
## + Fold5.Rep1: alpha=0.75140, lambda=0.561138
## - Fold5.Rep1: alpha=0.75140, lambda=0.561138
## + Fold5.Rep1: alpha=0.03599, lambda=0.001115
## - Fold5.Rep1: alpha=0.03599, lambda=0.001115
Chang Liu 17
R for Data Science Lecture 5
## + Fold5.Rep1: alpha=0.25504, lambda=2.954617
## - Fold5.Rep1: alpha=0.25504, lambda=2.954617
## + Fold5.Rep1: alpha=0.86475, lambda=0.043683
## - Fold5.Rep1: alpha=0.86475, lambda=0.043683
## + Fold5.Rep1: alpha=0.10863, lambda=0.154091
## - Fold5.Rep1: alpha=0.10863, lambda=0.154091
## + Fold5.Rep1: alpha=0.98116, lambda=7.405037
## - Fold5.Rep1: alpha=0.98116, lambda=7.405037
## + Fold5.Rep1: alpha=0.94388, lambda=0.002046
## - Fold5.Rep1: alpha=0.94388, lambda=0.002046
## + Fold1.Rep2: alpha=0.63950, lambda=0.004507
## - Fold1.Rep2: alpha=0.63950, lambda=0.004507
## + Fold1.Rep2: alpha=0.04530, lambda=0.016509
## - Fold1.Rep2: alpha=0.04530, lambda=0.016509
## + Fold1.Rep2: alpha=0.97420, lambda=0.004648
## - Fold1.Rep2: alpha=0.97420, lambda=0.004648
## + Fold1.Rep2: alpha=0.34773, lambda=0.060861
## - Fold1.Rep2: alpha=0.34773, lambda=0.060861
## + Fold1.Rep2: alpha=0.51433, lambda=0.001761
## - Fold1.Rep2: alpha=0.51433, lambda=0.001761
## + Fold1.Rep2: alpha=0.31833, lambda=0.479416
## - Fold1.Rep2: alpha=0.31833, lambda=0.479416
## + Fold1.Rep2: alpha=0.74806, lambda=0.327981
## - Fold1.Rep2: alpha=0.74806, lambda=0.327981
## + Fold1.Rep2: alpha=0.14914, lambda=0.028964
## - Fold1.Rep2: alpha=0.14914, lambda=0.028964
## + Fold1.Rep2: alpha=0.84515, lambda=0.897325
## - Fold1.Rep2: alpha=0.84515, lambda=0.897325
## + Fold1.Rep2: alpha=0.93503, lambda=0.082985
## - Fold1.Rep2: alpha=0.93503, lambda=0.082985
## + Fold1.Rep2: alpha=0.38077, lambda=1.148290
## - Fold1.Rep2: alpha=0.38077, lambda=1.148290
## + Fold1.Rep2: alpha=0.84280, lambda=0.045415
## - Fold1.Rep2: alpha=0.84280, lambda=0.045415
## + Fold1.Rep2: alpha=0.98348, lambda=0.006142
## - Fold1.Rep2: alpha=0.98348, lambda=0.006142
## + Fold1.Rep2: alpha=0.78895, lambda=0.042054
## - Fold1.Rep2: alpha=0.78895, lambda=0.042054
Chang Liu 18
R for Data Science Lecture 5
## + Fold1.Rep2: alpha=0.52859, lambda=0.428235
## - Fold1.Rep2: alpha=0.52859, lambda=0.428235
## + Fold1.Rep2: alpha=0.73053, lambda=0.015889
## - Fold1.Rep2: alpha=0.73053, lambda=0.015889
## + Fold1.Rep2: alpha=0.90284, lambda=0.445782
## - Fold1.Rep2: alpha=0.90284, lambda=0.445782
## + Fold1.Rep2: alpha=0.32570, lambda=0.081177
## - Fold1.Rep2: alpha=0.32570, lambda=0.081177
## + Fold1.Rep2: alpha=0.75140, lambda=0.561138
## - Fold1.Rep2: alpha=0.75140, lambda=0.561138
## + Fold1.Rep2: alpha=0.03599, lambda=0.001115
## - Fold1.Rep2: alpha=0.03599, lambda=0.001115
## + Fold1.Rep2: alpha=0.25504, lambda=2.954617
## - Fold1.Rep2: alpha=0.25504, lambda=2.954617
## + Fold1.Rep2: alpha=0.86475, lambda=0.043683
## - Fold1.Rep2: alpha=0.86475, lambda=0.043683
## + Fold1.Rep2: alpha=0.10863, lambda=0.154091
## - Fold1.Rep2: alpha=0.10863, lambda=0.154091
## + Fold1.Rep2: alpha=0.98116, lambda=7.405037
## - Fold1.Rep2: alpha=0.98116, lambda=7.405037
## + Fold1.Rep2: alpha=0.94388, lambda=0.002046
## - Fold1.Rep2: alpha=0.94388, lambda=0.002046
## + Fold2.Rep2: alpha=0.63950, lambda=0.004507
## - Fold2.Rep2: alpha=0.63950, lambda=0.004507
## + Fold2.Rep2: alpha=0.04530, lambda=0.016509
## - Fold2.Rep2: alpha=0.04530, lambda=0.016509
## + Fold2.Rep2: alpha=0.97420, lambda=0.004648
## - Fold2.Rep2: alpha=0.97420, lambda=0.004648
## + Fold2.Rep2: alpha=0.34773, lambda=0.060861
## - Fold2.Rep2: alpha=0.34773, lambda=0.060861
## + Fold2.Rep2: alpha=0.51433, lambda=0.001761
## - Fold2.Rep2: alpha=0.51433, lambda=0.001761
## + Fold2.Rep2: alpha=0.31833, lambda=0.479416
## - Fold2.Rep2: alpha=0.31833, lambda=0.479416
## + Fold2.Rep2: alpha=0.74806, lambda=0.327981
## - Fold2.Rep2: alpha=0.74806, lambda=0.327981
## + Fold2.Rep2: alpha=0.14914, lambda=0.028964
## - Fold2.Rep2: alpha=0.14914, lambda=0.028964
Chang Liu 19
R for Data Science Lecture 5
## + Fold2.Rep2: alpha=0.84515, lambda=0.897325
## - Fold2.Rep2: alpha=0.84515, lambda=0.897325
## + Fold2.Rep2: alpha=0.93503, lambda=0.082985
## - Fold2.Rep2: alpha=0.93503, lambda=0.082985
## + Fold2.Rep2: alpha=0.38077, lambda=1.148290
## - Fold2.Rep2: alpha=0.38077, lambda=1.148290
## + Fold2.Rep2: alpha=0.84280, lambda=0.045415
## - Fold2.Rep2: alpha=0.84280, lambda=0.045415
## + Fold2.Rep2: alpha=0.98348, lambda=0.006142
## - Fold2.Rep2: alpha=0.98348, lambda=0.006142
## + Fold2.Rep2: alpha=0.78895, lambda=0.042054
## - Fold2.Rep2: alpha=0.78895, lambda=0.042054
## + Fold2.Rep2: alpha=0.52859, lambda=0.428235
## - Fold2.Rep2: alpha=0.52859, lambda=0.428235
## + Fold2.Rep2: alpha=0.73053, lambda=0.015889
## - Fold2.Rep2: alpha=0.73053, lambda=0.015889
## + Fold2.Rep2: alpha=0.90284, lambda=0.445782
## - Fold2.Rep2: alpha=0.90284, lambda=0.445782
## + Fold2.Rep2: alpha=0.32570, lambda=0.081177
## - Fold2.Rep2: alpha=0.32570, lambda=0.081177
## + Fold2.Rep2: alpha=0.75140, lambda=0.561138
## - Fold2.Rep2: alpha=0.75140, lambda=0.561138
## + Fold2.Rep2: alpha=0.03599, lambda=0.001115
## - Fold2.Rep2: alpha=0.03599, lambda=0.001115
## + Fold2.Rep2: alpha=0.25504, lambda=2.954617
## - Fold2.Rep2: alpha=0.25504, lambda=2.954617
## + Fold2.Rep2: alpha=0.86475, lambda=0.043683
## - Fold2.Rep2: alpha=0.86475, lambda=0.043683
## + Fold2.Rep2: alpha=0.10863, lambda=0.154091
## - Fold2.Rep2: alpha=0.10863, lambda=0.154091
## + Fold2.Rep2: alpha=0.98116, lambda=7.405037
## - Fold2.Rep2: alpha=0.98116, lambda=7.405037
## + Fold2.Rep2: alpha=0.94388, lambda=0.002046
## - Fold2.Rep2: alpha=0.94388, lambda=0.002046
## + Fold3.Rep2: alpha=0.63950, lambda=0.004507
## - Fold3.Rep2: alpha=0.63950, lambda=0.004507
## + Fold3.Rep2: alpha=0.04530, lambda=0.016509
## - Fold3.Rep2: alpha=0.04530, lambda=0.016509
Chang Liu 20
R for Data Science Lecture 5
## + Fold3.Rep2: alpha=0.97420, lambda=0.004648
## - Fold3.Rep2: alpha=0.97420, lambda=0.004648
## + Fold3.Rep2: alpha=0.34773, lambda=0.060861
## - Fold3.Rep2: alpha=0.34773, lambda=0.060861
## + Fold3.Rep2: alpha=0.51433, lambda=0.001761
## - Fold3.Rep2: alpha=0.51433, lambda=0.001761
## + Fold3.Rep2: alpha=0.31833, lambda=0.479416
## - Fold3.Rep2: alpha=0.31833, lambda=0.479416
## + Fold3.Rep2: alpha=0.74806, lambda=0.327981
## - Fold3.Rep2: alpha=0.74806, lambda=0.327981
## + Fold3.Rep2: alpha=0.14914, lambda=0.028964
## - Fold3.Rep2: alpha=0.14914, lambda=0.028964
## + Fold3.Rep2: alpha=0.84515, lambda=0.897325
## - Fold3.Rep2: alpha=0.84515, lambda=0.897325
## + Fold3.Rep2: alpha=0.93503, lambda=0.082985
## - Fold3.Rep2: alpha=0.93503, lambda=0.082985
## + Fold3.Rep2: alpha=0.38077, lambda=1.148290
## - Fold3.Rep2: alpha=0.38077, lambda=1.148290
## + Fold3.Rep2: alpha=0.84280, lambda=0.045415
## - Fold3.Rep2: alpha=0.84280, lambda=0.045415
## + Fold3.Rep2: alpha=0.98348, lambda=0.006142
## - Fold3.Rep2: alpha=0.98348, lambda=0.006142
## + Fold3.Rep2: alpha=0.78895, lambda=0.042054
## - Fold3.Rep2: alpha=0.78895, lambda=0.042054
## + Fold3.Rep2: alpha=0.52859, lambda=0.428235
## - Fold3.Rep2: alpha=0.52859, lambda=0.428235
## + Fold3.Rep2: alpha=0.73053, lambda=0.015889
## - Fold3.Rep2: alpha=0.73053, lambda=0.015889
## + Fold3.Rep2: alpha=0.90284, lambda=0.445782
## - Fold3.Rep2: alpha=0.90284, lambda=0.445782
## + Fold3.Rep2: alpha=0.32570, lambda=0.081177
## - Fold3.Rep2: alpha=0.32570, lambda=0.081177
## + Fold3.Rep2: alpha=0.75140, lambda=0.561138
## - Fold3.Rep2: alpha=0.75140, lambda=0.561138
## + Fold3.Rep2: alpha=0.03599, lambda=0.001115
## - Fold3.Rep2: alpha=0.03599, lambda=0.001115
## + Fold3.Rep2: alpha=0.25504, lambda=2.954617
## - Fold3.Rep2: alpha=0.25504, lambda=2.954617
Chang Liu 21
R for Data Science Lecture 5
## + Fold3.Rep2: alpha=0.86475, lambda=0.043683
## - Fold3.Rep2: alpha=0.86475, lambda=0.043683
## + Fold3.Rep2: alpha=0.10863, lambda=0.154091
## - Fold3.Rep2: alpha=0.10863, lambda=0.154091
## + Fold3.Rep2: alpha=0.98116, lambda=7.405037
## - Fold3.Rep2: alpha=0.98116, lambda=7.405037
## + Fold3.Rep2: alpha=0.94388, lambda=0.002046
## - Fold3.Rep2: alpha=0.94388, lambda=0.002046
## + Fold4.Rep2: alpha=0.63950, lambda=0.004507
## - Fold4.Rep2: alpha=0.63950, lambda=0.004507
## + Fold4.Rep2: alpha=0.04530, lambda=0.016509
## - Fold4.Rep2: alpha=0.04530, lambda=0.016509
## + Fold4.Rep2: alpha=0.97420, lambda=0.004648
## - Fold4.Rep2: alpha=0.97420, lambda=0.004648
## + Fold4.Rep2: alpha=0.34773, lambda=0.060861
## - Fold4.Rep2: alpha=0.34773, lambda=0.060861
## + Fold4.Rep2: alpha=0.51433, lambda=0.001761
## - Fold4.Rep2: alpha=0.51433, lambda=0.001761
## + Fold4.Rep2: alpha=0.31833, lambda=0.479416
## - Fold4.Rep2: alpha=0.31833, lambda=0.479416
## + Fold4.Rep2: alpha=0.74806, lambda=0.327981
## - Fold4.Rep2: alpha=0.74806, lambda=0.327981
## + Fold4.Rep2: alpha=0.14914, lambda=0.028964
## - Fold4.Rep2: alpha=0.14914, lambda=0.028964
## + Fold4.Rep2: alpha=0.84515, lambda=0.897325
## - Fold4.Rep2: alpha=0.84515, lambda=0.897325
## + Fold4.Rep2: alpha=0.93503, lambda=0.082985
## - Fold4.Rep2: alpha=0.93503, lambda=0.082985
## + Fold4.Rep2: alpha=0.38077, lambda=1.148290
## - Fold4.Rep2: alpha=0.38077, lambda=1.148290
## + Fold4.Rep2: alpha=0.84280, lambda=0.045415
## - Fold4.Rep2: alpha=0.84280, lambda=0.045415
## + Fold4.Rep2: alpha=0.98348, lambda=0.006142
## - Fold4.Rep2: alpha=0.98348, lambda=0.006142
## + Fold4.Rep2: alpha=0.78895, lambda=0.042054
## - Fold4.Rep2: alpha=0.78895, lambda=0.042054
## + Fold4.Rep2: alpha=0.52859, lambda=0.428235
## - Fold4.Rep2: alpha=0.52859, lambda=0.428235
Chang Liu 22
R for Data Science Lecture 5
## + Fold4.Rep2: alpha=0.73053, lambda=0.015889
## - Fold4.Rep2: alpha=0.73053, lambda=0.015889
## + Fold4.Rep2: alpha=0.90284, lambda=0.445782
## - Fold4.Rep2: alpha=0.90284, lambda=0.445782
## + Fold4.Rep2: alpha=0.32570, lambda=0.081177
## - Fold4.Rep2: alpha=0.32570, lambda=0.081177
## + Fold4.Rep2: alpha=0.75140, lambda=0.561138
## - Fold4.Rep2: alpha=0.75140, lambda=0.561138
## + Fold4.Rep2: alpha=0.03599, lambda=0.001115
## - Fold4.Rep2: alpha=0.03599, lambda=0.001115
## + Fold4.Rep2: alpha=0.25504, lambda=2.954617
## - Fold4.Rep2: alpha=0.25504, lambda=2.954617
## + Fold4.Rep2: alpha=0.86475, lambda=0.043683
## - Fold4.Rep2: alpha=0.86475, lambda=0.043683
## + Fold4.Rep2: alpha=0.10863, lambda=0.154091
## - Fold4.Rep2: alpha=0.10863, lambda=0.154091
## + Fold4.Rep2: alpha=0.98116, lambda=7.405037
## - Fold4.Rep2: alpha=0.98116, lambda=7.405037
## + Fold4.Rep2: alpha=0.94388, lambda=0.002046
## - Fold4.Rep2: alpha=0.94388, lambda=0.002046
## + Fold5.Rep2: alpha=0.63950, lambda=0.004507
## - Fold5.Rep2: alpha=0.63950, lambda=0.004507
## + Fold5.Rep2: alpha=0.04530, lambda=0.016509
## - Fold5.Rep2: alpha=0.04530, lambda=0.016509
## + Fold5.Rep2: alpha=0.97420, lambda=0.004648
## - Fold5.Rep2: alpha=0.97420, lambda=0.004648
## + Fold5.Rep2: alpha=0.34773, lambda=0.060861
## - Fold5.Rep2: alpha=0.34773, lambda=0.060861
## + Fold5.Rep2: alpha=0.51433, lambda=0.001761
## - Fold5.Rep2: alpha=0.51433, lambda=0.001761
## + Fold5.Rep2: alpha=0.31833, lambda=0.479416
## - Fold5.Rep2: alpha=0.31833, lambda=0.479416
## + Fold5.Rep2: alpha=0.74806, lambda=0.327981
## - Fold5.Rep2: alpha=0.74806, lambda=0.327981
## + Fold5.Rep2: alpha=0.14914, lambda=0.028964
## - Fold5.Rep2: alpha=0.14914, lambda=0.028964
## + Fold5.Rep2: alpha=0.84515, lambda=0.897325
## - Fold5.Rep2: alpha=0.84515, lambda=0.897325
Chang Liu 23
R for Data Science Lecture 5
## + Fold5.Rep2: alpha=0.93503, lambda=0.082985
## - Fold5.Rep2: alpha=0.93503, lambda=0.082985
## + Fold5.Rep2: alpha=0.38077, lambda=1.148290
## - Fold5.Rep2: alpha=0.38077, lambda=1.148290
## + Fold5.Rep2: alpha=0.84280, lambda=0.045415
## - Fold5.Rep2: alpha=0.84280, lambda=0.045415
## + Fold5.Rep2: alpha=0.98348, lambda=0.006142
## - Fold5.Rep2: alpha=0.98348, lambda=0.006142
## + Fold5.Rep2: alpha=0.78895, lambda=0.042054
## - Fold5.Rep2: alpha=0.78895, lambda=0.042054
## + Fold5.Rep2: alpha=0.52859, lambda=0.428235
## - Fold5.Rep2: alpha=0.52859, lambda=0.428235
## + Fold5.Rep2: alpha=0.73053, lambda=0.015889
## - Fold5.Rep2: alpha=0.73053, lambda=0.015889
## + Fold5.Rep2: alpha=0.90284, lambda=0.445782
## - Fold5.Rep2: alpha=0.90284, lambda=0.445782
## + Fold5.Rep2: alpha=0.32570, lambda=0.081177
## - Fold5.Rep2: alpha=0.32570, lambda=0.081177
## + Fold5.Rep2: alpha=0.75140, lambda=0.561138
## - Fold5.Rep2: alpha=0.75140, lambda=0.561138
## + Fold5.Rep2: alpha=0.03599, lambda=0.001115
## - Fold5.Rep2: alpha=0.03599, lambda=0.001115
## + Fold5.Rep2: alpha=0.25504, lambda=2.954617
## - Fold5.Rep2: alpha=0.25504, lambda=2.954617
## + Fold5.Rep2: alpha=0.86475, lambda=0.043683
## - Fold5.Rep2: alpha=0.86475, lambda=0.043683
## + Fold5.Rep2: alpha=0.10863, lambda=0.154091
## - Fold5.Rep2: alpha=0.10863, lambda=0.154091
## + Fold5.Rep2: alpha=0.98116, lambda=7.405037
## - Fold5.Rep2: alpha=0.98116, lambda=7.405037
## + Fold5.Rep2: alpha=0.94388, lambda=0.002046
## - Fold5.Rep2: alpha=0.94388, lambda=0.002046
## + Fold1.Rep3: alpha=0.63950, lambda=0.004507
## - Fold1.Rep3: alpha=0.63950, lambda=0.004507
## + Fold1.Rep3: alpha=0.04530, lambda=0.016509
## - Fold1.Rep3: alpha=0.04530, lambda=0.016509
## + Fold1.Rep3: alpha=0.97420, lambda=0.004648
## - Fold1.Rep3: alpha=0.97420, lambda=0.004648
Chang Liu 24
R for Data Science Lecture 5
## + Fold1.Rep3: alpha=0.34773, lambda=0.060861
## - Fold1.Rep3: alpha=0.34773, lambda=0.060861
## + Fold1.Rep3: alpha=0.51433, lambda=0.001761
## - Fold1.Rep3: alpha=0.51433, lambda=0.001761
## + Fold1.Rep3: alpha=0.31833, lambda=0.479416
## - Fold1.Rep3: alpha=0.31833, lambda=0.479416
## + Fold1.Rep3: alpha=0.74806, lambda=0.327981
## - Fold1.Rep3: alpha=0.74806, lambda=0.327981
## + Fold1.Rep3: alpha=0.14914, lambda=0.028964
## - Fold1.Rep3: alpha=0.14914, lambda=0.028964
## + Fold1.Rep3: alpha=0.84515, lambda=0.897325
## - Fold1.Rep3: alpha=0.84515, lambda=0.897325
## + Fold1.Rep3: alpha=0.93503, lambda=0.082985
## - Fold1.Rep3: alpha=0.93503, lambda=0.082985
## + Fold1.Rep3: alpha=0.38077, lambda=1.148290
## - Fold1.Rep3: alpha=0.38077, lambda=1.148290
## + Fold1.Rep3: alpha=0.84280, lambda=0.045415
## - Fold1.Rep3: alpha=0.84280, lambda=0.045415
## + Fold1.Rep3: alpha=0.98348, lambda=0.006142
## - Fold1.Rep3: alpha=0.98348, lambda=0.006142
## + Fold1.Rep3: alpha=0.78895, lambda=0.042054
## - Fold1.Rep3: alpha=0.78895, lambda=0.042054
## + Fold1.Rep3: alpha=0.52859, lambda=0.428235
## - Fold1.Rep3: alpha=0.52859, lambda=0.428235
## + Fold1.Rep3: alpha=0.73053, lambda=0.015889
## - Fold1.Rep3: alpha=0.73053, lambda=0.015889
## + Fold1.Rep3: alpha=0.90284, lambda=0.445782
## - Fold1.Rep3: alpha=0.90284, lambda=0.445782
## + Fold1.Rep3: alpha=0.32570, lambda=0.081177
## - Fold1.Rep3: alpha=0.32570, lambda=0.081177
## + Fold1.Rep3: alpha=0.75140, lambda=0.561138
## - Fold1.Rep3: alpha=0.75140, lambda=0.561138
## + Fold1.Rep3: alpha=0.03599, lambda=0.001115
## - Fold1.Rep3: alpha=0.03599, lambda=0.001115
## + Fold1.Rep3: alpha=0.25504, lambda=2.954617
## - Fold1.Rep3: alpha=0.25504, lambda=2.954617
## + Fold1.Rep3: alpha=0.86475, lambda=0.043683
## - Fold1.Rep3: alpha=0.86475, lambda=0.043683
Chang Liu 25
R for Data Science Lecture 5
## + Fold1.Rep3: alpha=0.10863, lambda=0.154091
## - Fold1.Rep3: alpha=0.10863, lambda=0.154091
## + Fold1.Rep3: alpha=0.98116, lambda=7.405037
## - Fold1.Rep3: alpha=0.98116, lambda=7.405037
## + Fold1.Rep3: alpha=0.94388, lambda=0.002046
## - Fold1.Rep3: alpha=0.94388, lambda=0.002046
## + Fold2.Rep3: alpha=0.63950, lambda=0.004507
## - Fold2.Rep3: alpha=0.63950, lambda=0.004507
## + Fold2.Rep3: alpha=0.04530, lambda=0.016509
## - Fold2.Rep3: alpha=0.04530, lambda=0.016509
## + Fold2.Rep3: alpha=0.97420, lambda=0.004648
## - Fold2.Rep3: alpha=0.97420, lambda=0.004648
## + Fold2.Rep3: alpha=0.34773, lambda=0.060861
## - Fold2.Rep3: alpha=0.34773, lambda=0.060861
## + Fold2.Rep3: alpha=0.51433, lambda=0.001761
## - Fold2.Rep3: alpha=0.51433, lambda=0.001761
## + Fold2.Rep3: alpha=0.31833, lambda=0.479416
## - Fold2.Rep3: alpha=0.31833, lambda=0.479416
## + Fold2.Rep3: alpha=0.74806, lambda=0.327981
## - Fold2.Rep3: alpha=0.74806, lambda=0.327981
## + Fold2.Rep3: alpha=0.14914, lambda=0.028964
## - Fold2.Rep3: alpha=0.14914, lambda=0.028964
## + Fold2.Rep3: alpha=0.84515, lambda=0.897325
## - Fold2.Rep3: alpha=0.84515, lambda=0.897325
## + Fold2.Rep3: alpha=0.93503, lambda=0.082985
## - Fold2.Rep3: alpha=0.93503, lambda=0.082985
## + Fold2.Rep3: alpha=0.38077, lambda=1.148290
## - Fold2.Rep3: alpha=0.38077, lambda=1.148290
## + Fold2.Rep3: alpha=0.84280, lambda=0.045415
## - Fold2.Rep3: alpha=0.84280, lambda=0.045415
## + Fold2.Rep3: alpha=0.98348, lambda=0.006142
## - Fold2.Rep3: alpha=0.98348, lambda=0.006142
## + Fold2.Rep3: alpha=0.78895, lambda=0.042054
## - Fold2.Rep3: alpha=0.78895, lambda=0.042054
## + Fold2.Rep3: alpha=0.52859, lambda=0.428235
## - Fold2.Rep3: alpha=0.52859, lambda=0.428235
## + Fold2.Rep3: alpha=0.73053, lambda=0.015889
## - Fold2.Rep3: alpha=0.73053, lambda=0.015889
Chang Liu 26
R for Data Science Lecture 5
## + Fold2.Rep3: alpha=0.90284, lambda=0.445782
## - Fold2.Rep3: alpha=0.90284, lambda=0.445782
## + Fold2.Rep3: alpha=0.32570, lambda=0.081177
## - Fold2.Rep3: alpha=0.32570, lambda=0.081177
## + Fold2.Rep3: alpha=0.75140, lambda=0.561138
## - Fold2.Rep3: alpha=0.75140, lambda=0.561138
## + Fold2.Rep3: alpha=0.03599, lambda=0.001115
## - Fold2.Rep3: alpha=0.03599, lambda=0.001115
## + Fold2.Rep3: alpha=0.25504, lambda=2.954617
## - Fold2.Rep3: alpha=0.25504, lambda=2.954617
## + Fold2.Rep3: alpha=0.86475, lambda=0.043683
## - Fold2.Rep3: alpha=0.86475, lambda=0.043683
## + Fold2.Rep3: alpha=0.10863, lambda=0.154091
## - Fold2.Rep3: alpha=0.10863, lambda=0.154091
## + Fold2.Rep3: alpha=0.98116, lambda=7.405037
## - Fold2.Rep3: alpha=0.98116, lambda=7.405037
## + Fold2.Rep3: alpha=0.94388, lambda=0.002046
## - Fold2.Rep3: alpha=0.94388, lambda=0.002046
## + Fold3.Rep3: alpha=0.63950, lambda=0.004507
## - Fold3.Rep3: alpha=0.63950, lambda=0.004507
## + Fold3.Rep3: alpha=0.04530, lambda=0.016509
## - Fold3.Rep3: alpha=0.04530, lambda=0.016509
## + Fold3.Rep3: alpha=0.97420, lambda=0.004648
## - Fold3.Rep3: alpha=0.97420, lambda=0.004648
## + Fold3.Rep3: alpha=0.34773, lambda=0.060861
## - Fold3.Rep3: alpha=0.34773, lambda=0.060861
## + Fold3.Rep3: alpha=0.51433, lambda=0.001761
## - Fold3.Rep3: alpha=0.51433, lambda=0.001761
## + Fold3.Rep3: alpha=0.31833, lambda=0.479416
## - Fold3.Rep3: alpha=0.31833, lambda=0.479416
## + Fold3.Rep3: alpha=0.74806, lambda=0.327981
## - Fold3.Rep3: alpha=0.74806, lambda=0.327981
## + Fold3.Rep3: alpha=0.14914, lambda=0.028964
## - Fold3.Rep3: alpha=0.14914, lambda=0.028964
## + Fold3.Rep3: alpha=0.84515, lambda=0.897325
## - Fold3.Rep3: alpha=0.84515, lambda=0.897325
## + Fold3.Rep3: alpha=0.93503, lambda=0.082985
## - Fold3.Rep3: alpha=0.93503, lambda=0.082985
Chang Liu 27
R for Data Science Lecture 5
## + Fold3.Rep3: alpha=0.38077, lambda=1.148290
## - Fold3.Rep3: alpha=0.38077, lambda=1.148290
## + Fold3.Rep3: alpha=0.84280, lambda=0.045415
## - Fold3.Rep3: alpha=0.84280, lambda=0.045415
## + Fold3.Rep3: alpha=0.98348, lambda=0.006142
## - Fold3.Rep3: alpha=0.98348, lambda=0.006142
## + Fold3.Rep3: alpha=0.78895, lambda=0.042054
## - Fold3.Rep3: alpha=0.78895, lambda=0.042054
## + Fold3.Rep3: alpha=0.52859, lambda=0.428235
## - Fold3.Rep3: alpha=0.52859, lambda=0.428235
## + Fold3.Rep3: alpha=0.73053, lambda=0.015889
## - Fold3.Rep3: alpha=0.73053, lambda=0.015889
## + Fold3.Rep3: alpha=0.90284, lambda=0.445782
## - Fold3.Rep3: alpha=0.90284, lambda=0.445782
## + Fold3.Rep3: alpha=0.32570, lambda=0.081177
## - Fold3.Rep3: alpha=0.32570, lambda=0.081177
## + Fold3.Rep3: alpha=0.75140, lambda=0.561138
## - Fold3.Rep3: alpha=0.75140, lambda=0.561138
## + Fold3.Rep3: alpha=0.03599, lambda=0.001115
## - Fold3.Rep3: alpha=0.03599, lambda=0.001115
## + Fold3.Rep3: alpha=0.25504, lambda=2.954617
## - Fold3.Rep3: alpha=0.25504, lambda=2.954617
## + Fold3.Rep3: alpha=0.86475, lambda=0.043683
## - Fold3.Rep3: alpha=0.86475, lambda=0.043683
## + Fold3.Rep3: alpha=0.10863, lambda=0.154091
## - Fold3.Rep3: alpha=0.10863, lambda=0.154091
## + Fold3.Rep3: alpha=0.98116, lambda=7.405037
## - Fold3.Rep3: alpha=0.98116, lambda=7.405037
## + Fold3.Rep3: alpha=0.94388, lambda=0.002046
## - Fold3.Rep3: alpha=0.94388, lambda=0.002046
## + Fold4.Rep3: alpha=0.63950, lambda=0.004507
## - Fold4.Rep3: alpha=0.63950, lambda=0.004507
## + Fold4.Rep3: alpha=0.04530, lambda=0.016509
## - Fold4.Rep3: alpha=0.04530, lambda=0.016509
## + Fold4.Rep3: alpha=0.97420, lambda=0.004648
## - Fold4.Rep3: alpha=0.97420, lambda=0.004648
## + Fold4.Rep3: alpha=0.34773, lambda=0.060861
## - Fold4.Rep3: alpha=0.34773, lambda=0.060861
Chang Liu 28
R for Data Science Lecture 5
## + Fold4.Rep3: alpha=0.51433, lambda=0.001761
## - Fold4.Rep3: alpha=0.51433, lambda=0.001761
## + Fold4.Rep3: alpha=0.31833, lambda=0.479416
## - Fold4.Rep3: alpha=0.31833, lambda=0.479416
## + Fold4.Rep3: alpha=0.74806, lambda=0.327981
## - Fold4.Rep3: alpha=0.74806, lambda=0.327981
## + Fold4.Rep3: alpha=0.14914, lambda=0.028964
## - Fold4.Rep3: alpha=0.14914, lambda=0.028964
## + Fold4.Rep3: alpha=0.84515, lambda=0.897325
## - Fold4.Rep3: alpha=0.84515, lambda=0.897325
## + Fold4.Rep3: alpha=0.93503, lambda=0.082985
## - Fold4.Rep3: alpha=0.93503, lambda=0.082985
## + Fold4.Rep3: alpha=0.38077, lambda=1.148290
## - Fold4.Rep3: alpha=0.38077, lambda=1.148290
## + Fold4.Rep3: alpha=0.84280, lambda=0.045415
## - Fold4.Rep3: alpha=0.84280, lambda=0.045415
## + Fold4.Rep3: alpha=0.98348, lambda=0.006142
## - Fold4.Rep3: alpha=0.98348, lambda=0.006142
## + Fold4.Rep3: alpha=0.78895, lambda=0.042054
## - Fold4.Rep3: alpha=0.78895, lambda=0.042054
## + Fold4.Rep3: alpha=0.52859, lambda=0.428235
## - Fold4.Rep3: alpha=0.52859, lambda=0.428235
## + Fold4.Rep3: alpha=0.73053, lambda=0.015889
## - Fold4.Rep3: alpha=0.73053, lambda=0.015889
## + Fold4.Rep3: alpha=0.90284, lambda=0.445782
## - Fold4.Rep3: alpha=0.90284, lambda=0.445782
## + Fold4.Rep3: alpha=0.32570, lambda=0.081177
## - Fold4.Rep3: alpha=0.32570, lambda=0.081177
## + Fold4.Rep3: alpha=0.75140, lambda=0.561138
## - Fold4.Rep3: alpha=0.75140, lambda=0.561138
## + Fold4.Rep3: alpha=0.03599, lambda=0.001115
## - Fold4.Rep3: alpha=0.03599, lambda=0.001115
## + Fold4.Rep3: alpha=0.25504, lambda=2.954617
## - Fold4.Rep3: alpha=0.25504, lambda=2.954617
## + Fold4.Rep3: alpha=0.86475, lambda=0.043683
## - Fold4.Rep3: alpha=0.86475, lambda=0.043683
## + Fold4.Rep3: alpha=0.10863, lambda=0.154091
## - Fold4.Rep3: alpha=0.10863, lambda=0.154091
Chang Liu 29
R for Data Science Lecture 5
## + Fold4.Rep3: alpha=0.98116, lambda=7.405037
## - Fold4.Rep3: alpha=0.98116, lambda=7.405037
## + Fold4.Rep3: alpha=0.94388, lambda=0.002046
## - Fold4.Rep3: alpha=0.94388, lambda=0.002046
## + Fold5.Rep3: alpha=0.63950, lambda=0.004507
## - Fold5.Rep3: alpha=0.63950, lambda=0.004507
## + Fold5.Rep3: alpha=0.04530, lambda=0.016509
## - Fold5.Rep3: alpha=0.04530, lambda=0.016509
## + Fold5.Rep3: alpha=0.97420, lambda=0.004648
## - Fold5.Rep3: alpha=0.97420, lambda=0.004648
## + Fold5.Rep3: alpha=0.34773, lambda=0.060861
## - Fold5.Rep3: alpha=0.34773, lambda=0.060861
## + Fold5.Rep3: alpha=0.51433, lambda=0.001761
## - Fold5.Rep3: alpha=0.51433, lambda=0.001761
## + Fold5.Rep3: alpha=0.31833, lambda=0.479416
## - Fold5.Rep3: alpha=0.31833, lambda=0.479416
## + Fold5.Rep3: alpha=0.74806, lambda=0.327981
## - Fold5.Rep3: alpha=0.74806, lambda=0.327981
## + Fold5.Rep3: alpha=0.14914, lambda=0.028964
## - Fold5.Rep3: alpha=0.14914, lambda=0.028964
## + Fold5.Rep3: alpha=0.84515, lambda=0.897325
## - Fold5.Rep3: alpha=0.84515, lambda=0.897325
## + Fold5.Rep3: alpha=0.93503, lambda=0.082985
## - Fold5.Rep3: alpha=0.93503, lambda=0.082985
## + Fold5.Rep3: alpha=0.38077, lambda=1.148290
## - Fold5.Rep3: alpha=0.38077, lambda=1.148290
## + Fold5.Rep3: alpha=0.84280, lambda=0.045415
## - Fold5.Rep3: alpha=0.84280, lambda=0.045415
## + Fold5.Rep3: alpha=0.98348, lambda=0.006142
## - Fold5.Rep3: alpha=0.98348, lambda=0.006142
## + Fold5.Rep3: alpha=0.78895, lambda=0.042054
## - Fold5.Rep3: alpha=0.78895, lambda=0.042054
## + Fold5.Rep3: alpha=0.52859, lambda=0.428235
## - Fold5.Rep3: alpha=0.52859, lambda=0.428235
## + Fold5.Rep3: alpha=0.73053, lambda=0.015889
## - Fold5.Rep3: alpha=0.73053, lambda=0.015889
## + Fold5.Rep3: alpha=0.90284, lambda=0.445782
## - Fold5.Rep3: alpha=0.90284, lambda=0.445782
Chang Liu 30
R for Data Science Lecture 5
## + Fold5.Rep3: alpha=0.32570, lambda=0.081177
## - Fold5.Rep3: alpha=0.32570, lambda=0.081177
## + Fold5.Rep3: alpha=0.75140, lambda=0.561138
## - Fold5.Rep3: alpha=0.75140, lambda=0.561138
## + Fold5.Rep3: alpha=0.03599, lambda=0.001115
## - Fold5.Rep3: alpha=0.03599, lambda=0.001115
## + Fold5.Rep3: alpha=0.25504, lambda=2.954617
## - Fold5.Rep3: alpha=0.25504, lambda=2.954617
## + Fold5.Rep3: alpha=0.86475, lambda=0.043683
## - Fold5.Rep3: alpha=0.86475, lambda=0.043683
## + Fold5.Rep3: alpha=0.10863, lambda=0.154091
## - Fold5.Rep3: alpha=0.10863, lambda=0.154091
## + Fold5.Rep3: alpha=0.98116, lambda=7.405037
## - Fold5.Rep3: alpha=0.98116, lambda=7.405037
## + Fold5.Rep3: alpha=0.94388, lambda=0.002046
## - Fold5.Rep3: alpha=0.94388, lambda=0.002046
## + Fold1.Rep4: alpha=0.63950, lambda=0.004507
## - Fold1.Rep4: alpha=0.63950, lambda=0.004507
## + Fold1.Rep4: alpha=0.04530, lambda=0.016509
## - Fold1.Rep4: alpha=0.04530, lambda=0.016509
## + Fold1.Rep4: alpha=0.97420, lambda=0.004648
## - Fold1.Rep4: alpha=0.97420, lambda=0.004648
## + Fold1.Rep4: alpha=0.34773, lambda=0.060861
## - Fold1.Rep4: alpha=0.34773, lambda=0.060861
## + Fold1.Rep4: alpha=0.51433, lambda=0.001761
## - Fold1.Rep4: alpha=0.51433, lambda=0.001761
## + Fold1.Rep4: alpha=0.31833, lambda=0.479416
## - Fold1.Rep4: alpha=0.31833, lambda=0.479416
## + Fold1.Rep4: alpha=0.74806, lambda=0.327981
## - Fold1.Rep4: alpha=0.74806, lambda=0.327981
## + Fold1.Rep4: alpha=0.14914, lambda=0.028964
## - Fold1.Rep4: alpha=0.14914, lambda=0.028964
## + Fold1.Rep4: alpha=0.84515, lambda=0.897325
## - Fold1.Rep4: alpha=0.84515, lambda=0.897325
## + Fold1.Rep4: alpha=0.93503, lambda=0.082985
## - Fold1.Rep4: alpha=0.93503, lambda=0.082985
## + Fold1.Rep4: alpha=0.38077, lambda=1.148290
## - Fold1.Rep4: alpha=0.38077, lambda=1.148290
Chang Liu 31
R for Data Science Lecture 5
## + Fold1.Rep4: alpha=0.84280, lambda=0.045415
## - Fold1.Rep4: alpha=0.84280, lambda=0.045415
## + Fold1.Rep4: alpha=0.98348, lambda=0.006142
## - Fold1.Rep4: alpha=0.98348, lambda=0.006142
## + Fold1.Rep4: alpha=0.78895, lambda=0.042054
## - Fold1.Rep4: alpha=0.78895, lambda=0.042054
## + Fold1.Rep4: alpha=0.52859, lambda=0.428235
## - Fold1.Rep4: alpha=0.52859, lambda=0.428235
## + Fold1.Rep4: alpha=0.73053, lambda=0.015889
## - Fold1.Rep4: alpha=0.73053, lambda=0.015889
## + Fold1.Rep4: alpha=0.90284, lambda=0.445782
## - Fold1.Rep4: alpha=0.90284, lambda=0.445782
## + Fold1.Rep4: alpha=0.32570, lambda=0.081177
## - Fold1.Rep4: alpha=0.32570, lambda=0.081177
## + Fold1.Rep4: alpha=0.75140, lambda=0.561138
## - Fold1.Rep4: alpha=0.75140, lambda=0.561138
## + Fold1.Rep4: alpha=0.03599, lambda=0.001115
## - Fold1.Rep4: alpha=0.03599, lambda=0.001115
## + Fold1.Rep4: alpha=0.25504, lambda=2.954617
## - Fold1.Rep4: alpha=0.25504, lambda=2.954617
## + Fold1.Rep4: alpha=0.86475, lambda=0.043683
## - Fold1.Rep4: alpha=0.86475, lambda=0.043683
## + Fold1.Rep4: alpha=0.10863, lambda=0.154091
## - Fold1.Rep4: alpha=0.10863, lambda=0.154091
## + Fold1.Rep4: alpha=0.98116, lambda=7.405037
## - Fold1.Rep4: alpha=0.98116, lambda=7.405037
## + Fold1.Rep4: alpha=0.94388, lambda=0.002046
## - Fold1.Rep4: alpha=0.94388, lambda=0.002046
## + Fold2.Rep4: alpha=0.63950, lambda=0.004507
## - Fold2.Rep4: alpha=0.63950, lambda=0.004507
## + Fold2.Rep4: alpha=0.04530, lambda=0.016509
## - Fold2.Rep4: alpha=0.04530, lambda=0.016509
## + Fold2.Rep4: alpha=0.97420, lambda=0.004648
## - Fold2.Rep4: alpha=0.97420, lambda=0.004648
## + Fold2.Rep4: alpha=0.34773, lambda=0.060861
## - Fold2.Rep4: alpha=0.34773, lambda=0.060861
## + Fold2.Rep4: alpha=0.51433, lambda=0.001761
## - Fold2.Rep4: alpha=0.51433, lambda=0.001761
Chang Liu 32
R for Data Science Lecture 5
## + Fold2.Rep4: alpha=0.31833, lambda=0.479416
## - Fold2.Rep4: alpha=0.31833, lambda=0.479416
## + Fold2.Rep4: alpha=0.74806, lambda=0.327981
## - Fold2.Rep4: alpha=0.74806, lambda=0.327981
## + Fold2.Rep4: alpha=0.14914, lambda=0.028964
## - Fold2.Rep4: alpha=0.14914, lambda=0.028964
## + Fold2.Rep4: alpha=0.84515, lambda=0.897325
## - Fold2.Rep4: alpha=0.84515, lambda=0.897325
## + Fold2.Rep4: alpha=0.93503, lambda=0.082985
## - Fold2.Rep4: alpha=0.93503, lambda=0.082985
## + Fold2.Rep4: alpha=0.38077, lambda=1.148290
## - Fold2.Rep4: alpha=0.38077, lambda=1.148290
## + Fold2.Rep4: alpha=0.84280, lambda=0.045415
## - Fold2.Rep4: alpha=0.84280, lambda=0.045415
## + Fold2.Rep4: alpha=0.98348, lambda=0.006142
## - Fold2.Rep4: alpha=0.98348, lambda=0.006142
## + Fold2.Rep4: alpha=0.78895, lambda=0.042054
## - Fold2.Rep4: alpha=0.78895, lambda=0.042054
## + Fold2.Rep4: alpha=0.52859, lambda=0.428235
## - Fold2.Rep4: alpha=0.52859, lambda=0.428235
## + Fold2.Rep4: alpha=0.73053, lambda=0.015889
## - Fold2.Rep4: alpha=0.73053, lambda=0.015889
## + Fold2.Rep4: alpha=0.90284, lambda=0.445782
## - Fold2.Rep4: alpha=0.90284, lambda=0.445782
## + Fold2.Rep4: alpha=0.32570, lambda=0.081177
## - Fold2.Rep4: alpha=0.32570, lambda=0.081177
## + Fold2.Rep4: alpha=0.75140, lambda=0.561138
## - Fold2.Rep4: alpha=0.75140, lambda=0.561138
## + Fold2.Rep4: alpha=0.03599, lambda=0.001115
## - Fold2.Rep4: alpha=0.03599, lambda=0.001115
## + Fold2.Rep4: alpha=0.25504, lambda=2.954617
## - Fold2.Rep4: alpha=0.25504, lambda=2.954617
## + Fold2.Rep4: alpha=0.86475, lambda=0.043683
## - Fold2.Rep4: alpha=0.86475, lambda=0.043683
## + Fold2.Rep4: alpha=0.10863, lambda=0.154091
## - Fold2.Rep4: alpha=0.10863, lambda=0.154091
## + Fold2.Rep4: alpha=0.98116, lambda=7.405037
## - Fold2.Rep4: alpha=0.98116, lambda=7.405037
Chang Liu 33
R for Data Science Lecture 5
## + Fold2.Rep4: alpha=0.94388, lambda=0.002046
## - Fold2.Rep4: alpha=0.94388, lambda=0.002046
## + Fold3.Rep4: alpha=0.63950, lambda=0.004507
## - Fold3.Rep4: alpha=0.63950, lambda=0.004507
## + Fold3.Rep4: alpha=0.04530, lambda=0.016509
## - Fold3.Rep4: alpha=0.04530, lambda=0.016509
## + Fold3.Rep4: alpha=0.97420, lambda=0.004648
## - Fold3.Rep4: alpha=0.97420, lambda=0.004648
## + Fold3.Rep4: alpha=0.34773, lambda=0.060861
## - Fold3.Rep4: alpha=0.34773, lambda=0.060861
## + Fold3.Rep4: alpha=0.51433, lambda=0.001761
## - Fold3.Rep4: alpha=0.51433, lambda=0.001761
## + Fold3.Rep4: alpha=0.31833, lambda=0.479416
## - Fold3.Rep4: alpha=0.31833, lambda=0.479416
## + Fold3.Rep4: alpha=0.74806, lambda=0.327981
## - Fold3.Rep4: alpha=0.74806, lambda=0.327981
## + Fold3.Rep4: alpha=0.14914, lambda=0.028964
## - Fold3.Rep4: alpha=0.14914, lambda=0.028964
## + Fold3.Rep4: alpha=0.84515, lambda=0.897325
## - Fold3.Rep4: alpha=0.84515, lambda=0.897325
## + Fold3.Rep4: alpha=0.93503, lambda=0.082985
## - Fold3.Rep4: alpha=0.93503, lambda=0.082985
## + Fold3.Rep4: alpha=0.38077, lambda=1.148290
## - Fold3.Rep4: alpha=0.38077, lambda=1.148290
## + Fold3.Rep4: alpha=0.84280, lambda=0.045415
## - Fold3.Rep4: alpha=0.84280, lambda=0.045415
## + Fold3.Rep4: alpha=0.98348, lambda=0.006142
## - Fold3.Rep4: alpha=0.98348, lambda=0.006142
## + Fold3.Rep4: alpha=0.78895, lambda=0.042054
## - Fold3.Rep4: alpha=0.78895, lambda=0.042054
## + Fold3.Rep4: alpha=0.52859, lambda=0.428235
## - Fold3.Rep4: alpha=0.52859, lambda=0.428235
## + Fold3.Rep4: alpha=0.73053, lambda=0.015889
## - Fold3.Rep4: alpha=0.73053, lambda=0.015889
## + Fold3.Rep4: alpha=0.90284, lambda=0.445782
## - Fold3.Rep4: alpha=0.90284, lambda=0.445782
## + Fold3.Rep4: alpha=0.32570, lambda=0.081177
## - Fold3.Rep4: alpha=0.32570, lambda=0.081177
Chang Liu 34
R for Data Science Lecture 5
## + Fold3.Rep4: alpha=0.75140, lambda=0.561138
## - Fold3.Rep4: alpha=0.75140, lambda=0.561138
## + Fold3.Rep4: alpha=0.03599, lambda=0.001115
## - Fold3.Rep4: alpha=0.03599, lambda=0.001115
## + Fold3.Rep4: alpha=0.25504, lambda=2.954617
## - Fold3.Rep4: alpha=0.25504, lambda=2.954617
## + Fold3.Rep4: alpha=0.86475, lambda=0.043683
## - Fold3.Rep4: alpha=0.86475, lambda=0.043683
## + Fold3.Rep4: alpha=0.10863, lambda=0.154091
## - Fold3.Rep4: alpha=0.10863, lambda=0.154091
## + Fold3.Rep4: alpha=0.98116, lambda=7.405037
## - Fold3.Rep4: alpha=0.98116, lambda=7.405037
## + Fold3.Rep4: alpha=0.94388, lambda=0.002046
## - Fold3.Rep4: alpha=0.94388, lambda=0.002046
## + Fold4.Rep4: alpha=0.63950, lambda=0.004507
## - Fold4.Rep4: alpha=0.63950, lambda=0.004507
## + Fold4.Rep4: alpha=0.04530, lambda=0.016509
## - Fold4.Rep4: alpha=0.04530, lambda=0.016509
## + Fold4.Rep4: alpha=0.97420, lambda=0.004648
## - Fold4.Rep4: alpha=0.97420, lambda=0.004648
## + Fold4.Rep4: alpha=0.34773, lambda=0.060861
## - Fold4.Rep4: alpha=0.34773, lambda=0.060861
## + Fold4.Rep4: alpha=0.51433, lambda=0.001761
## - Fold4.Rep4: alpha=0.51433, lambda=0.001761
## + Fold4.Rep4: alpha=0.31833, lambda=0.479416
## - Fold4.Rep4: alpha=0.31833, lambda=0.479416
## + Fold4.Rep4: alpha=0.74806, lambda=0.327981
## - Fold4.Rep4: alpha=0.74806, lambda=0.327981
## + Fold4.Rep4: alpha=0.14914, lambda=0.028964
## - Fold4.Rep4: alpha=0.14914, lambda=0.028964
## + Fold4.Rep4: alpha=0.84515, lambda=0.897325
## - Fold4.Rep4: alpha=0.84515, lambda=0.897325
## + Fold4.Rep4: alpha=0.93503, lambda=0.082985
## - Fold4.Rep4: alpha=0.93503, lambda=0.082985
## + Fold4.Rep4: alpha=0.38077, lambda=1.148290
## - Fold4.Rep4: alpha=0.38077, lambda=1.148290
## + Fold4.Rep4: alpha=0.84280, lambda=0.045415
## - Fold4.Rep4: alpha=0.84280, lambda=0.045415
Chang Liu 35
R for Data Science Lecture 5
## + Fold4.Rep4: alpha=0.98348, lambda=0.006142
## - Fold4.Rep4: alpha=0.98348, lambda=0.006142
## + Fold4.Rep4: alpha=0.78895, lambda=0.042054
## - Fold4.Rep4: alpha=0.78895, lambda=0.042054
## + Fold4.Rep4: alpha=0.52859, lambda=0.428235
## - Fold4.Rep4: alpha=0.52859, lambda=0.428235
## + Fold4.Rep4: alpha=0.73053, lambda=0.015889
## - Fold4.Rep4: alpha=0.73053, lambda=0.015889
## + Fold4.Rep4: alpha=0.90284, lambda=0.445782
## - Fold4.Rep4: alpha=0.90284, lambda=0.445782
## + Fold4.Rep4: alpha=0.32570, lambda=0.081177
## - Fold4.Rep4: alpha=0.32570, lambda=0.081177
## + Fold4.Rep4: alpha=0.75140, lambda=0.561138
## - Fold4.Rep4: alpha=0.75140, lambda=0.561138
## + Fold4.Rep4: alpha=0.03599, lambda=0.001115
## - Fold4.Rep4: alpha=0.03599, lambda=0.001115
## + Fold4.Rep4: alpha=0.25504, lambda=2.954617
## - Fold4.Rep4: alpha=0.25504, lambda=2.954617
## + Fold4.Rep4: alpha=0.86475, lambda=0.043683
## - Fold4.Rep4: alpha=0.86475, lambda=0.043683
## + Fold4.Rep4: alpha=0.10863, lambda=0.154091
## - Fold4.Rep4: alpha=0.10863, lambda=0.154091
## + Fold4.Rep4: alpha=0.98116, lambda=7.405037
## - Fold4.Rep4: alpha=0.98116, lambda=7.405037
## + Fold4.Rep4: alpha=0.94388, lambda=0.002046
## - Fold4.Rep4: alpha=0.94388, lambda=0.002046
## + Fold5.Rep4: alpha=0.63950, lambda=0.004507
## - Fold5.Rep4: alpha=0.63950, lambda=0.004507
## + Fold5.Rep4: alpha=0.04530, lambda=0.016509
## - Fold5.Rep4: alpha=0.04530, lambda=0.016509
## + Fold5.Rep4: alpha=0.97420, lambda=0.004648
## - Fold5.Rep4: alpha=0.97420, lambda=0.004648
## + Fold5.Rep4: alpha=0.34773, lambda=0.060861
## - Fold5.Rep4: alpha=0.34773, lambda=0.060861
## + Fold5.Rep4: alpha=0.51433, lambda=0.001761
## - Fold5.Rep4: alpha=0.51433, lambda=0.001761
## + Fold5.Rep4: alpha=0.31833, lambda=0.479416
## - Fold5.Rep4: alpha=0.31833, lambda=0.479416
Chang Liu 36
R for Data Science Lecture 5
## + Fold5.Rep4: alpha=0.74806, lambda=0.327981
## - Fold5.Rep4: alpha=0.74806, lambda=0.327981
## + Fold5.Rep4: alpha=0.14914, lambda=0.028964
## - Fold5.Rep4: alpha=0.14914, lambda=0.028964
## + Fold5.Rep4: alpha=0.84515, lambda=0.897325
## - Fold5.Rep4: alpha=0.84515, lambda=0.897325
## + Fold5.Rep4: alpha=0.93503, lambda=0.082985
## - Fold5.Rep4: alpha=0.93503, lambda=0.082985
## + Fold5.Rep4: alpha=0.38077, lambda=1.148290
## - Fold5.Rep4: alpha=0.38077, lambda=1.148290
## + Fold5.Rep4: alpha=0.84280, lambda=0.045415
## - Fold5.Rep4: alpha=0.84280, lambda=0.045415
## + Fold5.Rep4: alpha=0.98348, lambda=0.006142
## - Fold5.Rep4: alpha=0.98348, lambda=0.006142
## + Fold5.Rep4: alpha=0.78895, lambda=0.042054
## - Fold5.Rep4: alpha=0.78895, lambda=0.042054
## + Fold5.Rep4: alpha=0.52859, lambda=0.428235
## - Fold5.Rep4: alpha=0.52859, lambda=0.428235
## + Fold5.Rep4: alpha=0.73053, lambda=0.015889
## - Fold5.Rep4: alpha=0.73053, lambda=0.015889
## + Fold5.Rep4: alpha=0.90284, lambda=0.445782
## - Fold5.Rep4: alpha=0.90284, lambda=0.445782
## + Fold5.Rep4: alpha=0.32570, lambda=0.081177
## - Fold5.Rep4: alpha=0.32570, lambda=0.081177
## + Fold5.Rep4: alpha=0.75140, lambda=0.561138
## - Fold5.Rep4: alpha=0.75140, lambda=0.561138
## + Fold5.Rep4: alpha=0.03599, lambda=0.001115
## - Fold5.Rep4: alpha=0.03599, lambda=0.001115
## + Fold5.Rep4: alpha=0.25504, lambda=2.954617
## - Fold5.Rep4: alpha=0.25504, lambda=2.954617
## + Fold5.Rep4: alpha=0.86475, lambda=0.043683
## - Fold5.Rep4: alpha=0.86475, lambda=0.043683
## + Fold5.Rep4: alpha=0.10863, lambda=0.154091
## - Fold5.Rep4: alpha=0.10863, lambda=0.154091
## + Fold5.Rep4: alpha=0.98116, lambda=7.405037
## - Fold5.Rep4: alpha=0.98116, lambda=7.405037
## + Fold5.Rep4: alpha=0.94388, lambda=0.002046
## - Fold5.Rep4: alpha=0.94388, lambda=0.002046
Chang Liu 37
R for Data Science Lecture 5
## + Fold1.Rep5: alpha=0.63950, lambda=0.004507
## - Fold1.Rep5: alpha=0.63950, lambda=0.004507
## + Fold1.Rep5: alpha=0.04530, lambda=0.016509
## - Fold1.Rep5: alpha=0.04530, lambda=0.016509
## + Fold1.Rep5: alpha=0.97420, lambda=0.004648
## - Fold1.Rep5: alpha=0.97420, lambda=0.004648
## + Fold1.Rep5: alpha=0.34773, lambda=0.060861
## - Fold1.Rep5: alpha=0.34773, lambda=0.060861
## + Fold1.Rep5: alpha=0.51433, lambda=0.001761
## - Fold1.Rep5: alpha=0.51433, lambda=0.001761
## + Fold1.Rep5: alpha=0.31833, lambda=0.479416
## - Fold1.Rep5: alpha=0.31833, lambda=0.479416
## + Fold1.Rep5: alpha=0.74806, lambda=0.327981
## - Fold1.Rep5: alpha=0.74806, lambda=0.327981
## + Fold1.Rep5: alpha=0.14914, lambda=0.028964
## - Fold1.Rep5: alpha=0.14914, lambda=0.028964
## + Fold1.Rep5: alpha=0.84515, lambda=0.897325
## - Fold1.Rep5: alpha=0.84515, lambda=0.897325
## + Fold1.Rep5: alpha=0.93503, lambda=0.082985
## - Fold1.Rep5: alpha=0.93503, lambda=0.082985
## + Fold1.Rep5: alpha=0.38077, lambda=1.148290
## - Fold1.Rep5: alpha=0.38077, lambda=1.148290
## + Fold1.Rep5: alpha=0.84280, lambda=0.045415
## - Fold1.Rep5: alpha=0.84280, lambda=0.045415
## + Fold1.Rep5: alpha=0.98348, lambda=0.006142
## - Fold1.Rep5: alpha=0.98348, lambda=0.006142
## + Fold1.Rep5: alpha=0.78895, lambda=0.042054
## - Fold1.Rep5: alpha=0.78895, lambda=0.042054
## + Fold1.Rep5: alpha=0.52859, lambda=0.428235
## - Fold1.Rep5: alpha=0.52859, lambda=0.428235
## + Fold1.Rep5: alpha=0.73053, lambda=0.015889
## - Fold1.Rep5: alpha=0.73053, lambda=0.015889
## + Fold1.Rep5: alpha=0.90284, lambda=0.445782
## - Fold1.Rep5: alpha=0.90284, lambda=0.445782
## + Fold1.Rep5: alpha=0.32570, lambda=0.081177
## - Fold1.Rep5: alpha=0.32570, lambda=0.081177
## + Fold1.Rep5: alpha=0.75140, lambda=0.561138
## - Fold1.Rep5: alpha=0.75140, lambda=0.561138
Chang Liu 38
R for Data Science Lecture 5
## + Fold1.Rep5: alpha=0.03599, lambda=0.001115
## - Fold1.Rep5: alpha=0.03599, lambda=0.001115
## + Fold1.Rep5: alpha=0.25504, lambda=2.954617
## - Fold1.Rep5: alpha=0.25504, lambda=2.954617
## + Fold1.Rep5: alpha=0.86475, lambda=0.043683
## - Fold1.Rep5: alpha=0.86475, lambda=0.043683
## + Fold1.Rep5: alpha=0.10863, lambda=0.154091
## - Fold1.Rep5: alpha=0.10863, lambda=0.154091
## + Fold1.Rep5: alpha=0.98116, lambda=7.405037
## - Fold1.Rep5: alpha=0.98116, lambda=7.405037
## + Fold1.Rep5: alpha=0.94388, lambda=0.002046
## - Fold1.Rep5: alpha=0.94388, lambda=0.002046
## + Fold2.Rep5: alpha=0.63950, lambda=0.004507
## - Fold2.Rep5: alpha=0.63950, lambda=0.004507
## + Fold2.Rep5: alpha=0.04530, lambda=0.016509
## - Fold2.Rep5: alpha=0.04530, lambda=0.016509
## + Fold2.Rep5: alpha=0.97420, lambda=0.004648
## - Fold2.Rep5: alpha=0.97420, lambda=0.004648
## + Fold2.Rep5: alpha=0.34773, lambda=0.060861
## - Fold2.Rep5: alpha=0.34773, lambda=0.060861
## + Fold2.Rep5: alpha=0.51433, lambda=0.001761
## - Fold2.Rep5: alpha=0.51433, lambda=0.001761
## + Fold2.Rep5: alpha=0.31833, lambda=0.479416
## - Fold2.Rep5: alpha=0.31833, lambda=0.479416
## + Fold2.Rep5: alpha=0.74806, lambda=0.327981
## - Fold2.Rep5: alpha=0.74806, lambda=0.327981
## + Fold2.Rep5: alpha=0.14914, lambda=0.028964
## - Fold2.Rep5: alpha=0.14914, lambda=0.028964
## + Fold2.Rep5: alpha=0.84515, lambda=0.897325
## - Fold2.Rep5: alpha=0.84515, lambda=0.897325
## + Fold2.Rep5: alpha=0.93503, lambda=0.082985
## - Fold2.Rep5: alpha=0.93503, lambda=0.082985
## + Fold2.Rep5: alpha=0.38077, lambda=1.148290
## - Fold2.Rep5: alpha=0.38077, lambda=1.148290
## + Fold2.Rep5: alpha=0.84280, lambda=0.045415
## - Fold2.Rep5: alpha=0.84280, lambda=0.045415
## + Fold2.Rep5: alpha=0.98348, lambda=0.006142
## - Fold2.Rep5: alpha=0.98348, lambda=0.006142
Chang Liu 39
R for Data Science Lecture 5
## + Fold2.Rep5: alpha=0.78895, lambda=0.042054
## - Fold2.Rep5: alpha=0.78895, lambda=0.042054
## + Fold2.Rep5: alpha=0.52859, lambda=0.428235
## - Fold2.Rep5: alpha=0.52859, lambda=0.428235
## + Fold2.Rep5: alpha=0.73053, lambda=0.015889
## - Fold2.Rep5: alpha=0.73053, lambda=0.015889
## + Fold2.Rep5: alpha=0.90284, lambda=0.445782
## - Fold2.Rep5: alpha=0.90284, lambda=0.445782
## + Fold2.Rep5: alpha=0.32570, lambda=0.081177
## - Fold2.Rep5: alpha=0.32570, lambda=0.081177
## + Fold2.Rep5: alpha=0.75140, lambda=0.561138
## - Fold2.Rep5: alpha=0.75140, lambda=0.561138
## + Fold2.Rep5: alpha=0.03599, lambda=0.001115
## - Fold2.Rep5: alpha=0.03599, lambda=0.001115
## + Fold2.Rep5: alpha=0.25504, lambda=2.954617
## - Fold2.Rep5: alpha=0.25504, lambda=2.954617
## + Fold2.Rep5: alpha=0.86475, lambda=0.043683
## - Fold2.Rep5: alpha=0.86475, lambda=0.043683
## + Fold2.Rep5: alpha=0.10863, lambda=0.154091
## - Fold2.Rep5: alpha=0.10863, lambda=0.154091
## + Fold2.Rep5: alpha=0.98116, lambda=7.405037
## - Fold2.Rep5: alpha=0.98116, lambda=7.405037
## + Fold2.Rep5: alpha=0.94388, lambda=0.002046
## - Fold2.Rep5: alpha=0.94388, lambda=0.002046
## + Fold3.Rep5: alpha=0.63950, lambda=0.004507
## - Fold3.Rep5: alpha=0.63950, lambda=0.004507
## + Fold3.Rep5: alpha=0.04530, lambda=0.016509
## - Fold3.Rep5: alpha=0.04530, lambda=0.016509
## + Fold3.Rep5: alpha=0.97420, lambda=0.004648
## - Fold3.Rep5: alpha=0.97420, lambda=0.004648
## + Fold3.Rep5: alpha=0.34773, lambda=0.060861
## - Fold3.Rep5: alpha=0.34773, lambda=0.060861
## + Fold3.Rep5: alpha=0.51433, lambda=0.001761
## - Fold3.Rep5: alpha=0.51433, lambda=0.001761
## + Fold3.Rep5: alpha=0.31833, lambda=0.479416
## - Fold3.Rep5: alpha=0.31833, lambda=0.479416
## + Fold3.Rep5: alpha=0.74806, lambda=0.327981
## - Fold3.Rep5: alpha=0.74806, lambda=0.327981
Chang Liu 40
R for Data Science Lecture 5
## + Fold3.Rep5: alpha=0.14914, lambda=0.028964
## - Fold3.Rep5: alpha=0.14914, lambda=0.028964
## + Fold3.Rep5: alpha=0.84515, lambda=0.897325
## - Fold3.Rep5: alpha=0.84515, lambda=0.897325
## + Fold3.Rep5: alpha=0.93503, lambda=0.082985
## - Fold3.Rep5: alpha=0.93503, lambda=0.082985
## + Fold3.Rep5: alpha=0.38077, lambda=1.148290
## - Fold3.Rep5: alpha=0.38077, lambda=1.148290
## + Fold3.Rep5: alpha=0.84280, lambda=0.045415
## - Fold3.Rep5: alpha=0.84280, lambda=0.045415
## + Fold3.Rep5: alpha=0.98348, lambda=0.006142
## - Fold3.Rep5: alpha=0.98348, lambda=0.006142
## + Fold3.Rep5: alpha=0.78895, lambda=0.042054
## - Fold3.Rep5: alpha=0.78895, lambda=0.042054
## + Fold3.Rep5: alpha=0.52859, lambda=0.428235
## - Fold3.Rep5: alpha=0.52859, lambda=0.428235
## + Fold3.Rep5: alpha=0.73053, lambda=0.015889
## - Fold3.Rep5: alpha=0.73053, lambda=0.015889
## + Fold3.Rep5: alpha=0.90284, lambda=0.445782
## - Fold3.Rep5: alpha=0.90284, lambda=0.445782
## + Fold3.Rep5: alpha=0.32570, lambda=0.081177
## - Fold3.Rep5: alpha=0.32570, lambda=0.081177
## + Fold3.Rep5: alpha=0.75140, lambda=0.561138
## - Fold3.Rep5: alpha=0.75140, lambda=0.561138
## + Fold3.Rep5: alpha=0.03599, lambda=0.001115
## - Fold3.Rep5: alpha=0.03599, lambda=0.001115
## + Fold3.Rep5: alpha=0.25504, lambda=2.954617
## - Fold3.Rep5: alpha=0.25504, lambda=2.954617
## + Fold3.Rep5: alpha=0.86475, lambda=0.043683
## - Fold3.Rep5: alpha=0.86475, lambda=0.043683
## + Fold3.Rep5: alpha=0.10863, lambda=0.154091
## - Fold3.Rep5: alpha=0.10863, lambda=0.154091
## + Fold3.Rep5: alpha=0.98116, lambda=7.405037
## - Fold3.Rep5: alpha=0.98116, lambda=7.405037
## + Fold3.Rep5: alpha=0.94388, lambda=0.002046
## - Fold3.Rep5: alpha=0.94388, lambda=0.002046
## + Fold4.Rep5: alpha=0.63950, lambda=0.004507
## - Fold4.Rep5: alpha=0.63950, lambda=0.004507
Chang Liu 41
R for Data Science Lecture 5
## + Fold4.Rep5: alpha=0.04530, lambda=0.016509
## - Fold4.Rep5: alpha=0.04530, lambda=0.016509
## + Fold4.Rep5: alpha=0.97420, lambda=0.004648
## - Fold4.Rep5: alpha=0.97420, lambda=0.004648
## + Fold4.Rep5: alpha=0.34773, lambda=0.060861
## - Fold4.Rep5: alpha=0.34773, lambda=0.060861
## + Fold4.Rep5: alpha=0.51433, lambda=0.001761
## - Fold4.Rep5: alpha=0.51433, lambda=0.001761
## + Fold4.Rep5: alpha=0.31833, lambda=0.479416
## - Fold4.Rep5: alpha=0.31833, lambda=0.479416
## + Fold4.Rep5: alpha=0.74806, lambda=0.327981
## - Fold4.Rep5: alpha=0.74806, lambda=0.327981
## + Fold4.Rep5: alpha=0.14914, lambda=0.028964
## - Fold4.Rep5: alpha=0.14914, lambda=0.028964
## + Fold4.Rep5: alpha=0.84515, lambda=0.897325
## - Fold4.Rep5: alpha=0.84515, lambda=0.897325
## + Fold4.Rep5: alpha=0.93503, lambda=0.082985
## - Fold4.Rep5: alpha=0.93503, lambda=0.082985
## + Fold4.Rep5: alpha=0.38077, lambda=1.148290
## - Fold4.Rep5: alpha=0.38077, lambda=1.148290
## + Fold4.Rep5: alpha=0.84280, lambda=0.045415
## - Fold4.Rep5: alpha=0.84280, lambda=0.045415
## + Fold4.Rep5: alpha=0.98348, lambda=0.006142
## - Fold4.Rep5: alpha=0.98348, lambda=0.006142
## + Fold4.Rep5: alpha=0.78895, lambda=0.042054
## - Fold4.Rep5: alpha=0.78895, lambda=0.042054
## + Fold4.Rep5: alpha=0.52859, lambda=0.428235
## - Fold4.Rep5: alpha=0.52859, lambda=0.428235
## + Fold4.Rep5: alpha=0.73053, lambda=0.015889
## - Fold4.Rep5: alpha=0.73053, lambda=0.015889
## + Fold4.Rep5: alpha=0.90284, lambda=0.445782
## - Fold4.Rep5: alpha=0.90284, lambda=0.445782
## + Fold4.Rep5: alpha=0.32570, lambda=0.081177
## - Fold4.Rep5: alpha=0.32570, lambda=0.081177
## + Fold4.Rep5: alpha=0.75140, lambda=0.561138
## - Fold4.Rep5: alpha=0.75140, lambda=0.561138
## + Fold4.Rep5: alpha=0.03599, lambda=0.001115
## - Fold4.Rep5: alpha=0.03599, lambda=0.001115
Chang Liu 42
R for Data Science Lecture 5
## + Fold4.Rep5: alpha=0.25504, lambda=2.954617
## - Fold4.Rep5: alpha=0.25504, lambda=2.954617
## + Fold4.Rep5: alpha=0.86475, lambda=0.043683
## - Fold4.Rep5: alpha=0.86475, lambda=0.043683
## + Fold4.Rep5: alpha=0.10863, lambda=0.154091
## - Fold4.Rep5: alpha=0.10863, lambda=0.154091
## + Fold4.Rep5: alpha=0.98116, lambda=7.405037
## - Fold4.Rep5: alpha=0.98116, lambda=7.405037
## + Fold4.Rep5: alpha=0.94388, lambda=0.002046
## - Fold4.Rep5: alpha=0.94388, lambda=0.002046
## + Fold5.Rep5: alpha=0.63950, lambda=0.004507
## - Fold5.Rep5: alpha=0.63950, lambda=0.004507
## + Fold5.Rep5: alpha=0.04530, lambda=0.016509
## - Fold5.Rep5: alpha=0.04530, lambda=0.016509
## + Fold5.Rep5: alpha=0.97420, lambda=0.004648
## - Fold5.Rep5: alpha=0.97420, lambda=0.004648
## + Fold5.Rep5: alpha=0.34773, lambda=0.060861
## - Fold5.Rep5: alpha=0.34773, lambda=0.060861
## + Fold5.Rep5: alpha=0.51433, lambda=0.001761
## - Fold5.Rep5: alpha=0.51433, lambda=0.001761
## + Fold5.Rep5: alpha=0.31833, lambda=0.479416
## - Fold5.Rep5: alpha=0.31833, lambda=0.479416
## + Fold5.Rep5: alpha=0.74806, lambda=0.327981
## - Fold5.Rep5: alpha=0.74806, lambda=0.327981
## + Fold5.Rep5: alpha=0.14914, lambda=0.028964
## - Fold5.Rep5: alpha=0.14914, lambda=0.028964
## + Fold5.Rep5: alpha=0.84515, lambda=0.897325
## - Fold5.Rep5: alpha=0.84515, lambda=0.897325
## + Fold5.Rep5: alpha=0.93503, lambda=0.082985
## - Fold5.Rep5: alpha=0.93503, lambda=0.082985
## + Fold5.Rep5: alpha=0.38077, lambda=1.148290
## - Fold5.Rep5: alpha=0.38077, lambda=1.148290
## + Fold5.Rep5: alpha=0.84280, lambda=0.045415
## - Fold5.Rep5: alpha=0.84280, lambda=0.045415
## + Fold5.Rep5: alpha=0.98348, lambda=0.006142
## - Fold5.Rep5: alpha=0.98348, lambda=0.006142
## + Fold5.Rep5: alpha=0.78895, lambda=0.042054
## - Fold5.Rep5: alpha=0.78895, lambda=0.042054
Chang Liu 43
R for Data Science Lecture 5
## + Fold5.Rep5: alpha=0.52859, lambda=0.428235
## - Fold5.Rep5: alpha=0.52859, lambda=0.428235
## + Fold5.Rep5: alpha=0.73053, lambda=0.015889
## - Fold5.Rep5: alpha=0.73053, lambda=0.015889
## + Fold5.Rep5: alpha=0.90284, lambda=0.445782
## - Fold5.Rep5: alpha=0.90284, lambda=0.445782
## + Fold5.Rep5: alpha=0.32570, lambda=0.081177
## - Fold5.Rep5: alpha=0.32570, lambda=0.081177
## + Fold5.Rep5: alpha=0.75140, lambda=0.561138
## - Fold5.Rep5: alpha=0.75140, lambda=0.561138
## + Fold5.Rep5: alpha=0.03599, lambda=0.001115
## - Fold5.Rep5: alpha=0.03599, lambda=0.001115
## + Fold5.Rep5: alpha=0.25504, lambda=2.954617
## - Fold5.Rep5: alpha=0.25504, lambda=2.954617
## + Fold5.Rep5: alpha=0.86475, lambda=0.043683
## - Fold5.Rep5: alpha=0.86475, lambda=0.043683
## + Fold5.Rep5: alpha=0.10863, lambda=0.154091
## - Fold5.Rep5: alpha=0.10863, lambda=0.154091
## + Fold5.Rep5: alpha=0.98116, lambda=7.405037
## - Fold5.Rep5: alpha=0.98116, lambda=7.405037
## + Fold5.Rep5: alpha=0.94388, lambda=0.002046
## - Fold5.Rep5: alpha=0.94388, lambda=0.002046
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.255, lambda = 2.95 on full training set
# Model Prediction
y_hat_pre <- predict(elastic_model, X)
y_hat_pre
## Mazda RX4 Mazda RX4 Wag Datsun 710 Hornet 4 Drive
## -76.689730 -63.507267 -101.480805 -3.325839
## Hornet Sportabout Valiant Duster 360 Merc 240D
## 93.829305 4.352543 106.753683 -93.017947
## Merc 230 Merc 280 Merc 280C Merc 450SE
## -101.213698 -41.043819 -46.153274 114.245778
## Merc 450SL Merc 450SLC Cadillac Fleetwood Lincoln Continental
## 88.607576 88.721132 183.384131 202.849050
Chang Liu 44
R for Data Science Lecture 5
## Chrysler Imperial Fiat 128 Honda Civic Toyota Corolla
## 209.473900 -133.055889 -197.967302 -162.997974
## Toyota Corona Dodge Challenger AMC Javelin Camaro Z28
## -100.028842 86.105235 76.459696 129.422705
## Pontiac Firebird Fiat X1-9 Porsche 914-2 Lotus Europa
## 122.084701 -146.857166 -107.839739 -155.648579
## Ford Pantera L Ferrari Dino Maserati Bora Volvo 142E
## 100.300718 -67.158840 74.668657 -83.272098
# Plot
plot(elastic_model, main = "Elastic Net Regression")
Elastic Net Regression
Regularization Parameter
0.0165093099991542 0.0829852579927621
0.0289642507893573 0.154090592241317
0.0420535300675737 0.327981224069327
0.0436832243254204 0.428235457044259
0.0454153120956423 0.445781722010769
0.0608610736326484 0.47941572765797
0.0811774345923398 0.561137521217022
RMSE (Repeated Cross−Validation)
42
40
38
36
0.0 0.2 0.4 0.6 0.8 1.0
Mixing Percentage
Chang Liu 45
R for Data Science Lecture 5
K-nearest Neighbors Algorithm
K-Nearest Neighbor or K-NN is a Supervised Non-linear classification algorithm. K-NN is a
Non-parametric algorithm i.e it doesn’t make any assumption about underlying data or its
distribution. It is one of the simplest and widely used algorithm which depends on it’s k
value(Neighbors) and finds it’s applications in many industries like finance industry, healthcare
industry etc.
In the KNN algorithm, K specifies the number of neighbors and its algorithm is as follows:
• Choose the number K of neighbor.
• Take the K Nearest Neighbor of unknown data point according to distance.
• Among the K-neighbors, Count the number of data points in each category.
• Assign the new data point to a category, where you counted the most neighbors.
For the Nearest Neighbor classifier, the distance between two points is expressed in the form of
Euclidean Distance.
df <- data(iris) ##load data
head(iris) ## see the studcture
Chang Liu 46
R for Data Science Lecture 5
## [Link] [Link] [Link] [Link] Species
## 1 5.1 3.5 1.4 0.2 setosa
## 2 4.9 3.0 1.4 0.2 setosa
## 3 4.7 3.2 1.3 0.2 setosa
## 4 4.6 3.1 1.5 0.2 setosa
## 5 5.0 3.6 1.4 0.2 setosa
## 6 5.4 3.9 1.7 0.4 setosa
##Generate a random number that is 90% of the total number of rows in dataset.
ran <- sample(1:nrow(iris), 0.9 * nrow(iris))
##the normalization function is created
nor <-function(x) { (x -min(x))/(max(x)-min(x)) }
##Run nomalization on first 4 coulumns of dataset because they are the predictors
iris_norm <- [Link](lapply(iris[,c(1,2,3,4)], nor))
summary(iris_norm)
## [Link] [Link] [Link] [Link]
## Min. :0.0000 Min. :0.0000 Min. :0.0000 Min. :0.00000
## 1st Qu.:0.2222 1st Qu.:0.3333 1st Qu.:0.1017 1st Qu.:0.08333
## Median :0.4167 Median :0.4167 Median :0.5678 Median :0.50000
## Mean :0.4287 Mean :0.4406 Mean :0.4675 Mean :0.45806
## 3rd Qu.:0.5833 3rd Qu.:0.5417 3rd Qu.:0.6949 3rd Qu.:0.70833
## Max. :1.0000 Max. :1.0000 Max. :1.0000 Max. :1.00000
##extract training set
iris_train <- iris_norm[ran,]
##extract testing set
iris_test <- iris_norm[-ran,]
##extract 5th column of train dataset because it will be used as 'cl' argument in knn
,→ function.
iris_target_category <- iris[ran,5]
##extract 5th column if test dataset to measure the accuracy
iris_test_category <- iris[-ran,5]
##load the package class
library(class)
##run knn function
pr <- knn(iris_train,iris_test,cl=iris_target_category,k=13)
Chang Liu 47
R for Data Science Lecture 5
##create confusion matrix
tab <- table(pr,iris_test_category)
##this function divides the correct predictions by total number of predictions that
,→ tell us how accurate teh model is.
accuracy <- function(x){sum(diag(x)/(sum(rowSums(x)))) * 100}
accuracy (tab)
## [1] 100
In the iris dataset that is already available in R, I have run the k-nearest neighbor algorithm
that gave me 80% accurate result. First, I normalized the data to convert [Link],
[Link], [Link] and [Link] into a standardized 0-to-1 form so that we can fit
them into one box (one graph) and also because our main objective is to predict whether a
flower is virginica, Versicolor, or setosa and that is why I excluded the column 5 and stored
it into another variable called iris_target_category. Then, I separated the normalized values
into training and testing dataset. Imagine it this way, that the values from training dataset
are firstly drawn on a graph and after we run knn function with all the necessary arguments,
we introduce testing dataset’s values into the graph and calculate Euclidean distance with
each and every already stored point in graph. Now, although we know which flower it is in
testing dataset, we still predict the values and store them in variable called “pr” so that we can
compare predicted values with original testing dataset’s values. This way we understand the
accuracy of our model and if we are to get new 50 values in future and we are asked to predict
the category of those 50 values, we can do that with this model.
Chang Liu 48
R for Data Science Lecture 5
Decision Tree
Decision Trees are versatile Machine Learning algorithm that can perform both classification
and regression tasks. They are very powerful algorithms, capable of fitting complex datasets.
Besides, decision trees are fundamental components of random forests, which are among the
most potent Machine Learning algorithms available today.
library(tidyverse)
library(rpart)
library(partykit)
## Loading required package: grid
## Loading required package: libcoin
## Loading required package: mvtnorm
happiness2017 <- read_csv("data/happinessdata_2017.csv")
## Rows: 1420 Columns: 10
## -- Column specification --------------------------------------------------------
## Delimiter: ","
## chr (2): country, continent
## dbl (8): year, life_ladder, logGDP, social_support, life_exp, freedom, gener...
##
## i Use `spec()` to retrieve the full column specification for this data.
## i Specify the column types or set `show_col_types = FALSE` to quiet this message.
happiness2017 <- happiness2017 %>%
mutate(life_exp_category = case_when(life_exp > 60 ~ "Good",
life_exp <= 60 ~ "Poor"))
[Link](834)
n <- nrow(happiness2017); # number of obs in the full dataset n
# Add row IDs to happiness data
happiness2017 <- happiness2017 %>% rowid_to_column() # Random sample of 80% of row
,→ indices
Chang Liu 49
R for Data Science Lecture 5
training_indices <- sample(1:n, size=round(0.8*n))
train <- happiness2017 %>% filter(rowid %in% training_indices)
test <- happiness2017 %>% filter(!(rowid %in% training_indices))
# Fit the tree based on training data
tree1 <- rpart(life_exp_category ~ social_support, data=train)
plot([Link](tree1), type="simple")
1
social_support
≥ 0.83 < 0.83
2 3
Good
social_support
(n = 576, err = 10.6%)
≥ 0.725 < 0.725
4 5
Good Poor
(n = 315, err = 42.2%) (n = 230, err = 29.6%)
# Fit the tree based on training data
tree2 <- rpart(life_exp_category ~ logGDP + social_support + freedom + generosity,
,→ data=train)
plot([Link](tree2), type="simple")
Chang Liu 50
R for Data Science Lecture 5
1
logGDP
2≥ 8.723 < 8.723 3
Good
logGDP
(n = 750, err = 8.1%)
4 ≥ 8.265 < 8.265
11
Poor
social_support
(n = 279, err = 11.5%)
5 ≥ 0.737 < 0.737
10
Poor
logGDP
(n = 34, err = 17.6%)
6< 8.504 ≥ 8.504 7
Good
social_support
(n = 44, err = 9.1%)
8≥ 0.833< 0.8339
Good Poor
(n = 7, err = 0.0%)
(n = 17, err = 0.0%)
### Tree from (b)
predicted_tree1 <- predict(tree1, newdata = test, type="class")
table(predicted_tree1, test$life_exp_category)
##
## predicted_tree1 Good Poor
## Good 183 47
## Poor 11 39
m <- table(predicted_tree1, test$life_exp_category)
tp <- m[1,1] / sum(m[,1])
tn <- m[2,2] / sum(m[,2])
accuracy <- sum(diag(m))/sum(m)
c(tp, tn, accuracy)
## [1] 0.9432990 0.4534884 0.7928571
Chang Liu 51
R for Data Science Lecture 5
predicted_tree2 <- predict(tree2, newdata = test, type="class")
table(predicted_tree2, test$life_exp_category)
##
## predicted_tree2 Good Poor
## Good 188 18
## Poor 6 68
m <- table(predicted_tree2, test$life_exp_category)
tp <- m[1,1] / sum(m[,1])
tn <- m[2,2] / sum(m[,2])
accuracy <- sum(diag(m))/sum(m)
c(tp, tn, accuracy)
## [1] 0.9690722 0.7906977 0.9142857
Chang Liu 52
R for Data Science Lecture 5
Bagging (extension: Random forest)
Bagging is a powerful method to improve the performance of simple models and reduce overfitting
of more complex models. The principle is very easy to understand, instead of fitting the model on
one sample of the population, several models are fitted on different samples (with replacement)
of the population. Then, these models are aggregated by using their average, weighted average
or a voting system (mainly for classification).
Though bagging reduces the explanatory ability of your model, it makes it much more robust
and able to get the “big picture” from your data.
To build a bagged trees, the process is easy. Let’s say you want 100 models that you will average,
for each of the hundred iterations you will:
• Take a sample with replacement of your original dataset
• Train a regression tree on this sample (you can learn more on classification trees there,
regression trees are similar)
• Save the model with your other models
Once you trained all your models, to get a prediction from your bagged model on new data, you
will need to:
• Get the estimate from each of the individual trees you saved.
• Average the estimates.
library(rpart)
require(ggplot2)
library([Link])
##
## Attaching package: '[Link]'
## The following objects are masked from 'package:dplyr':
##
## between, first, last
## The following object is masked from 'package:purrr':
##
## transpose
Chang Liu 53
R for Data Science Lecture 5
[Link](456)
##Reading data
bagging_data=[Link](airquality)
ggplot(bagging_data,aes(Wind,Ozone))+geom_point()+ggtitle("Ozone vs wind speed")
## Warning: Removed 37 rows containing missing values (geom_point).
Ozone vs wind speed
150
100
Ozone
50
5 10 15 20
Wind
data_test=[Link](bagging_data[,.(Ozone,Wind)])
##Training data
train_index=[Link](nrow(data_test),size=round(nrow(data_test)*0.8),replace = F)
data_test[train_index,train:=TRUE][-train_index,train:=FALSE]
data_test
## Ozone Wind train
## 1: 41 7.4 TRUE
## 2: 36 8.0 FALSE
Chang Liu 54
R for Data Science Lecture 5
## 3: 12 12.6 TRUE
## 4: 18 11.5 TRUE
## 5: 28 14.9 TRUE
## ---
## 112: 14 16.6 TRUE
## 113: 30 6.9 TRUE
## 114: 14 14.3 TRUE
## 115: 18 8.0 TRUE
## 116: 20 11.5 TRUE
##Model without bagging
no_bag_model=rpart(Ozone~Wind,data_test[train_index],control=[Link](minsplit=6))
result_no_bag=predict(no_bag_model,bagging_data)
##Training of the bagged model
n_model=100
bagged_models=list()
for (i in 1:n_model)
{
new_sample=sample(train_index,size=length(train_index),replace=T)
,→ bagged_models=c(bagged_models,list(rpart(Ozone~Wind,data_test[new_sample],control=[Link](m
}
##Getting estimate from the bagged model
bagged_result=NULL
i=0
for (from_bag_model in bagged_models)
{
if ([Link](bagged_result))
bagged_result=predict(from_bag_model,bagging_data)
else
bagged_result=(i*bagged_result+predict(from_bag_model,bagging_data))/(i+1)
i=i+1
}
Chang Liu 55
R for Data Science Lecture 5
Unique Value
df <- [Link](team=c('A', 'A', 'B', 'B', 'C', 'C'),
points=c(90, 99, 90, 85, 90, 85),
assists=c(33, 33, 31, 39, 34, 34),
rebounds=c(30, 28, 24, 24, 28, 28))
unique(df$team)
## [1] "A" "B" "C"
unique(df$points)
## [1] 90 99 85
#find and sort unique values in 'points' column
sort(unique(df$points))
## [1] 85 90 99
#find and sort unique values in 'points' column
sort(unique(df$points), decreasing=TRUE)
## [1] 99 90 85
#find and count unique values in 'points' column
table(df$points)
##
## 85 90 99
## 2 3 1
Chang Liu 56
R for Data Science Lecture 5
Length
#create vector
my_vector <- c(2, 7, 6, 6, 9, 10, 14, 13, 4, 20, NA)
#calculate length of vector
length(my_vector)
## [1] 11
my_vector <- c(2, 7, 6, 6, 9, 10, 14, 13, 4, 20, NA)
#calculate length of vector, excluding NA values
sum()
## [1] 10
#create list
my_list <- list(A=1:5, B=c('hey', 'hi'), C=c(3, 5, 7))
#calculate length of entire list
length(my_list)
## [1] 3
#calculate length of first element in list
length(my_list[[1]])
## [1] 5
#create data frame
df <- [Link](team=c('A', 'B', 'B', 'B', 'C', 'D'),
points=c(10, 15, 29, 24, 30, 31))
nrow(df)
## [1] 6
Chang Liu 57
R for Data Science Lecture 5
#define string
my_string <- "hey there"
#calculate length of string
length(my_string)
## [1] 1
#define string
my_string <- "hey there"
#calculate total characters in string
nchar(my_string)
## [1] 9
Chang Liu 58
R for Data Science Lecture 5
Gsub
The gsub() function in R can be used to replace all occurrences of certain text within a string
in R.
gsub(pattern, replacement, x)
• pattern: The pattern to look for
• replacement: The replacement for the pattern
• x: The string to search
x <- "This is a fun sentence"
#replace 'fun' with 'great'
x <- gsub('fun', 'great', x)
#view updated string
x
## [1] "This is a great sentence"
#define vector
x <- c('Mavs', 'Mavs', 'Spurs', 'Nets', 'Spurs', 'Mavs')
#replace 'Mavs' with 'M'
x <- gsub('Mavs', 'M', x)
#view updated vector
x
## [1] "M" "M" "Spurs" "Nets" "Spurs" "M"
#define vector
x <- c('A', 'A', 'B', 'C', 'D', 'D')
#replace 'A' or 'B' or 'C' with 'X'
Chang Liu 59
R for Data Science Lecture 5
x <- gsub('A|B|C', 'X', x)
#view updated string
x
## [1] "X" "X" "X" "X" "D" "D"
#define data frame
df <- [Link](team=c('A', 'B', 'C', 'D'),
conf=c('West', 'West', 'East', 'East'),
points=c(99, 98, 92, 87),
rebounds=c(18, 22, 26, 19))
#replace 'West' and 'East' with 'W' and 'E'
df$conf <- gsub('West', 'W', df$conf)
df$conf <- gsub('East', 'E', df$conf)
#view updated data frame
df
## team conf points rebounds
## 1 A W 99 18
## 2 B W 98 22
## 3 C E 92 26
## 4 D E 87 19
Chang Liu 60
R for Data Science Lecture 5
sampling
Stratified Sampling
Researchers often take samples from a population and use the data from the sample to draw
conclusions about the population as a whole.
One commonly used sampling method is stratified random sampling, in which a population is
split into groups and a certain number of members from each group are randomly selected to
be included in the sample.
#make this example reproducible
[Link](1)
#create data frame
df <- [Link](grade = rep(c('Freshman', 'Sophomore', 'Junior', 'Senior'),
,→ each=100),
gpa = rnorm(400, mean=85, sd=3))
#view first six rows of data frame
head(df)
## grade gpa
## 1 Freshman 83.12064
## 2 Freshman 85.55093
## 3 Freshman 82.49311
## 4 Freshman 89.78584
## 5 Freshman 85.98852
## 6 Freshman 82.53859
library(dplyr)
#obtain stratified sample
strat_sample <- df %>%
group_by(grade) %>%
sample_n(size=10)
#find frequency of students from each grade
table(strat_sample$grade)
Chang Liu 61
R for Data Science Lecture 5
##
## Freshman Junior Senior Sophomore
## 10 10 10 10
library(dplyr)
#obtain stratified sample
strat_sample <- df %>%
group_by(grade) %>%
sample_frac(size=.15)
#find frequency of students from each grade
table(strat_sample$grade)
##
## Freshman Junior Senior Sophomore
## 15 15 15 15
Chang Liu 62
R for Data Science Lecture 5
Cluster Sampling
One commonly used sampling method is cluster sampling, in which a population is split into
clusters and all members of some clusters are chosen to be included in the sample.
[Link](1)
#create data frame
df <- [Link](tour = rep(1:10, each=20),
experience = rnorm(200, mean=7, sd=1))
#view first six rows of data frame
head(df)
## tour experience
## 1 1 6.373546
## 2 1 7.183643
## 3 1 6.164371
## 4 1 8.595281
## 5 1 7.329508
## 6 1 6.179532
#randomly choose 4 tour groups out of the 10
clusters <- sample(unique(df$tour), size=4, replace=F)
#define sample as all members who belong to one of the 4 tour groups
cluster_sample <- df[df$tour %in% clusters, ]
#view how many customers came from each tour
table(cluster_sample$tour)
##
## 1 2 3 7
## 20 20 20 20
Chang Liu 63
R for Data Science Lecture 5
Systematic Sampling
One commonly used sampling method is systematic sampling, which is implemented with a
simple two step process:
1. Place each member of a population in some order.
2. Choose a random starting point and select every nth member to be in the sample.
#make this example reproducible
[Link](1)
#create simple function to generate random last names
randomNames <- function(n = 5000) {
[Link](paste0, replicate(5, sample(LETTERS, n, TRUE), FALSE))
}
#create data frame
df <- [Link](last_name = randomNames(500),
gpa = rnorm(500, mean=82, sd=3))
#view first six rows of data frame
head(df)
## last_name gpa
## 1 YLGRG 74.66755
## 2 DCVUK 80.74210
## 3 GZXSE 80.89685
## 4 ARZOG 80.31026
## 5 BNVRR 77.83073
## 6 WMWJM 80.10269
#define function to obtain systematic sample
obtain_sys = function(N,n){
k = ceiling(N/n)
r = sample(1:k, 1)
seq(r, r + k*(n-1), k)
}
#obtain systematic sample
sys_sample_df = df[obtain_sys(nrow(df), 100), ]
Chang Liu 64
R for Data Science Lecture 5
#view first six rows of data frame
head(sys_sample_df)
## last_name gpa
## 5 BNVRR 77.83073
## 10 SBTFE 81.51290
## 15 VPJTO 80.63059
## 20 OVQCE 83.80557
## 25 NLJRM 83.35642
## 30 YMCZO 82.31994
Chang Liu 65