0% found this document useful (0 votes)
12 views7 pages

Multi-Linear Regression Analysis on Startup Profit

This assignment focuses on using multiple linear regression to predict startup profits based on R&D Spend, Administration, and Marketing Spend. The analysis reveals that R&D Spend has a significant positive impact on profits, while Administration and Marketing Spend do not significantly influence profits. The model is statistically significant, meets regression assumptions, and identifies an outlier that does not affect the overall results.

Uploaded by

sumyaaktereva
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
12 views7 pages

Multi-Linear Regression Analysis on Startup Profit

This assignment focuses on using multiple linear regression to predict startup profits based on R&D Spend, Administration, and Marketing Spend. The analysis reveals that R&D Spend has a significant positive impact on profits, while Administration and Marketing Spend do not significantly influence profits. The model is statistically significant, meets regression assumptions, and identifies an outlier that does not affect the overall results.

Uploaded by

sumyaaktereva
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

The purpose of this assignment is to explore multiple linear

regression techniques to predict business outcomes. You will analyze


the provided dataset to identify the factors influencing the profit of
startups while performing diagnostic checks.

1. Dataset Description:
There are 5 variables mentioned below where dependent variable is “Profit” and
the rest of the variables are independent variables except “State”.
1. R&D Spend: The amount spent on research and development (continuous).
2. Administration: Administrative expenses (continuous).
3. Marketing Spend: Marketing budget (continuous).
4. State: Location of the startup (categorical).
5. Profit: Profit of the startup (continuous target variable).
This analysis will show whether R&D spend, Administration, Marketing Spend
have any significant effect on profit or not. We will also be able to know about the
most influencing factor among these three factors.

2. Regression Model Summary:


Dependent Variable: Profit
Independent Variable: R&D Spend, Administration, Marketing Spend
Hypothesis being tested:
1. H0=Null Hypothesis (All means are square) which means there is no
significant influence on profit for any of the independent variables.
2. H1=Alternate Hypothesis (Means are different) which means there is at least
one highly significant influence of the independent variables on profit.
3. Model Summary Table:

Model Summaryb

Change Statistics
Adjusted R Std. Error of R Square Sig. F
Model R R Square Square the Estimate Change F Change df1 df2 Change
1 .975a .951 .948 9232.33484 .951 295.978 3 46 .000

a. Predictors: (Constant), MarketingSpend, Administration, RDSpend

b. Dependent Variable: Profit

Since there are only 3 independent variables, R2 will be considered instead of


adjusted R2. From the model summary table, it is seen that 0.951 or 95.1% of data
can be represented through this model.

4. ANOVA Table:

ANOVAa
Model Sum of Squares df Mean Square F Sig.
1 Regression 75683964196.1 3 25227988065.3 295.978 .000b
93 98
Residual 3920856300.95 46 85236006.543
7
Total 79604820497.1 49
49
a. Dependent Variable: Profit
b. Predictors: (Constant), MarketingSpend, Administration, RDSpend

From this table, the critical value for a 95% confidence interval is 1.96, so clearly
Fcr is way less than the value of F (variation between sample means within the
samples) =295.978. That means the model is statistically significant. Also, the
value of P(Sig.) =0.000b < 0.05 indicates the model is highly significant that rejects
null hypothesis.

5. Coefficients Table:

Coefficientsa

Standardi
zed
Unstandardized Coefficie 95.0% Confidence Collinearity
Coefficients nts Interval for B Correlations Statistics
Std. Lower Upper Zero- Partia Tolera
Model B Error Beta t Sig. Bound Bound order l Part nce VIF
1 (Constant) 50122.1 6572.35 7.626 .000 36892.73 63351.65
93 3 3 3
RDSpend .806 .045 .918 17.84 .000 .715 .897 .973 .935 .584 .405 2.469
6
Administrat -.027 .051 -.019 -.526 .602 -.130 .076 .201 -.077 -.017 .851 1.175
ion
MarketingS .027 .016 .083 1.655 .105 -.006 .060 .748 .237 .054 .430 2.327
pend
a. Dependent Variable: Profit

From the table, we can see the value of B which is the coefficient of dependent
variable profit, is very high for R&D Spend. It means for 1 unit of change in R&D
Spend variable, it will increase the dependent variable profit by 0.806 unit. The
impact of Administration and Marketing Spend is similar but opposite. 1 unit
change of Administration variable will reduce profit by 0.027 and Marketing Spend
will increase profit by 0.027.
Similarly from Beta column, 1 unit change of standard deviation in R &D spend will
increase profit by 0.918 unit whereas the impact of administration and marketing
spend is very low.
From the value of P, it is evident that only R&D spend variable has significant
impact. But P for administration and marketing spend is more than 0.05,
indicating no considerable significance on profit.
6. Residual Analysis:

This histogram represents almost a normal distribution of data. But due to its
slight negative skewness, there are outliers that might have significant or non-
significant impact. Also, the normal P-P plot regression shows us that data are
almost equally distributed along the fitted line. We can say, most of the predicted
value aligns with the actual values. So. This model meets the assumption of
“Normality”.

From the scattered plot, it can be said that the standardized residual values make
a square box shape almost equally distributed on the both side of the X-axis. So,
the residual is homoscedastic meeting another assumption of multilinear
regression.

7. Multicollinearity Check:
Coefficientsa

Standardi
zed
Unstandardized Coefficie 95.0% Confidence Collinearity
Coefficients nts Interval for B Correlations Statistics
Std. Lower Upper Zero- Partia Tolera
Model B Error Beta t Sig. Bound Bound order l Part nce VIF
1 (Constant) 50122.1 6572.35 7.626 .000 36892.73 63351.65
93 3 3 3
RDSpend .806 .045 .918 17.84 .000 .715 .897 .973 .935 .584 .405 2.469
6
Administrat -.027 .051 -.019 -.526 .602 -.130 .076 .201 -.077 -.017 .851 1.175
ion
MarketingS .027 .016 .083 1.655 .105 -.006 .060 .748 .237 .054 .430 2.327
pend
a. Dependent Variable: Profit
From collinearity statistics, each VIF(variation inflation factor) of independent
variables is less than 10 and each tolerance of independent variables is greater
than 0.1. That means the relations between the independent variables are not
significant at all meeting the assumption of non-collinearity for regression model.

8. Outliers and Influence Diagnostics:

Casewise Diagnosticsa
Case Number Std. Residual Profit Predicted Value Residual
50 -3.632 14681.40 48215.1341 -33533.73411
a. Dependent Variable: Profit

Here case 50 might be an outlier because the value of residual is thousand times
more than the standard residual. To analyze if it has impact on our model or not,
we have to check Cook’s distance and Mahal’s distance.

Residuals Statisticsa
Minimum Maximum Mean Std. Deviation N
Predicted Value 46490.5898 192521.2500 112012.6392 39301.02668 50
Std. Predicted Value -1.667 2.049 .000 1.000 50
Standard Error of Predicted 1436.328 4528.567 2516.829 703.092 50
Value
Adjusted Predicted Value 46021.6523 192558.2656 112081.8979 39177.30313 50
Residual -33533.73437 17275.42969 .00000 8945.24877 50
Std. Residual -3.632 1.871 .000 .969 50
Stud. Residual -3.776 1.957 -.003 1.011 50
Deleted Residual -36243.71875 18904.42578 -69.25866 9749.34771 50
Stud. Deleted Residual -4.496 2.022 -.017 1.078 50
Mahal. Distance .206 10.809 2.940 2.322 50
Cook's Distance .000 .288 .023 .050 50
Centered Leverage Value .004 .221 .060 .047 50
a. Dependent Variable: Profit

Since the maximum cook’s distance is 0.288 which is less than 1 and the
maximum value of Mahal’s distance is 10.809 which is also less than 13.82, it
means the outlier hence case 50 has negligible impact on this regression model.
There is no need to remove this row.

9. Conclusion:
Through multilinear regression technique, we can reject null hypothesis and it is
evident that the influence of R&D Spending variable on profit is maximum and
highly significant whereas the significance of other independent variables is
negligible. This model has an outlier of case 50 but its impact is not considerable
so there’s no need to remove this case. The multilinear regression is verified
meeting all of its assumption.

Common questions

Powered by AI

R&D Spend is identified as the most significant factor influencing the startup profit. This conclusion is supported by various diagnostic checks: the coefficient analysis reveals a strong standardized Beta coefficient of 0.918 for R&D Spend, and an insignificant p-value (0.000), indicating high significance. The model’s fit and assumptions like normality, homoscedasticity, and non-collinearity are also verified, ensuring the reliability of the conclusion drawn .

Cook's distance and Mahalanobis Distance are diagnostic measures to identify influential outliers that might unduly affect the model. The maximum Cook's distance recorded is 0.288 and the maximum Mahalanobis distance is 10.809, both values being below their respective threshold levels (1 for Cook's, 13.82 for Mahalanobis). This indicates that while there is an outlier (Case 50), its influence on the overall regression model is negligible and does not necessitate its removal from the data .

Multicollinearity checks assess the extent of correlation between independent variables, which can affect the stability and interpretation of the regression coefficients. In this model, the VIF values are all below 10, and Tolerance values are greater than 0.1, indicating well above the threshold of significant multicollinearity issues. This suggests that the independent variables are not highly correlated, thus confirming the non-collinearity assumption required for a reliable regression model .

The primary aim of using multiple linear regression in analyzing the startup dataset is to predict business outcomes, particularly the profit of startups, by examining the influence of various independent variables, such as R&D Spend, Administration, and Marketing Spend, on profit. This analysis helps in identifying which factors are most significant in driving profit, allowing for better business decision-making. Multiple linear regression facilitates understanding by quantifying the relationship between these variables and showing how changes in the independent variables are expected to influence the dependent variable, Profit .

The model summary indicates the effectiveness of the regression model by showing an R value of 0.975 and an R Square value of 0.951. This means that 95.1% of the variability in the profit data can be explained by the independent variables in the model, indicating a very high level of effectiveness of the model in predicting the dependent variable, Profit. The R Square value signifies how well the independent variables explain the variation in the dependent variable, with higher values indicating a better fit .

The residual analysis confirms the assumptions of normality and homoscedasticity. The histogram of residuals shows an almost normal distribution, with only slight negative skewness, suggesting normality. The normal P-P plot confirms this by showing data points closely aligned with the fitted line. Furthermore, a scatter plot indicates that standardized residuals form a square box shape evenly distributed across the X-axis, fulfilling the homoscedasticity assumption where variances across residuals are constant .

The influence of R&D Spend on Profit is highly significant, as indicated by a p-value of 0.000 and a high standardized Beta coefficient of 0.918. This means a one unit change in R&D Spend results in a 0.806 increase in profit, showcasing its strong influence. Conversely, Administration and Marketing Spend have p-values greater than 0.05 and much lower Beta coefficients, reflecting negligible influence on profit when compared to R&D Spend. Thus, R&D Spend is the primary influencing factor among the three variables .

The ANOVA table reveals that the regression model is statistically significant. The F-value is 295.978, which is much larger than the critical F-value for a 95% confidence level, demonstrating significant variation between sample means. The p-value is reported as 0.000, which is less than 0.05, strongly indicating the model's significance and leading to the rejection of the null hypothesis that assumes no effect of the independent variables on Profit .

The analysis suggests that there is no need for intervention based on the identified outlier (Case 50) because its impact on the regression model is negligible. This decision is supported by the low Cook’s distance (0.288) and Mahalanobis distance (10.809) values, both indicating that the case does not significantly influence the model's results. Therefore, it does not warrant removal, ensuring the integrity of the dataset .

R Square is chosen over Adjusted R Square for evaluating the model fit because the number of predictors (independent variables) is only three. R Square already provides a sufficient indication of how much variance in the dependent variable is explained by the independent variables without needing the adjustment for the sample size and number of predictors that Adjusted R Square accounts for. This choice implies confidence in the model's capacity to represent the data effectively with the number of predictors used .

You might also like