Multi-Linear Regression Analysis on Startup Profit
Multi-Linear Regression Analysis on Startup Profit
R&D Spend is identified as the most significant factor influencing the startup profit. This conclusion is supported by various diagnostic checks: the coefficient analysis reveals a strong standardized Beta coefficient of 0.918 for R&D Spend, and an insignificant p-value (0.000), indicating high significance. The model’s fit and assumptions like normality, homoscedasticity, and non-collinearity are also verified, ensuring the reliability of the conclusion drawn .
Cook's distance and Mahalanobis Distance are diagnostic measures to identify influential outliers that might unduly affect the model. The maximum Cook's distance recorded is 0.288 and the maximum Mahalanobis distance is 10.809, both values being below their respective threshold levels (1 for Cook's, 13.82 for Mahalanobis). This indicates that while there is an outlier (Case 50), its influence on the overall regression model is negligible and does not necessitate its removal from the data .
Multicollinearity checks assess the extent of correlation between independent variables, which can affect the stability and interpretation of the regression coefficients. In this model, the VIF values are all below 10, and Tolerance values are greater than 0.1, indicating well above the threshold of significant multicollinearity issues. This suggests that the independent variables are not highly correlated, thus confirming the non-collinearity assumption required for a reliable regression model .
The primary aim of using multiple linear regression in analyzing the startup dataset is to predict business outcomes, particularly the profit of startups, by examining the influence of various independent variables, such as R&D Spend, Administration, and Marketing Spend, on profit. This analysis helps in identifying which factors are most significant in driving profit, allowing for better business decision-making. Multiple linear regression facilitates understanding by quantifying the relationship between these variables and showing how changes in the independent variables are expected to influence the dependent variable, Profit .
The model summary indicates the effectiveness of the regression model by showing an R value of 0.975 and an R Square value of 0.951. This means that 95.1% of the variability in the profit data can be explained by the independent variables in the model, indicating a very high level of effectiveness of the model in predicting the dependent variable, Profit. The R Square value signifies how well the independent variables explain the variation in the dependent variable, with higher values indicating a better fit .
The residual analysis confirms the assumptions of normality and homoscedasticity. The histogram of residuals shows an almost normal distribution, with only slight negative skewness, suggesting normality. The normal P-P plot confirms this by showing data points closely aligned with the fitted line. Furthermore, a scatter plot indicates that standardized residuals form a square box shape evenly distributed across the X-axis, fulfilling the homoscedasticity assumption where variances across residuals are constant .
The influence of R&D Spend on Profit is highly significant, as indicated by a p-value of 0.000 and a high standardized Beta coefficient of 0.918. This means a one unit change in R&D Spend results in a 0.806 increase in profit, showcasing its strong influence. Conversely, Administration and Marketing Spend have p-values greater than 0.05 and much lower Beta coefficients, reflecting negligible influence on profit when compared to R&D Spend. Thus, R&D Spend is the primary influencing factor among the three variables .
The ANOVA table reveals that the regression model is statistically significant. The F-value is 295.978, which is much larger than the critical F-value for a 95% confidence level, demonstrating significant variation between sample means. The p-value is reported as 0.000, which is less than 0.05, strongly indicating the model's significance and leading to the rejection of the null hypothesis that assumes no effect of the independent variables on Profit .
The analysis suggests that there is no need for intervention based on the identified outlier (Case 50) because its impact on the regression model is negligible. This decision is supported by the low Cook’s distance (0.288) and Mahalanobis distance (10.809) values, both indicating that the case does not significantly influence the model's results. Therefore, it does not warrant removal, ensuring the integrity of the dataset .
R Square is chosen over Adjusted R Square for evaluating the model fit because the number of predictors (independent variables) is only three. R Square already provides a sufficient indication of how much variance in the dependent variable is explained by the independent variables without needing the adjustment for the sample size and number of predictors that Adjusted R Square accounts for. This choice implies confidence in the model's capacity to represent the data effectively with the number of predictors used .