Please give a step-by-step solution.Answer question 3. Regression: Let's say, we want to perform linear regression on a dataset containing m examplesand n features. Our output is a linear funcion as follows:Y₁ = W₁x₁,1 + w2xi,2+.......... + Wnxin + bNow, if the error is E, then the gradient descent weight update rules should be as follows:w₁ = w₁-X for i = {1,2,...,n}b = b - Xow₂SEFor the following loss functions E, find andδων1. Mean Squared Error:2. Sum of Squared Error:E = 1 (Yi-Yi)²E = ₁ (Yi - yi)²i=13. Mean Squared Logged Error: Sometimes, y₁ and yi can be too large. So, we use the followingloss function.mE = 1/21 (log yi – log yi)²Li=1

Given the linear functionand its mean squared logged error is

Answered: Regression: Let's say, we want to…

Elementary Linear Algebra (MindTap Course List)

8th Edition

ISBN:9781305658004

Author:Ron Larson

Publisher:Ron Larson

Chapter2: Matrices

Section2.CR: Review Exercises

Problem 90CR

See similar textbooks

Similar questions

Olympic Pole Vault The graph in Figure 7 indicates that in recent years the winning Olympic men’s pole vault height has fallen below the value predicted by the regression line in Example 2. This might have occurred because when the pole vault was a new event there was much room for improvement in vaulters’ performances, whereas now even the best training can produce only incremental advances. Let’s see whether concentrating on more recent results gives a better predictor of future records. (a) Use the data in Table 2 (page 176) to complete the table of winning pole vault heights shown in the margin. (Note that we are using x=0 to correspond to the year 1972, where this restricted data set begins.) (b) Find the regression line for the data in part ‚(a). (c) Plot the data and the regression line on the same axes. Does the regression line seem to provide a good model for the data? (d) What does the regression line predict as the winning pole vault height for the 2012 Olympics? Compare this predicted value to the actual 2012 winning height of 5.97 m, as described on page 177. Has this new regression line provided a better prediction than the line in Example 2?
Adjusted Gross Income An individuals adjusted gross income is the amount of income that is subject to federal income tax. The following table shows the total adjusted gross income AGI, in trillions of dollars, reported to the IRS in the given year. Year 2009 2010 2011 2012 AGI trillions 7.6 8.1 8.6 9.1 a. Show that the data are linear. b. Let t denote the time in years since 2009, and let A denote the total adjusted gross income. Find a linear model for A as a function of t. c. Identify the slope of the linear model you found in part b, and explain its meaning in practical terms.
The following fictitious table shows kryptonite price, in dollar per gram, t years after 2006. t= Years since 2006 0 1 2 3 4 5 6 7 8 9 10 K= Price 56 51 50 55 58 52 45 43 44 48 51 Make a quartic model of these data. Round the regression parameters to two decimal places.
A1 We want to estimate the following simple linear regression model with heteroskedas- ticity by Generalized Least Squares (GLS): yi =β0 +β1xi +ui i=1,...,n where V ar(ui|xi) = (3 + 5x2i )σ2 and σ2 is a population parameter. Explain how the GLS estimators are obtained for this specific model. Describe the underlying intuition of the GLS estimation procedure. Provide mathematical formulas
Consider multiple regression predicting Y from X1, X2, and X3. If we use hierarchical regression and enter the variables in the order X1, X3 and X2 and then compare it to the order X1, X2 and X3, what do we discover? A. It is impossible to sat without more information B. The R2 is the same for both orders but the coefficients will be different C. the R2 will be different but the coefficients will be the same D. Both the R2 and the coefficients will be the same
The Simple Linear Regression model is Y = b0 + b1*X1 + u and the Multiple Linear Regression model with k variables is: Y = b0 + b1*X1 + b2*X2 + ... + bk*Xk + u Y is the dependent variable, the X1, X2, ..., Xk are the explanatory variables, b0 is the intercept, b1, b2, ..., bk are the slope coefficients, and u is the error term, Yhat represents the OLS fitted values, uhat represent the OLS residuals, b0_hat represents the OLS estimated intercept, and b1_hat, b2_hat,..., bk_hat, represent the OLS estimated slope coefficients. QUESTION 7 In the MLR model, the assumption of ‘linearity in parameters’ is violated if: one of the slope coefficients appears as a power (e.g. Y = b0 + b1*(X1^b2) + b3*X2 + u) the model includes the reciprocal of a variable (e.g. 1/X1) the model includes a variable squared (e.g. X1^2) the model includes a variable in its logarithmic form (i.e. log(X1) ) QUESTION 8 In the MLR model, the assumption of 'no perfect collinearity'…
The Simple Linear Regression model is Y = b0 + b1*X1 + u and the Multiple Linear Regression model with k variables is: Y = b0 + b1*X1 + b2*X2 + ... + bk*Xk + u Y is the dependent variable, the X1, X2, ..., Xk are the explanatory variables, b0 is the intercept, b1, b2, ..., bk are the slope coefficients, and u is the error term, Yhat represents the OLS fitted values, uhat represent the OLS residuals, b0_hat represents the OLS estimated intercept, and b1_hat, b2_hat,..., bk_hat, represent the OLS estimated slope coefficients. QUESTION 1 In the SLR model, suppose the dependent variable (Y) represents the quantity consumed of apples in a particular area in tones, and the explanatory variable (X1) is the average price of apples in that area in £. If this model is estimated by OLS, then the estimated slope b1_hat, represents: by how many tones consumption of apples will change, if the average price of apples increases by £1 the predicted change in the consumption of apples (in…
The Simple Linear Regression model is Y = b0 + b1*X1 + u and the Multiple Linear Regression model with k variables is: Y = b0 + b1*X1 + b2*X2 + ... + bk*Xk + u Y is the dependent variable, the X1, X2, ..., Xk are the explanatory variables, b0 is the intercept, b1, b2, ..., bk are the slope coefficients, and u is the error term, Yhat represents the OLS fitted values, uhat represent the OLS residuals, b0_hat represents the OLS estimated intercept, and b1_hat, b2_hat,..., bk_hat, represent the OLS estimated slope coefficients. QUESTION 16 In a t-test, suppose a researcher sets the significance level at 0.5%. What does this mean? The probability that the null hypothesis is true is 0.5% The researcher would be rejecting the null hypothesis, only if the p-value is less than 0.5% The researcher would be rejecting the null hypothesis, if the t-statistic is higher than 0.5 It does not mean anything, because the significance level can only be set at 5% QUESTION 17 In an MLR…
The Simple Linear Regression model is Y = b0 + b1*X1 + u and the Multiple Linear Regression model with k variables is: Y = b0 + b1*X1 + b2*X2 + ... + bk*Xk + u Y is the dependent variable, the X1, X2, ..., Xk are the explanatory variables, b0 is the intercept, b1, b2, ..., bk are the slope coefficients, and u is the error term, Yhat represents the OLS fitted values, uhat represent the OLS residuals, b0_hat represents the OLS estimated intercept, and b1_hat, b2_hat,..., bk_hat, represent the OLS estimated slope coefficients. QUESTION 28 Suppose your estimated MLR model is: Y_hat = -30 + 2*X1 + 10*X2 Suppose the standard error for the estimated coefficient associated with X2 is equal to 5. Now, suppose that for some reason we multiply X2 by 5 and we re-estimate the model using the rescaled explanatory variable. What will be the value of the estimated coefficient of X2 and its standard error? The estimated coefficient of X2 will be equal to 50 and its standard error will be…
The Simple Linear Regression model is Y = b0 + b1*X1 + u and the Multiple Linear Regression model with k variables is: Y = b0 + b1*X1 + b2*X2 + ... + bk*Xk + u Y is the dependent variable, the X1, X2, ..., Xk are the explanatory variables, b0 is the intercept, b1, b2, ..., bk are the slope coefficients, and u is the error term, Yhat represents the OLS fitted values, uhat represent the OLS residuals, b0_hat represents the OLS estimated intercept, and b1_hat, b2_hat,..., bk_hat, represent the OLS estimated slope coefficients. QUESTION 13 In the MLR model, what do we mean by Heteroskedasticity? That the error term depends on the values of the explanatory variables That all the explanatory variables have different variance That the variance of the error term is a function of the explanatory variables That the variance of the error term is constant QUESTION 14 Suppose that in the model Y=b0+b1*X1+u, we add a variable that is correlated with both Y and X1. What will happen…
The Simple Linear Regression model is Y = b0 + b1*X1 + u and the Multiple Linear Regression model with k variables is: Y = b0 + b1*X1 + b2*X2 + ... + bk*Xk + u Y is the dependent variable, the X1, X2, ..., Xk are the explanatory variables, b0 is the intercept, b1, b2, ..., bk are the slope coefficients, and u is the error term, Yhat represents the OLS fitted values, uhat represent the OLS residuals, b0_hat represents the OLS estimated intercept, and b1_hat, b2_hat,..., bk_hat, represent the OLS estimated slope coefficients. QUESTION 25 In the MLR model, with 150 observations and 5 explanatory variables, suppose you want to test the null hypothesis, H0: b3=0, b4=0 We also know that the RSS of the unrestricted model is 563, while the RSS of a model that excludes the variables associated with the 2 coefficients under the null hypothesis is 577. Given this information what is the F-statistic for this hypothesis? It is around -1.79 It is around 1.75 It is around -1.75 It is…
The Simple Linear Regression model is Y = b0 + b1*X1 + u and the Multiple Linear Regression model with k variables is: Y = b0 + b1*X1 + b2*X2 + ... + bk*Xk + u Y is the dependent variable, the X1, X2, ..., Xk are the explanatory variables, b0 is the intercept, b1, b2, ..., bk are the slope coefficients, and u is the error term, Yhat represents the OLS fitted values, uhat represent the OLS residuals, b0_hat represents the OLS estimated intercept, and b1_hat, b2_hat,..., bk_hat, represent the OLS estimated slope coefficients. QUESTION 22 Suppose your estimated MLR model with two explanatory variables, X1 and log(X2), is: log(Y)_hat= 10 +0.5*X1 + 0.25*log(X2) Which of the following statements about the interpretation of the coefficient of log(X2) is correct? If X2 increases by 1%, Y is predicted to increase by approximately 25 units, holding X1 constant If X2 increases by 1%, Y is predicted to increase by approximately 0.25%, holding X1 constant If X2 increases by 1 unit, Y is…

SEE MORE QUESTIONS

Recommended textbooks for you

Elementary Linear Algebra (MindTap Course List)

Algebra

ISBN:

9781305658004

Author:

Ron Larson

Publisher:

Cengage Learning

College Algebra

Algebra

ISBN:

9781305115545

Author:

James Stewart, Lothar Redlin, Saleem Watson

Publisher:

Cengage Learning

Functions and Change: A Modeling Approach to Coll…

Algebra

ISBN:

9781337111348

Author:

Bruce Crauder, Benny Evans, Alan Noell

Publisher:

Cengage Learning

Elementary Linear Algebra (MindTap Course List)

Algebra

ISBN:

9781305658004

Author:

Ron Larson

Publisher:

Cengage Learning

College Algebra

Algebra

ISBN:

9781305115545

Author:

James Stewart, Lothar Redlin, Saleem Watson

Publisher:

Cengage Learning

Functions and Change: A Modeling Approach to Coll…

Algebra

ISBN:

9781337111348

Author:

Bruce Crauder, Benny Evans, Alan Noell

Publisher:

Cengage Learning

Linear Algebra: A Modern Introduction

Algebra

ISBN:

9781285463247

Author:

David Poole

Publisher:

Cengage Learning

Algebra & Trigonometry with Analytic Geometry

Algebra

ISBN:

9781133382119

Author:

Swokowski

Publisher:

Cengage

SEE MORE TEXTBOOKS