This exercise asks you to derive a gradient descent rule analogous to that used by TANGENTPROP. Consider the instance space X consisting of the real numbers, and consider the hypothesis space H consisting of quadratic functions of x. That is, (a) Derive a gradient descent rule that minimizes the same criterion as BACKPROPAGATION; that is, the sum of squared errors between the hypothesis and target values of the training data. (b) Derive a second gradient descent rule that minimizes the same criterion as TANGENTPROP. Consider only the single transformation s(a, x) = x +a.

Question
Asked Mar 5, 2020
1 views

This exercise asks you to derive a gradient descent rule analogous to that used by TANGENTPROP. Consider the instance space X consisting of the real numbers, and consider the hypothesis space H consisting of quadratic functions of x. That is,

(a) Derive a gradient descent rule that minimizes the same criterion as BACKPROPAGATION; that is, the sum of squared errors between the hypothesis and target values of the training data.

(b) Derive a second gradient descent rule that minimizes the same criterion as TANGENTPROP. Consider only the single transformation s(a, x) = x +a.


Expert Answer

This question hasn't been answered yet.

Ask an expert

Check out a sample Q&A here.

The solution to your study problems

Solutions are written by subject matter experts who are available 24/7. Questions are typically answered within 1 hour.*

Get Started
*Response times may vary by subject and question.

Related Electrical Engineering Q&A

Find answers to questions asked by student like you
Show more Q&A
add
question_answer

Q: The following number is represented using excess-3 number system: (100101100111)XS3 What will be the...

A: XS3 is a special non-weighted binary number system. To convert a number from excess-3 (XS3) system i...

question_answer

Q: A parabolic antenna having a circular aperture mouth has a power gain of 1000 for wavelength of 10 c...

A: Power gain (Gp) of a parabolic antenna having a circular aperture with aperture diameter D can be ex...

question_answer

Q: I want questions from 2 to 10 to be answered. Question 2 - 10. Thats (2 through 10)

A: As we are authorised to do 3 subparts at a time so i am answering first 3 subparts. Please mentioned...

question_answer

Q: 5. Plot of B vs.n. Magnetic Field vs. Number of Turns per Length 20 40 60 80 120 -0.005 y = 0.0003x-...

A: The given graph is plotted between the magnetic field and the turns per length. the dotted lines rep...

question_answer

Q: Problem 1 A 2.1-MW Sulon S97 wind turbine has a cut-in wind speed uc = 3.5 m/s, rated wind speed u, ...

A: The given speed data is:-

question_answer

Q: 2. A parallel plate capacitor with a plate area of 0.13 square meters separated by 1 mm is charged t...

A: Referring to the given points from the question:  

question_answer

Q: C. d. Construct root locus diagram of the control system with the following open-loop transfer funct...

A: Given open loop transfer function is –

question_answer

Q: A pyramidal horn antenna has aperture dimentions of 8 cm x 4 cm. If the wavelength is 3.75 m, then w...

A: The directivity (in degrees) of a pyramidal horn antenna can be computed using the following relatio...

question_answer

Q: In RL Parallel Circuit where R=6.8kohms, L=200mH, & f=6kHz a. Find Y & Z in rectangular &amp...

A: (a) In a parallel configuration, admittances are added. Hence Substitute the necessary values. Con...