Suppose we have a neural net, which we denote as a function F(x; 0), that performs binary logistic regression to classify between images of cats and dogs. The final layer of F is a sigmoid, so that the output is a number between 0 and 1. Cats are given the label 0, and dogs are given the label 1. We use the NLL loss as our loss function: L(F(x; 0), y) = − [y log F(x; 0) + (1 − y) log(1 — F(x; 0))] We have an image x under consideration and wish to modify our predictions about it. Is the following true? If we want our net to predict 'cat' we should try taking a gradient step new = x − ▼xF(x; 0).

Computer Networking: A Top-Down Approach (7th Edition)
7th Edition
ISBN:9780133594140
Author:James Kurose, Keith Ross
Publisher:James Kurose, Keith Ross
Chapter1: Computer Networks And The Internet
Section: Chapter Questions
Problem R1RQ: What is the difference between a host and an end system? List several different types of end...
icon
Related questions
Question
Suppose we have a neural net, which we denote as a function F(x; 0), that performs binary
logistic regression to classify between images of cats and dogs. The final layer of F is a sigmoid,
so that the output is a number between 0 and 1. Cats are given the label 0, and dogs are given
the label 1. We use the NLL loss as our loss function:
L(F(x; 0), y) = − [y log F(x; 0) + (1 − y) log(1 – F(x; 0))]
We have an image x under consideration and wish to modify our predictions about it. Is the
following true?
If we want our net to predict 'cat' we should try taking a gradient step new = x − ▼xF(x; 0).
Transcribed Image Text:Suppose we have a neural net, which we denote as a function F(x; 0), that performs binary logistic regression to classify between images of cats and dogs. The final layer of F is a sigmoid, so that the output is a number between 0 and 1. Cats are given the label 0, and dogs are given the label 1. We use the NLL loss as our loss function: L(F(x; 0), y) = − [y log F(x; 0) + (1 − y) log(1 – F(x; 0))] We have an image x under consideration and wish to modify our predictions about it. Is the following true? If we want our net to predict 'cat' we should try taking a gradient step new = x − ▼xF(x; 0).
Expert Solution
trending now

Trending now

This is a popular solution!

steps

Step by step

Solved in 3 steps

Blurred answer
Recommended textbooks for you
Computer Networking: A Top-Down Approach (7th Edi…
Computer Networking: A Top-Down Approach (7th Edi…
Computer Engineering
ISBN:
9780133594140
Author:
James Kurose, Keith Ross
Publisher:
PEARSON
Computer Organization and Design MIPS Edition, Fi…
Computer Organization and Design MIPS Edition, Fi…
Computer Engineering
ISBN:
9780124077263
Author:
David A. Patterson, John L. Hennessy
Publisher:
Elsevier Science
Network+ Guide to Networks (MindTap Course List)
Network+ Guide to Networks (MindTap Course List)
Computer Engineering
ISBN:
9781337569330
Author:
Jill West, Tamara Dean, Jean Andrews
Publisher:
Cengage Learning
Concepts of Database Management
Concepts of Database Management
Computer Engineering
ISBN:
9781337093422
Author:
Joy L. Starks, Philip J. Pratt, Mary Z. Last
Publisher:
Cengage Learning
Prelude to Programming
Prelude to Programming
Computer Engineering
ISBN:
9780133750423
Author:
VENIT, Stewart
Publisher:
Pearson Education
Sc Business Data Communications and Networking, T…
Sc Business Data Communications and Networking, T…
Computer Engineering
ISBN:
9781119368830
Author:
FITZGERALD
Publisher:
WILEY