COS711 Assignment 1 Due date: 4 September 2022, at 23h30

FIND A SOLUTION AT Academic Writers Bay

COS711 Assignment 1
Due date: 4 September 2022, at 23h30
1 General instructions
This assignment is theoretical, and will test your understanding of the backpropagation algorithm. You have to submit a single pdf document containing your answers to the questions provided. Note: the assignment is designed to test your ability to derive the weight update equations for arbitrary loss and activation functions. Thus, you will loose marks by skipping over steps. Make sure your derivations are readable, notation is correct, and the steps (including simplifications) are clear.
The report will be checked for plagiarism using Turnitin, and should be submitted through the ClickUp system. You are advised but not required to typeset your report in LaTeX.
2 Deriving backpropagation (25 marks)
A feed-forward neural network is set up to have an input layer of size I, a hidden layer of size H, and an output layer of size O. The following activation functions are employed in the neurons on each layer:
• Input layer: identity, f(x) = x
• Hidden layer: Softplus, f(x) = ln(1 + ex)
• Output layer: Modified Elliott,
Hidden and output units are summation units, i.e. x in the activation functions above refers to the net input signal, thus the output signal of a neuron j is yj = f(netj) = f(Pwkjyk). Bias signal is sent to all hidden, as well as all output units. Assume the objective function E is used, defined for a single input data pattern as:

where yi is the output of the i-th output unit, ti is the target output of the i-th output unit, ln refers to natural logarithm, s1 and s2 are scalar values such that s1 + s2 = 1, maxE1 and maxE2 are the maximum values produced by E1 and E2 over the data set before training, respectively.
Answer the questions below:
1. Derive the update rule for the non-bias weights between the hidden and the output layer. Showall steps, including simplifications. (10 marks)
1
2. Derive the update rule for the non-bias weights between the input and the hidden layer. Showall steps, including simplifications. (10 marks)
3. Will the bias weight update rules differ from the non-bias weight update rules? Derive theupdate rule for the bias weights associated with the hidden layer. Show your working. (5 marks)
2

• WE OFFER THE BEST CUSTOM PAPER WRITING SERVICES. WE HAVE DONE THIS QUESTION BEFORE, WE CAN ALSO DO IT FOR YOU.
• Assignment status: Already Solved By Our Experts
• (USA, AUS, UK & CA PhD. Writers)
• CLICK HERE TO GET A PROFESSIONAL WRITER TO WORK ON THIS PAPER AND OTHER SIMILAR PAPERS, GET A NON PLAGIARIZED PAPER FROM OUR EXPERTS

QUALITY: 100% ORIGINAL PAPER – NO PLAGIARISM – CUSTOM PAPER

Why Choose Us?

How It Works

• Click on the “Place Your Order” tab at the top menu or “Order Now” icon at the bottom and a new page will appear with an order form to be filled.
• Fill in your paper’s requirements in the “PAPER DETAILS” section.
• Fill in your paper’s academic level, deadline, and the required number of pages from the drop-down menus.
• Click “CREATE ACCOUNT & SIGN IN” to enter your registration details and get an account with us for record-keeping and then, click on “PROCEED TO CHECKOUT” at the bottom of the page.
• From there, the payment sections will show, follow the guided payment process and your order will be available for our writing team to work on it.

About AcademicWritersBay.com

AcademicWritersBay.com is an easy-to-use and reliable service that is ready to assist you with your papers 24/7/ 365days a year. 99% of our customers are happy with their papers. Our team is efficient and will always tackle your essay needs comprehensively assuring you of excellent results. Feel free to ask them anything concerning your essay demands or Order.

AcademicWritersBay.com is a private company that offers academic support and assistance to students at all levels. Our mission is to provide proficient and high quality academic services to our highly esteemed clients. AcademicWritersBay.com is equipped with competent and proficient writers to tackle all types of your academic needs, and provide you with excellent results. Most of our writers are holders of master’s degrees or PhDs, which is an surety of excellent results to our clients. We provide assistance to students all over the world.
We provide high quality term papers, research papers, essays, proposals, theses and many others. At AcademicWritersBay.com, you can be sure of excellent grades in your assignments and final exams.