Hello, dear friend, you can consult us at any time if you have any questions, add WeChat: THEend8_
EECE5644
Please submit your solutions on Blackboard in a single PDF file that includes all math and
numerical results. Only the contents of this PDF will be graded.
For control purposes, please also provide any code you write to solve the questions in one of
the following ways:
1. Include all of your code in the PDF as an appendix.
2. In the PDF provide a link to your online code repo where the code resides.
This is a graded assignment and the entirety of your submission must contain only your own
work. Do not make your code repo public until after the submission deadline. If people find your
code and use it to solve questions, we will consider it cheating for all parties involved. You may
benefit from publicly available literature including software (that is not from classmates), as long
as these sources are properly acknowledged in your submission.
Copying math or code from each other is clearly not allowed and will be considered as academic
dishonesty. Discussing with the instructor and the teaching assistant to get clarification, or
to eliminate doubts is acceptable.
By submitting a PDF file in response to this take home assignment you are declaring that the
contents of your submission, and the associated code is your own work, except as noted in your
acknowledgement citations to resources.
Start early and use the office periods well. The office periods are on gcal and contain video
links for remote participation. You may call 1-617-3733021 to reach Deniz if you have difficulty
using the video links for the office periods.
It is your responsibility to provide the necessary and sufficient evidence in the form of explanations,
math, visualizations, and numerical values to earn scores. Do not provide a minimal set
of what you interpret is being precisely requested; you may be providing too little evidence of
your understanding. On the other hand, also please do not dump in unnecessarily large amounts
of things; you may be creating the perception that you do not know what you are doing. Be intentional
in what you present and how you present it. You are trying to convince the reader (grader)
that your mathematical design, code implementations, and generated results are legitimate and
correct/accurate.
1
Question 1 (50%)
In this exercise, you will train many multilayer perceptrons (MLP) to approximate the class
label posterior, using maximum likelihood parameter estimation (equivalently, with minimum average
cross-entropy loss).
Pick your own C value (number of classes) from this set: {3,4,5}. Pick two activation functions
for the perceptrons; one sigmoid, one soft-ReLu type differentiable function. Your MLP
structure will consist of 2 fully-connected layers of adaptive weights, followed by a softmax layer
to ensure your model output conforms to the requirements of a probability distribution over discrete
class labels. The dataset you will classify consists of 2-dimensional real vectors. The number
of perceptrons in the first layer of the MLP will be determined using cross-validation procedures
(e.g., from the set {1,...,6}).
Using the Matlab function generateMultiringDataset.m generate two sets of data. Dtrain will
have 100 iid samples and their class labels. Dtest will have 10000 iid samples and their class labels.
Do NOT use Dtest in making any training or model selection choices in the process. You will use
it only for final performance evaluation.
Using 10-fold cross-validation with Dtrain, and minimum classification error probability as the
objective, select the best combination of number of perceptrons in the first layer and the activation
function.