DS4023编程语言辅导、讲解Java，Python程序

日期：2021-04-27 08:13

DS4023 Machine Learning
SVM Exercise1
Q1. What linear function is used by a SVM for classification? How is an
input vector ????
(instance) assigned to the positive or negative class?
Q2. If the training examples are linearly separable, how many decision
boundaries can separate positive from negative data points? Which
decision boundary does the SVM algorithm calculate? Why?
Q3. Use Lagrange multiplier method to answer the following questions.
3.1 Consider the Entropy definition:
– If we are given a probability distribution ?? = (??1, ??2, … , ????) ,
then the information conveyed by this distribution, also called the
Entropy of ??, is ??(??) = ?(??1 × log ??1 + ??2 log ??2 + ? +
???? log ????) (The base of the logarithm is 2)
What is the range of entropy of ?? and which distribution gives
maximum entropy? Show the details of your answer.
3.2 Given the probability distribution ?? = (??1, ??2, … , ????), Gini index
is another way to measure the uncertainty ????????(??) = 1 ? ∑ ????
?? 2
??
.
What is the range of Gini index and which distribution gives maximum
Gini index value? Show the details of your answer.
Q4. Given the SVM optimization problem:
min
w,b
1
2
‖w‖
2
??.??. ????
(w??x?? + ??) ≥ 1, ?? = 1,2, … , ??
Derive the dual optimization problem and show the detail steps.
Q5.
for the dual problem, if exist
????
?
that ????
? > 0, then the solution for primal problem is:
Show the detail steps for deriving the solution given ??
?
.