algorithmsbooks / optimization

Errata for Algorithms for Optimization book
68 stars 16 forks source link

example 10.5 on P179 #5

Closed yingjieMiao closed 5 years ago

yingjieMiao commented 5 years ago

This problem minimizes sin(x) over an interval. So the minimizer is either an endpoint or a stationary point. In fact, x = -pi/2, p = -1.

In the example's plot, u starts from 0.1. If we include u = 0, we would recover x*.

A slightly more interesting example may be consider the constraint x^2 <= 1. Now the x* is found at a nontrivial u. (u = cos(1) / 2, if I got this correct.)

tawheeler commented 5 years ago

Is this what you meant?

image

The minimum in the original problem should be sqrt(3). I believe using 1.5 is a mistake.

tawheeler commented 5 years ago

Thanks @yingjieMiao, we will go with this.

yingjieMiao commented 5 years ago

Sorry for the late response - somehow I didn't get an email notification.

The original problem is minimized at a stationary point -pi/2. This corresponds to set u = 0 in the dual problem. (This u is "trivial" -- the Lagrangian happens to be sin(x) itself).

If we consider the constraint x^2 <= 1, sin(x) is monotonic on [-1, 1], it minimizes at -1. We could ask: in the dual problem, which u gives this minimizer?

For a fixed u, set dL/dx = 0, we have cos(x) + 2ux = 0. If x=-1 is a stationary point, we solve u = cos(-1) / 2 = 0.270. (We can also verify the 2nd derivative > 0, so x = -1 is indeed a minimizer). This u is nontrivial.

Does this make sense?

tawheeler commented 5 years ago

Yes, this makes sense. The optimal u is no longer trivially at zero.