Skip to content

Clean up "equivalence" of penalty and constraint form regularization #78

Open

Description

@davidrosenberg

There's something going on that needs clarification.
Suppose w^* is an unconstrained minimizer of phi(w), and suppose Omega(w^*)=R.
Say phi(w) is a quadratic objective for a linear system that has a null space. Then there's another minimizer w^** that has Omega(w^)=r>R.
So w^
is a solution to a constrained optimization problem, but not of the penalized form. What assumption is not met in the equivalence theorem from the homework?

Even if w^** is not attained as a solution to a penalty form problem, say something about the corresponding linear function being attained?

Activity

  1. brett1479 commented on May 23, 2019

    @brett1479
    Collaborator

    w^** is a solution of the penalized form with lambda=0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions