Citadel · ML & AI Fundamentals
When Does `min x'Qx + c'x` Have a Finite Minimum?
TrueInterview
July 18, 2026 · 2 min read
Requirements
Consider the real-valued optimization problem:
minimize x^T Q x + c^T x
x ∈ R^n
where Q is real and symmetric and c is real. Describe the conditions on Q and c that ensure the objective has a finite minimum value.
Notes
- Case 1 — If
Qis positive definite, the objective is strictly convex, so it has one unique minimizer with value-(1/4) c^T Q^{-1} c, attained atx* = -(1/2) Q^{-1} c. The value is finite for everyc. - Case 2 — If
Qis positive semi-definite but not positive definite, the objective is convex without being strictly convex. A finite minimum exists exactly whencbelongs to the column space ofQ(equivalently,c ⊥ null(Q)). Any component ofcinnull(Q)permits movement in that direction that sends the objective to . When the condition is satisfied, the minimum is attained across an affine subspace. - Case 3 — If
Qpossesses a negative eigenvalue, the objective is unbounded below. Moving along the associated eigenvector can makex^T Q xarbitrarily negative, overwhelming the finite linear termc^T x. Thus no finite minimum exists for anyc. - Sanity check: with
Q = 0, the objective becomesc^T x, which is finite (and equals 0) exactly whenc = 0; otherwise, moving in the-cdirection makes it unbounded below. - In compact form, the minimum is finite if and only if
Qis PSD andc ∈ range(Q). Both parts of this characterization are expected.
Preparation
- Know the closed-form minimizer and the existence criterion for the PD, PSD, and indefinite cases — these are standard convex-optimization facts that recur in quantitative interviews.
- Be prepared to outline the proof within 90 seconds using the eigendecomposition : after rotating to
y = V^T x, the objective separates as , withd = V^T c. Each coordinate has a finite minimum when , whenλ_i = 0 and d_i = 0, or when (unbounded). Explain this decomposition smoothly. - Rehearse the geometric view: PSD
Qproduces a paraboloid that may be degenerate, whereas a negative eigenvalue creates a saddle with a downward direction that thecterm cannot prevent. - If asked about the constrained variant with a linear constraint (
Ax = b), mention that the KKT conditions produce a linear system; the constrained problem may still have a finite minimum even ifQis not globally PSD, as long asQis PSD onnull(A).
Loading comments…