[Reading Note] Chapter 2.3 Operations that Preserves Convexity
Published:
Chapter 2.3 Operations that Preserves Convexity
2.3.1 Intersection
- If \(S_\alpha\) is convex for every \(\alpha\in\mathcal{A}\), then \(\cap_{\alpha\in\mathcal{A}}S_{\alpha}\) is convex.
- Every closed convex set \(S\) is a (usually infinite) intersection of halfspaces.
2.3.2 Affine Functions
What is an affine function?
The form \(f(x)=Ax+B\) is affine function, where \(f:\mathbb{R}^n\rightarrow\mathbb{R}^m\), \(A\in\mathbb{R}^{m\times n}\) and \(B\in\mathbb{R}^{m}\).
Affine function preserves convexity
Suppose \(S\subseteq\mathbb{R}^n\) is convex, and \(f:\mathbb{R}^n\rightarrow\mathbb{R}^m\) is an affine function. Then the image of \(S\) under \(f\), i.e., \(\{f(x)\vert x\in S\}\) is convex.
Inverse affine function preserves convexity
Suppose \(S\subseteq\mathbb{R}^n\) is convex, and \(f:\mathbb{R}^k\rightarrow\mathbb{R}^n\) is an affine function. Then the image of \(S\) under \(f\), i.e., \(\{x\vert f(x)\in S\}\) is convex.
Some affine functions. Bellow are some affine functions, the sets \(S_i\)’s are assumed to be convex.
- scaling: \(\{\alpha S\vert x\in S\}\), \(\alpha\in\mathbb{R}\), \(S\subseteq\mathbb{R^n}\).
- translating: \(\{a+S\vert x\in S\}\), \(a\in\mathbb{R}^n\), \(S\subseteq\mathbb{R^n}\).
- projection: \(\{x_1\in\mathbb{R}^m\vert (x_1, x_2)\in S, {\text{for some}} x_2\in\mathbb{R}^{n}\}\), \(S\in\mathbb{R}^{m\times n}\).
- sum: \(\{x+y\vert x\in S_1, y\in S_2\}\).
- partial sum: \(\{(x,y_1+y_2)\vert (x, y_1)\in S_1, (x, y_2)\in S_2\}\), where \(x\in\mathbb{R}^n, yi\in\mathbb{R}^m, S_{i}\in\mathbb{R}^{m\times n}\). If \(m=0\), partial sums becomes intersection; if \(n=0\), partial sum becomes sum.
2.3.3 Linear-fraction and perspective functions
- perspective function.
- The perspective function \(P\): \(\mathbb{R}^{n+1}\rightarrow\mathbb{R}^n\), with domain \({\bf{dom}}P=\mathbb{R}^{n}\times\mathbb{R}_{++}\), is defined as: \(P(z,t)=z/t\).
- If \(C\subseteq {\bf{dom}}P\), then its image \(P(C)=\{P(x)\vert x\in C\}\) is convex.
- The inverse image of a convex set under the perspective function is also convex: If \(C\subseteq \mathbb{R}^n\) is convex, then \(P^{-1}(C)=\{(x,t)\in\mathbb{R}^{n+1}\vert x/t\in C, t>0\}\).
- linear-fractional function.
Suppose \(g:\mathbb{R}^{n}\rightarrow\mathbb{R}^{m+1}\) is affine, i.e.,:
\[\begin{aligned} g(x)= [A^T~c]^Tx+[b^T~d]^T, \end{aligned}\]where \(A\in\mathbb{R}^{m\times n }, c\in\mathbb{R}^{n}, b\in\mathbb{R}^{m}\), and \(d\in\mathbb{R}\). The function \(f: \mathbb{R}^n\rightarrow\mathbb{R}^m\) given by \(f=P\circ g\): \(f(x)=Ax+b/c^Tx+d\), with \({\bf{dom}}f=\{x\vert c^Tx+d>0\}\) is called a linear-fractional (or projective) function.
- Linear-fractional functions preserve the convextiy.
- If \(C\subseteq R^{m}\) is convex, then the inverse image \(f^{-1}(C)\) is convex.