Technical Documentation: H∞\mathcal{H}_\infty LPV-LFT Control

Interactive course notes and documentation

run the simulation

How to read this page

This page explains, step by step, how to build a tracking controller for a mass-spring-damper system whose stiffness varies with a parameter. It goes from the physical model to the H∞\mathcal{H}_\infty synthesis problem, with two interactive modules to build intuition about signal energy and system gain, then uses the method of [1] to derive sufficient matrix inequalities for this scalar parameter.

The page separates several levels of statement, which should not be confused:

Problem formulation
Sections 1 to 3 define the model, the LFT, the generalized plant and the weights.
Sufficient condition
Section 5 derives LMI conditions that suffice to certify the gain for the scalar parameter model, following the method of [1].
Numerical feasibility
The controller has a computed scaled gain of 0.84490.8449. A second solver produced a storage matrix for γ=0.85\gamma = 0.85, verified against the discrete-time dissipation inequality.
Stated guarantee
The certificate bounds the induced gain and establishes stability of the unsaturated discrete model for every parameter sequence satisfying ∣ρ∣≤1/γ≈1.17647|\rho| \le 1/\gamma \approx 1.17647.
Simulation
The simulation is an illustration in discrete time. A run does not prove stability or performance.

1Physical model & LFT

The system under study is a classical Mass-Spring-Damper (MSD) mechanical system. It consists of a mass mm sliding on a frictionless horizontal surface, attached to a fixed wall via a spring with stiffness k(ρ(t))k(\rho(t)) and a damper with coefficient cc. The system is subject to a control input u(t)u(t) and the goal of this wiki is to explain how to construct a tracking controller for this system using H∞\mathcal{H}_\infty LPV-LFT control.

Figure 1: Schematic of the LPV Mass-Spring-Damper system. The force u(t)u(t) is applied to the mass and its position y(t)y(t) is measured from rest, both counted positive to the right.
Click the figure to zoom.

The equation of motion is derived from Newton's Second Law:

my¨(t)+cy˙(t)+k(ρ(t))y(t)=u(t)m \ddot{y}(t) + c \dot{y}(t) + k(\rho(t)) y(t) = u(t)

The stiffness k(ρ(t))k(\rho(t)) is parameter-dependent: k(ρ(t))=k0(1+αρ(t))k(\rho(t)) = k_0(1 + \alpha\rho(t)). Physical parameters are presented in Table 1.

Table 1: Physical parameters of the LPV Mass-Spring-Damper system.
ParameterValueUnit
mm (mass)1kg
cc (damping)2N·s/m
k0k_0 (nominal stiffness)10N/m
α\alpha (stiffness gain)0.4—

The system written just above is a Linear Parameter Varying (LPV) system: its dynamics depend on the time-varying parameter ρ(t)\rho(t), which sets the stiffness k(ρ(t))k(\rho(t)). To apply robust control tools, we must isolate the parameter variation from the nominal dynamics. This is done using a Linear Fractional Transformation (LFT), which creates a fictitious feedback loop with the parameter ρ\rho. Here is the derivation of the LFT:

2Generalized LPV-LFT Model for synthesis

Now that we have the LPV-LFT system, we can proceed to the controller synthesis. Figure 2 illustrates a classical mixed-sensitivity synthesis scheme, a standard architecture in robust control design. It consists of three main components:

  • Plant PP: Represents the Mass-Spring-Damper (MSD) system. It encapsulates both the nominal dynamics and the LFT decomposition of the varying stiffness.
  • Controller KK: The controller we aim to synthesize. It also reads the parameter ρ(t)\rho(t), through an LFT loop of its own (Figure 2). Its internal architecture—derived to handle ρ(t)\rho(t)—will be detailed in Section 5.
  • Weighting Filters (We,WuW_e, W_u): Strictly design tools grafted onto the physical signals (the error ee and the control signal uu). They translate performance specifications into mathematical constraints.
Figure 2: The Synthesis Scheme. The same parameter ρ(t)\rho(t) is looped on the plant and on the controller.
Click the figure to zoom.

By combining the LPV system model (Section 1) and the weighting filters presented in Figure 2, we construct the Generalized LPV Model. This is a single augmented state-space system that the optimizer 'sees'.

First, we need to define the two state models induced by the filters WeW_e and WuW_u:

x˙e(t)=Aexe(t)+Bee(t)e′(t)=Cexe(t)+Dee(t)\begin{aligned} \dot{\mathbf{x}}_e(t)&=\mathbf{A}_e \mathbf{x}_e(t)+\mathbf{B}_e e(t) \\ e'(t)&=\mathbf{C}_e \mathbf{x}_e(t)+\mathbf{D}_e e(t) \end{aligned}
x˙u(t)=Auxu(t)+Buu(t)u′(t)=Cuxu(t)+Duu(t)\begin{aligned} \dot{\mathbf{x}}_u(t)&=\mathbf{A}_u \mathbf{x}_u(t)+\mathbf{B}_u u(t) \\ u'(t)&=\mathbf{C}_u \mathbf{x}_u(t)+\mathbf{D}_u u(t) \end{aligned}

The augmented state vector ξ\boldsymbol{\xi} concatenates the system states and the filter states:

ξ(t)=[x⊤(t)xe⊤(t)xu⊤(t)]⊤\boldsymbol{\xi}(t) = \begin{bmatrix} \mathbf{x}^\top(t) & \mathbf{x}_e^\top(t) & \mathbf{x}_u^\top(t) \end{bmatrix}^\top

To construct the augmented matrices, we must express the dynamics of the filters in terms of the global system inputs (wρ,r,uw_\rho, r, u) and the augmented state vector ξ\boldsymbol{\xi}. Based on the synthesis scheme (Figure 2), the error signal is defined as e(t)=r(t)−y(t)=r(t)−Cyx(t)e(t) = r(t) - y(t) = r(t) - \mathbf{C}_y \mathbf{x}(t).

Augmented State Dynamics
We substitute the error equation into the state equation of the performance filter WeW_e. The control filter WuW_u depends only on the control input uu. By assembling these with the nominal system dynamics, we obtain:

x˙(t)=Anomx(t)+Bρwρ(t)+Bu(t)x˙e(t)=Aexe(t)+Be(r(t)−Cyx(t))=−BeCyx(t)+Aexe(t)+Ber(t)x˙u(t)=Auxu(t)+Buu(t)\begin{aligned} \dot{\mathbf{x}}(t) &= \mathbf{A}_{\text{nom}}\mathbf{x}(t) + \mathbf{B}_\rho w_\rho(t) + \mathbf{B} u(t) \\ \dot{\mathbf{x}}_e(t) &= \mathbf{A}_e \mathbf{x}_e(t) + \mathbf{B}_e (r(t) - \mathbf{C}_y \mathbf{x}(t)) \\ &= -\mathbf{B}_e \mathbf{C}_y \mathbf{x}(t) + \mathbf{A}_e \mathbf{x}_e(t) + \mathbf{B}_e r(t) \\ \dot{\mathbf{x}}_u(t) &= \mathbf{A}_u \mathbf{x}_u(t) + \mathbf{B}_u u(t) \end{aligned}

We then write the equations in term of ξ\boldsymbol{\xi}:

[x˙(t)x˙e(t)x˙u(t)]⏟ξ˙(t)=[Anom00−BeCyAe000Au]⏟A[x(t)xe(t)xu(t)]+[Bρ00]⏟Bρwρ(t)+[0Be0]⏟Brr(t)+[B0Bu]⏟Buu(t)\underbrace{\begin{bmatrix} \dot{\mathbf{x}}(t) \\ \dot{\mathbf{x}}_e(t) \\ \dot{\mathbf{x}}_u(t) \end{bmatrix}}_{\dot{\boldsymbol{\xi}}(t)} = \underbrace{\begin{bmatrix} \mathbf{A}_{\text{nom}} & \mathbf{0} & \mathbf{0} \\ -\mathbf{B}_e \mathbf{C}_y & \mathbf{A}_e & \mathbf{0} \\ \mathbf{0} & \mathbf{0} & \mathbf{A}_u \end{bmatrix}}_{\mathcal{A}} \begin{bmatrix} \mathbf{x}(t) \\ \mathbf{x}_e(t) \\ \mathbf{x}_u(t) \end{bmatrix} + \underbrace{\begin{bmatrix} \mathbf{B}_\rho \\ \mathbf{0} \\ \mathbf{0} \end{bmatrix}}_{\mathcal{B}_\rho} w_\rho(t) + \underbrace{\begin{bmatrix} \mathbf{0} \\ \mathbf{B}_e \\ \mathbf{0} \end{bmatrix}}_{\mathcal{B}_r} r(t) + \underbrace{\begin{bmatrix} \mathbf{B} \\ \mathbf{0} \\ \mathbf{B}_u \end{bmatrix}}_{\mathcal{B}_u} u(t)

Completing the System Representation
The state equation derived above governs how the system evolves internally. To fully characterize the Generalized Plant, we must now define how it interacts with its environment. This requires specifying the output equations for three distinct loops: the parameter variation loop, the performance evaluation loop (outputs of WeW_e and WuW_u), and the feedback loop to the controller. Table 2 provides a structured summary of these essential channels.

Table 2: Signal definitions for the Standard LPV Interconnection.
ChannelDescription
Parametric (zρ→wρz_\rho\to w_\rho)Interaction with the varying parameter ρ(t)\rho(t). The signal zρz_\rho 'senses' the state affected by the parameter, and wρw_\rho reinjects the variation effect.
Performance (r→wr \to \mathbf{w})Maps exogenous inputs (Reference rr) to regulated outputs (Weighted Error e′e', Weighted Control u′u'). This channel defines what we want to optimize.
Control (u→eu \to e)Physical interface. uu is the force applied by the actuator. The sensor measures the position yy, and the controller receives the tracking error e=r−ye = r - y.

Parametric Loop (zρ→wρz_\rho \to w_\rho):
The LFT feedback signal zρz_\rho depends exclusively on the physical system states x\mathbf{x}. However, to maintain a unified state-space representation for the generalized plant, we must express this output in terms of the augmented state vector ξ\boldsymbol{\xi}. This is done by zero-padding the matrix to account for the filter states:

zρ(t)=Cρx(t)=[Cρ00]⏟Cρ[x(t)xe(t)xu(t)]⏟ξ(t)z_\rho(t) = \mathbf{C}_\rho \mathbf{x}(t) = \underbrace{\begin{bmatrix} \mathbf{C}_\rho & \mathbf{0} & \mathbf{0} \end{bmatrix}}_{\mathcal{C}_\rho} \underbrace{\begin{bmatrix} \mathbf{x}(t) \\ \mathbf{x}_e(t) \\ \mathbf{x}_u(t) \end{bmatrix}}_{\boldsymbol{\xi}(t)}

Regulated Outputs w\mathbf{w}:
The performance vector w\mathbf{w} consists of the weighted error e′e' and the weighted control effort u′u'. We substitute the physical error expression into the output equation of WeW_e:

e′(t)=Cexe(t)+De(r(t)−Cyx(t))=−DeCyx(t)+Cexe(t)+Der(t)u′(t)=Cuxu(t)+Duu(t)⟹w(t)≜[e′(t)u′(t)]=[−DeCyCe000Cu]⏟Cwξ(t)+[De0]⏟Dwrr(t)+[0Du]⏟Dwuu(t)\begin{aligned} e'(t) &= \mathbf{C}_e \mathbf{x}_e(t) + \mathbf{D}_e (r(t) - \mathbf{C}_y \mathbf{x}(t)) \\ &= -\mathbf{D}_e \mathbf{C}_y \mathbf{x}(t) + \mathbf{C}_e \mathbf{x}_e(t) + \mathbf{D}_e r(t) \\ u'(t) &= \mathbf{C}_u \mathbf{x}_u(t) + \mathbf{D}_u u(t) \\ \Longrightarrow\quad\mathbf{w}(t) \triangleq \begin{bmatrix}e'(t)\\u'(t)\end{bmatrix}&= \underbrace{\begin{bmatrix}-\mathbf{D}_e\mathbf{C}_y &\mathbf{C}_e &\mathbf{0}\\\mathbf{0}&\mathbf{0}&\mathbf{C}_u\end{bmatrix}}_{\mathcal{C}_w}\boldsymbol{\xi}(t)+\underbrace{\begin{bmatrix}\mathbf{D}_e\\\mathbf{0}\end{bmatrix}}_{\mathcal{D}_{wr}}r(t)+\underbrace{\begin{bmatrix}\mathbf{0}\\\mathbf{D}_u\end{bmatrix}}_{\mathcal{D}_{wu}}u(t) \end{aligned}

Measurement Output ee:
Finally, the controller observes the tracking error ee. This observation equation acts as the feedback interface (we already have written it before):

e(t)=r(t)−Cyx(t)=[−Cy00]⏟Ceξ(t)+r(t)e(t) = r(t) - \mathbf{C}_y \mathbf{x}(t) = \underbrace{\begin{bmatrix}-\mathbf{C}_y&\mathbf{0}&\mathbf{0}\end{bmatrix}}_{\mathcal{C}_e}\boldsymbol{\xi}(t) + r(t)

By stacking these equations into matrix form, we identify the specific blocks of the generalized plant.

The full interconnection is described by the partitioned matrix:

[ξ˙(t)zρ(t)w(t)e(t)]=[ABρBrBuCρ000Cw0DwrDwuCe010][ξ(t)wρ(t)r(t)u(t)]\begin{bmatrix} \dot{\boldsymbol{\xi}}(t) \\ z_\rho(t) \\ \mathbf{w}(t) \\ e(t) \end{bmatrix} = \begin{bmatrix} \mathcal{A} & \mathcal{B}_\rho & \mathcal{B}_r & \mathcal{B}_u \\ \mathcal{C}_\rho & \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathcal{C}_w & \mathbf{0} & \mathcal{D}_{wr} & \mathcal{D}_{wu} \\ \mathcal{C}_e & \mathbf{0} & 1 & \mathbf{0} \end{bmatrix} \begin{bmatrix} \boldsymbol{\xi}(t) \\ w_\rho(t) \\ r(t) \\ u(t) \end{bmatrix}

We can now focus on the explicit definition of the filters WeW_e and WuW_u.

3Weighting Filters Design

The synthesis process relies on properly shaping the closed-loop response. Before solving the optimization problem, we must define the performance requirements (WeW_e and WuW_u) and formally state the input-output map (The Operator).

As we can see on Figure 2, we do not minimize the physical error directly. Instead, we use weighting filters WeW_e and WuW_u to shape the signals. These filters act as frequency-dependent penalties. The choice of these transfer functions dictates the trade-off between performance and robustness. For this example, we select:

We(s)=0.5s+3s+0.06,Wu(s)=0.2s+10s+1000W_e(s) = \frac{0.5s + 3}{s + 0.06}, \quad W_u(s) = \frac{0.2s + 10}{s + 1000}

Justification of WeW_e (Performance):
This filter shapes the sensitivity function SS (the transfer from reference rr to error ee). The fundamental constraint is ∣S(jω)∣<1/∣We(jω)∣|S(j\omega)| < 1/|W_e(j\omega)| and is represented in Figure 3. To ensure high precision, we focus on the behavior at zero frequency (s→0s \to 0).

  • Frequency Zero implies Steady-State: A frequency of zero (s=0s=0) corresponds to a signal that does not change over time (a constant). Therefore, the filter's gain at s=0s=0 dictates the system's behavior in the steady-state regime (as t→∞t \to \infty).
  • Static Gain Calculation: Evaluating the filter at s=0s=0 yields: We(0)=0.5(0)+30+0.06=30.06=50W_e(0) = \frac{0.5(0) + 3}{0 + 0.06} = \frac{3}{0.06} = 50. This means the filter demands an amplification of 50 for constant signals.
  • Precision Guarantee (2% Error): Since the constraint forces the error sensitivity ∣S∣|S| to be less than the inverse of the weight, we have: ∣S(0)∣<1We(0)=150=0.02|S(0)| < \frac{1}{W_e(0)} = \frac{1}{50} = 0.02. So, for a constant reference and a frozen parameter, the steady-state error will never exceed 2%, as soon as the synthesis reaches the objective ∥WeS∥∞<1\|W_e S\|_\infty < 1. For a time-varying ρ(t)\rho(t), this frequency-by-frequency reading is only an approximation: what the synthesis really bounds is the L2L_2 gain of the whole weighted operator (Section 4).

Justification of WuW_u (Control Effort & Robustness):
This filter shapes the Control Sensitivity function KSKS (the transfer from reference rr to control input uu). The constraint is ∣KS(jω)∣<1/∣Wu(jω)∣|KS(j\omega)| < 1/|W_u(j\omega)| and is represented in Figure 3. We analyze the inverse of the weight (the ceiling) at the frequency extremes:

  • Low Frequencies (s→0s \to 0): Permissiveness.
    At steady-state, Wu(0)=101000=0.01⇒1Wu(0)=100W_u(0) = \frac{10}{1000} = 0.01 \Rightarrow \frac{1}{W_u(0)} = 100. This sets a high ceiling (100) for the control action. It allows the controller to generate large static forces (up to 100 times the reference amplitude) if necessary to compress the spring and eliminate the static error. We do not want to restrict the controller's authority here.
  • High Frequencies (s→∞s \to \infty): Restriction (Roll-off).
    At high frequencies, Wu(s)∼0.2ss=0.2W_u(s) \sim \frac{0.2s}{s} = 0.2 as s→∞s \to \infty, hence 1Wu(∞)=5\frac{1}{W_u(\infty)} = 5. This sets a low ceiling (5), twenty times lower than the first one. At these frequencies the loop no longer has any effect and S≈1S \approx 1, so KS≈KKS \approx K: a high-frequency ceiling of 5 (14 dB) limits the control action produced by sensor noise.

Between the two: why the ceiling only falls above 50 rad/s.
The weight keeps its low value up to its zero, at 5050 rad/s, and reaches its high-frequency value beyond its pole, at 10001000 rad/s. This leaves room to the controller where the mass needs it. Tracking is asked up to about 3.53.5 rad/s, the frequency at which ∣We(jω)∣=1|W_e(j\omega)| = 1. There the loop still follows the reference, so that ∣T∣=∣PKS∣|T| = |P K S| stays close to 11 and ∣KS∣=∣T∣/∣P∣|KS| = |T| / |P| is close to 1/∣P(jω)∣=∣k0−m ω2+j c ω∣1 / |P(j\omega)| = |k_0 - m\, \omega^2 + j\, c\, \omega|. This quantity grows like m ω2m\, \omega^2: moving a mass faster takes a force that grows with the square of the frequency, and the loop only lets go of the reference about a decade further. So ∣KS∣|KS| must first rise before it can fall. For the controller of this page, with the parameter frozen at ρ=0\rho = 0, it reaches 3636 at 1010 rad/s and about 4848 near 2020 rad/s, then falls to 0.340.34 at 10001000 rad/s. With the earlier filter (2s+0.2)/(s+10)(2s + 0.2)/(s + 10), the ceiling for ∣KS∣|KS| is about 0.710.71 at 1010 rad/s and tends to 0.50.5 at high frequencies. For the earlier weights and ρ=0\rho = 0, the smallest possible weighted gain at 1.231.23 rad/s already exceeds 1.631.63 in the continuous model, regardless of the controller. This rules out γ<1\gamma < 1 even at the nominal stiffness.

Figure 3: Frequency response of the weighting filters.
Click the figure to zoom.

4L2L_2-norm, H∞\mathcal{H}_\infty-norm and H∞\mathcal{H}_\infty-synthesis

In the first three sections, all the objects related to the design of an H∞\mathcal{H}_\infty controller have been defined and motivated. But to be honest, it is perfectly normal for you to wonder what H∞\mathcal{H}_\infty actually is and what its purpose is. This section is therefore dedicated to this topic.

The H∞\mathcal{H}_\infty-norm is a norm based on signal energy (L2L_2-norm). Let's firstly define this L2L_2-norm.

The L2L_2-norm of a signal u(t)u(t) can be infinite, e.g. u(t)=sin⁡(t)u(t) = \sin(t) or u(t)=cos⁡(t)u(t) = \cos(t) have infinite energy. A necessary condition for a uniformly continuous signal to have a finite L2L_2-norm is that its value tends to zero as tt goes to infinity. This is not a sufficient condition, e.g. u(t)=1t+1u(t) = \frac{1}{\sqrt{t+1}} has an infinite L2L_2-norm but tends to zero (but not fast enough) as tt goes to infinity.

The purpose of this section is not to delve into the theoretical depths of the L2L_2-norm. However, the module below is available for those who wish to gain a practical sense of this metric. Use it to experiment with different signals and see firsthand which ones possess finite energy. It displays the norm ∥u∥L2\|u\|_{L_2}, that is the square root of the integral above, and draws the integral itself as a reference line.

Signal L2L_2 Norm Explorer

Enter a function of time 't' (e.g., sin(t)*exp(-0.5*t)) to visualize its energy. The blue area represents the squared magnitude.

Documentation

Supported functions
  • sin
  • cos
  • tan
  • exp
  • log
  • sqrt
  • sinh
  • cosh
  • tanh
Syntax rules
  • Powers: use ^ or ** (e.g. t^2)
  • Multiplication: explicit * is safer (2*t)
  • Constants: pi is available, use exp(1) for ee
Approximation limits

For very complex non-linear functions, this approximation may differ from the exact theoretical value or fail to converge.

05.0 × 10−101.0 × 10−9012345

tt (s)

  • u(t)u(t)
  • ∣u(t)∣2|u(t)|^2
  • ∫0t∣u(τ)∣2 dτ\int_0^t |u(\tau)|^2\,\mathrm{d}\tau (accumulated energy)

The plot above is computed directly. To get the exact and numeric value of the norm, SymPy and SciPy run in your browser: this downloads about 90 MB from cdn.jsdelivr.net, once.

Find the Worst-Case Input

Below is a stable linear system (unknown to you). Try to find an input signal u(t)=sin⁡(ωt)u(t)=\sin(\omega t) that maximizes the gain (output norm / input norm). For a sine input, in steady state, this ratio is exactly ∣H(jω)∣|H(j\omega)|, which is what the module plots. If you maximize this ratio, you have found the H∞\mathcal{H}_\infty norm of the system.

Input u(t)u(t) and output y(t)y(t)

−505051015

Time (s)

  • Input u(t)u(t)
  • Output y(t)y(t)

Gain ∥y∥/∥u∥=∣H(jω)∣\|y\| / \|u\| = |H(j\omega)| at the frequencies explored

0246510

ω\omega (rad/s)

  • Gain

u(t)=sin⁡(ωt)u(t) = \sin(\omega t)

Current gain ratio
7.0711
Your max found
7.0711

To mathematically formulate the problem, we define the Closed-Loop Operator Tzw\mathbf{T}_{zw}. This operator maps the exogenous input rr to the regulated performance outputs w\mathbf{w}:

w=Tzw(P,K,ρ) r\mathbf{w} = \mathbf{T}_{zw}(P, K, \rho)\, r
Figure 4: The closed-loop operator Tzw\mathbf{T}_{zw}: the whole dashed box, seen as a single system. The same measured parameter ρ(t)\rho(t) is looped on the plant at the top and on the controller at the bottom, as in [1].
Click the figure to zoom.

Figure 4 shows what is inside this operator. Once the plant PP, the controller KK and the parameter ρ\rho are connected, the signals zρz_\rho, wρw_\rho, ee, uu, zθz_\theta and wθw_\theta stay inside the loop. Seen from outside, only the reference rr enters and only the weighted signals w\mathbf{w} leave. That is all Tzw\mathbf{T}_{zw} is: the map between the two.

Its gain compares the size of what leaves with the size of what enters. Keeping this gain below γ\gamma means that, for every non-zero rr of finite energy, from zero initial conditions and for every admissible ρ(t)\rho(t):

∥w∥L2<γ ∥r∥L2\|\mathbf{w}\|_{L_2} < \gamma\, \|r\|_{L_2}

Since w\mathbf{w} gathers the weighted error e′e' and the weighted control u′u', its energy is the sum of theirs, ∥w∥L22=∥e′∥L22+∥u′∥L22\|\mathbf{w}\|_{L_2}^2 = \|e'\|_{L_2}^2 + \|u'\|_{L_2}^2. A small gain therefore means a small tracking error and a restrained control effort, in the frequency ranges emphasized by WeW_e and WuW_u.

This operator depends on the Generalized Plant PP, the Controller KK and the parameter ρ\rho. The H∞\mathcal{H}_\infty synthesis problem is formulated as follows:

Let's read this line slowly, because γ\gamma appears twice, and that is no accident. On the right, γ\gamma is the performance level: the smaller it is, the better. Under the sup⁡\sup, 1/γ1/\gamma is the range of ρ\rho covered by the guarantee. Both are linked by the small-gain idea: if what surrounds ρ\rho has a gain below γ\gamma and if ∣ρ∣≤1/γ|\rho| \le 1/\gamma, a signal going around the loop through ρ\rho comes back smaller than it left, so the loop stays stable. Lowering γ\gamma therefore improves the performance and widens the range of ρ\rho at the same time. Here the unsaturated discrete model is certified at γ=0.85\gamma = 0.85, so ∣ρ∣≤1/γ≈1.17647|\rho| \le 1/\gamma \approx 1.17647 covers the design range ∣ρ∣≤1|\rho| \le 1.

How such a controller is found, and why the result can be trusted, is the subject of Section 5.

5Gain-scheduled synthesis: the method of Apkarian and Gahinet, with its proofs

5.1The plan

Section 4 ended on a problem statement: find a controller K(ρ)K(\rho) and the smallest γ\gamma such that the gain of Tzw\mathbf{T}_{zw} stays below γ\gamma for every ρ(t)\rho(t) such that ∣ρ(t)∣≤1/γ|\rho(t)| \le 1/\gamma. Stated like this, the problem cannot be handed to a solver: the unknown is a whole dynamical system, and the condition must hold for infinitely many functions ρ(t)\rho(t). Following the method of Apkarian and Gahinet [1], we derive sufficient matrix inequalities for the scalar parameter in this example. The derivation uses completion of squares and changes of coordinates to separate the controller from the certificate.

  • Step 1. Take ρ\rho out: the closed loop is one constant system, looped on ρ\rho.
  • Step 2. State the small-gain theorem with a change of units called a scaling: a single inequality, written (D) below, guarantees stability and performance for every admissible ρ(t)\rho(t).
  • Step 3. Turn (D) into a matrix inequality: this is the bounded real lemma.
  • Step 4. Eliminate the controller from this inequality: this is the projection lemma.
  • Step 5. Read what remains: the Linear Matrix Inequalities for this scalar parameter, which are convex.
  • Step 6. Rebuild the controller from their solution.

5.2Step 1: one constant system, looped on the parameter

In Figure 4, ρ(t)\rho(t) appears twice: on the plant, through wρ=ρ zρw_\rho = \rho\, z_\rho, and on the controller, through wθ=ρ zθw_\theta = \rho\, z_\theta. Stack the two channels into zΔ=(zθ,zρ)\mathbf{z}_\Delta = (z_\theta, z_\rho) and wΔ=(wθ,wρ)\mathbf{w}_\Delta = (w_\theta, w_\rho). The two loops then read as a single one:

wΔ(t)=ρ(t) zΔ(t)\mathbf{w}_\Delta(t) = \rho(t)\, \mathbf{z}_\Delta(t)

Everything else inside the dashed box, that is PP and KK connected through ee and uu, contains no ρ\rho: it is a linear time-invariant system, which we call MM. Its state gathers the states of the plant and of the controller, xcl=(ξ,xK)\mathbf{x}_{\mathrm{cl}} = (\boldsymbol{\xi}, \mathbf{x}_K). Its inputs are ν=(wΔ,r)\boldsymbol{\nu} = (\mathbf{w}_\Delta, r) and its outputs η=(zΔ,w)\boldsymbol{\eta} = (\mathbf{z}_\Delta, \mathbf{w}):

x˙cl(t)=Acl xcl(t)+Bcl ν(t)η(t)=Ccl xcl(t)+Dcl ν(t)\begin{aligned} \dot{\mathbf{x}}_{\mathrm{cl}}(t) &= \mathbf{A}_{\mathrm{cl}}\, \mathbf{x}_{\mathrm{cl}}(t) + \mathbf{B}_{\mathrm{cl}}\, \boldsymbol{\nu}(t) \\ \boldsymbol{\eta}(t) &= \mathbf{C}_{\mathrm{cl}}\, \mathbf{x}_{\mathrm{cl}}(t) + \mathbf{D}_{\mathrm{cl}}\, \boldsymbol{\nu}(t) \end{aligned}

Two facts about MM matter for what follows. First, the whole difficulty of a time-varying system is now concentrated in one multiplication by a number, ρ(t)\rho(t), of which we only know that ∣ρ(t)∣≤1/γ|\rho(t)| \le 1/\gamma. Second, MM depends on the unknown controller in the simplest possible way. Gather the nine matrices of the controller into a single one, Ω\boldsymbol{\Omega}. Substituting the equations of KK into those of PP gives:

Ω=[AKBK1BKθCK1DK11DK1θCKθDKθ1DKθθ][AclBclCclDcl]=[A0B0C0D0]+[BΩDΩ]Ω[CΩEΩ]\begin{gathered} \boldsymbol{\Omega} = \begin{bmatrix} \mathbf{A}_K & \mathbf{B}_{K1} & \mathbf{B}_{K\theta} \\ \mathbf{C}_{K1} & \mathbf{D}_{K11} & \mathbf{D}_{K1\theta} \\ \mathbf{C}_{K\theta} & \mathbf{D}_{K\theta 1} & \mathbf{D}_{K\theta\theta} \end{bmatrix} \\[4pt] \begin{bmatrix} \mathbf{A}_{\mathrm{cl}} & \mathbf{B}_{\mathrm{cl}} \\ \mathbf{C}_{\mathrm{cl}} & \mathbf{D}_{\mathrm{cl}} \end{bmatrix} = \begin{bmatrix} \mathbf{A}_0 & \mathbf{B}_0 \\ \mathbf{C}_0 & \mathbf{D}_0 \end{bmatrix} + \begin{bmatrix} \mathbf{B}_\Omega \\ \mathbf{D}_\Omega \end{bmatrix} \boldsymbol{\Omega} \begin{bmatrix} \mathbf{C}_\Omega & \mathbf{E}_\Omega \end{bmatrix} \end{gathered}

The matrices with the index 00 or Ω\Omega contain only the matrices of the generalized plant of Section 2, zeros and identities. The controller appears once and to the first power: the closed loop is affine in Ω\boldsymbol{\Omega}. This can be seen on one line of the computation: the plant state obeys ξ˙=(A+BuDK11 Ce) ξ+BuCK1 xK+…\dot{\boldsymbol{\xi}} = (\mathcal{A} + \mathcal{B}_u \mathbf{D}_{K11}\, \mathcal{C}_e)\, \boldsymbol{\xi} + \mathcal{B}_u \mathbf{C}_{K1}\, \mathbf{x}_K + \dots, where each controller matrix is multiplied by plant matrices, never by another controller matrix.

Let us write these matrices down, because Step 4 will use them. The controller reads three things, stacked into one vector: its own state xK\mathbf{x}_K, the error ee and its parameter channel wθw_\theta. It produces three things: the derivative of its state, the control uu and zθz_\theta. In one line:

[x˙Kuzθ]=Ω[xKewθ]\begin{bmatrix} \dot{\mathbf{x}}_K \\ u \\ z_\theta \end{bmatrix} = \boldsymbol{\Omega} \begin{bmatrix} \mathbf{x}_K \\ e \\ w_\theta \end{bmatrix}

What the controller reads is a linear function of the state xcl=(ξ,xK)\mathbf{x}_{\mathrm{cl}} = (\boldsymbol{\xi}, \mathbf{x}_K) and of the inputs ν=(wθ,wρ,r)\boldsymbol{\nu} = (w_\theta, w_\rho, r) of MM, because the error is e=Ce ξ+re = \mathcal{C}_e\, \boldsymbol{\xi} + r (Section 2):

[xKewθ]=[0ICe000]⏟CΩxcl+[000001100]⏟EΩν\begin{bmatrix} \mathbf{x}_K \\ e \\ w_\theta \end{bmatrix} = \underbrace{\begin{bmatrix} \mathbf{0} & \mathbf{I} \\ \mathcal{C}_e & \mathbf{0} \\ \mathbf{0} & \mathbf{0} \end{bmatrix}}_{\mathbf{C}_\Omega} \mathbf{x}_{\mathrm{cl}} + \underbrace{\begin{bmatrix} \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathbf{0} & \mathbf{0} & 1 \\ 1 & \mathbf{0} & \mathbf{0} \end{bmatrix}}_{\mathbf{E}_\Omega} \boldsymbol{\nu}

What it produces enters MM in two places. In the state equation, the derivative of its state is the lower half of x˙cl\dot{\mathbf{x}}_{\mathrm{cl}}, and the control acts on the plant through Bu\mathcal{B}_u. In the output equation, zθz_\theta is the first block of η=(zθ,zρ,w)\boldsymbol{\eta} = (z_\theta, z_\rho, \mathbf{w}), and the control reaches w\mathbf{w} through Dwu\mathcal{D}_{wu}:

BΩ=[0Bu0I00],DΩ=[0010000Dwu0]\mathbf{B}_\Omega = \begin{bmatrix} \mathbf{0} & \mathcal{B}_u & \mathbf{0} \\ \mathbf{I} & \mathbf{0} & \mathbf{0} \end{bmatrix}, \qquad \mathbf{D}_\Omega = \begin{bmatrix} \mathbf{0} & \mathbf{0} & 1 \\ \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathbf{0} & \mathcal{D}_{wu} & \mathbf{0} \end{bmatrix}
BΩ=[0Bu0I00]DΩ=[0010000Dwu0]\begin{gathered} \mathbf{B}_\Omega = \begin{bmatrix} \mathbf{0} & \mathcal{B}_u & \mathbf{0} \\ \mathbf{I} & \mathbf{0} & \mathbf{0} \end{bmatrix} \\[3pt] \mathbf{D}_\Omega = \begin{bmatrix} \mathbf{0} & \mathbf{0} & 1 \\ \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathbf{0} & \mathcal{D}_{wu} & \mathbf{0} \end{bmatrix} \end{gathered}

The rest does not go through the controller. It is the plant alone, as if the controller produced nothing:

A0=[A000],B0=[0BρBr000]C0=[00Cρ0Cw0],D0=[00000000Dwr]\begin{gathered} \mathbf{A}_0 = \begin{bmatrix} \mathcal{A} & \mathbf{0} \\ \mathbf{0} & \mathbf{0} \end{bmatrix}, \qquad \mathbf{B}_0 = \begin{bmatrix} \mathbf{0} & \mathcal{B}_\rho & \mathcal{B}_r \\ \mathbf{0} & \mathbf{0} & \mathbf{0} \end{bmatrix} \\[4pt] \mathbf{C}_0 = \begin{bmatrix} \mathbf{0} & \mathbf{0} \\ \mathcal{C}_\rho & \mathbf{0} \\ \mathcal{C}_w & \mathbf{0} \end{bmatrix}, \qquad \mathbf{D}_0 = \begin{bmatrix} \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathbf{0} & \mathbf{0} & \mathcal{D}_{wr} \end{bmatrix} \end{gathered}
A0=[A000]B0=[0BρBr000]C0=[00Cρ0Cw0]D0=[00000000Dwr]\begin{gathered} \mathbf{A}_0 = \begin{bmatrix} \mathcal{A} & \mathbf{0} \\ \mathbf{0} & \mathbf{0} \end{bmatrix} \\[3pt] \mathbf{B}_0 = \begin{bmatrix} \mathbf{0} & \mathcal{B}_\rho & \mathcal{B}_r \\ \mathbf{0} & \mathbf{0} & \mathbf{0} \end{bmatrix} \\[3pt] \mathbf{C}_0 = \begin{bmatrix} \mathbf{0} & \mathbf{0} \\ \mathcal{C}_\rho & \mathbf{0} \\ \mathcal{C}_w & \mathbf{0} \end{bmatrix} \\[3pt] \mathbf{D}_0 = \begin{bmatrix} \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathbf{0} & \mathbf{0} & \mathcal{D}_{wr} \end{bmatrix} \end{gathered}

Check one block to see how the pieces fit: the upper-left block of A0+BΩΩ CΩ\mathbf{A}_0 + \mathbf{B}_\Omega \boldsymbol{\Omega}\, \mathbf{C}_\Omega is A+BuDK11 Ce\mathcal{A} + \mathcal{B}_u \mathbf{D}_{K11}\, \mathcal{C}_e, the matrix that multiplies ξ\boldsymbol{\xi} in the line above.

5.3Step 2: the small-gain theorem and its scaling

The idea first. Consider the loop made of two elements: MM, seen from wΔ\mathbf{w}_\Delta to zΔ\mathbf{z}_\Delta, and the multiplication by ρ\rho. If MM never amplifies a signal by more than γ\gamma and ρ\rho never by more than 1/γ1/\gamma, a signal that goes once around the loop comes back no larger than it left. If one of the two bounds is strict, it comes back strictly smaller, and nothing is left after many turns: the loop is stable. This is the small-gain theorem. Its strength is that it asks nothing of ρ(t)\rho(t) but its size: the parameter may vary as fast as it likes. Figure 5 lets you try it.

1004812turns of the loop
Amplification by MM
0.90 γ\gamma
Amplification by ρ\rho
0.90 / γ/\,\gamma
Product over one turn
0.81

At each turn the signal comes back smaller: it dies out, and the loop is stable.

Figure 5: A signal going around the loop. Each bar is the largest size the signal can have after one more turn, its size at the start being 11. One turn multiplies it by at most the amplification of MM times that of ρ\rho. The first is counted in multiples of γ\gamma and the second in multiples of 1/γ1/\gamma: only their product matters.

Its weakness is its pessimism, which a scaling reduces. The size of zΔ\mathbf{z}_\Delta depends on the units in which its components are measured and on the way they are combined. Let us measure zΔ\mathbf{z}_\Delta and wΔ\mathbf{w}_\Delta through the same symmetric positive definite matrix L\mathbf{L}: the size of zΔ\mathbf{z}_\Delta becomes zΔ⊤L zΔ\mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta instead of zΔ⊤zΔ\mathbf{z}_\Delta^\top \mathbf{z}_\Delta. Since ρ(t)\rho(t) multiplies every component by the same number, it shrinks the new size exactly as it shrank the old one. For ∣ρ∣≤1/γ|\rho| \le 1/\gamma:

wΔ⊤L wΔ=ρ2 zΔ⊤L zΔ≤1γ2 zΔ⊤L zΔ(S)\mathbf{w}_\Delta^\top \mathbf{L}\, \mathbf{w}_\Delta = \rho^2\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta \le \frac{1}{\gamma^2}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta \tag{S}
wΔ⊤L wΔ=ρ2 zΔ⊤L zΔ≤1γ2 zΔ⊤L zΔ(S)\begin{aligned} \mathbf{w}_\Delta^\top \mathbf{L}\, \mathbf{w}_\Delta &= \rho^2\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta \\ &\le \frac{1}{\gamma^2}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta \end{aligned} \tag{S}
Figure 6: The scaling in a plane. The large ellipse gathers the vectors zΔ\mathbf{z}_\Delta of size 11 when the size is measured through L\mathbf{L}. Multiplying by ρ\rho shrinks every direction by the same factor: the image of the ellipse is an ellipse of the same shape, ∣ρ∣|\rho| times smaller, and it carries wΔ=ρ zΔ\mathbf{w}_\Delta = \rho\, \mathbf{z}_\Delta. This is what (S) says.
Click the figure to zoom.

The gain of MM, on the other hand, changes with L\mathbf{L}. We are free to pick the L\mathbf{L} for which MM looks smallest: one more unknown, and a far less pessimistic test. With several parameters, L\mathbf{L} must keep the property used above, that of passing through the parameter block, which restricts its shape [1]. With the single parameter of this page, every symmetric positive definite L\mathbf{L} qualifies.

An energy that can only go down: the idea of Lyapunov. The small-gain idea of Figure 5 follows a signal around the loop. To turn it into a proof, the method calls on a second idea, older and more general, due to Aleksandr Lyapunov (1892): to show that a motion dies out, there is no need to compute it. It is enough to find a quantity, attached to the state, that measures how far the system is from rest, and to check that it can only decrease.

Think of a marble in a bowl (Figure 7). As it rolls up the opposite side, its height rises again. Its kinetic and potential energies exchange, while friction dissipates their sum. In Figure 7 the height represents the stored energy of the system, so it decreases along the trajectory. A Lyapunov function is the same object for a dynamical system: a function VV of the state with two properties.

  • It is positive away from rest. V(0)=0V(\mathbf{0}) = 0, and V(x)>0V(\mathbf{x}) > 0 for every other state x\mathbf{x}: rest is the bottom of the bowl.
  • It decreases along every motion. dV/dt<0\mathrm{d}V/\mathrm{d}t < 0 as long as the state is not zero: the marble only goes down.

Then the state never leaves the region enclosed by the level curve of VV on which it starts, and if VV decreases fast enough, the state tends to rest; part (a) of the proof of Result 1, below, writes this argument out in full. For a mechanical system, the natural candidate is the energy, hence the name used on this page, stored energy. For the linear systems of this page, the candidates are the quadratic forms V(x)=x⊤X xV(\mathbf{x}) = \mathbf{x}^\top \mathbf{X}\, \mathbf{x}, with X\mathbf{X} symmetric positive definite: their level curves are ellipses, and their graph is a bowl.

Figure 7: A Lyapunov function as a bowl. The surface is the graph of the energy VV of the mass alone, built in the example below (Figure 9), above the plane of its states (y,v/ω0)(y, v/\omega_0). In blue, a motion of the mass while ρ(t)\rho(t) oscillates over the whole range ∣ρ∣≤1.17|\rho| \le 1.17; in copper, the same motion lifted to the height VV: it can only go down.
Click the figure to zoom.

Why such a detour? For a frozen value of ρ\rho, the mass is a linear system with constant coefficients, and the eigenvalues of its matrix decide stability: here, the mass is stable for every frozen ρ>−2.5\rho > -2.5, where the stiffness is positive. But eigenvalues only describe a frozen system. When ρ(t)\rho(t) varies, a family of systems that are all stable can produce a motion that grows, if one switches between them at the right moments. Figure 8 shows it on the mass alone. With ρ\rho frozen at −2-2 or at 66, the mass comes back to rest. Now take the soft spring, ρ=−2\rho = -2, while the mass moves away from rest, and the stiff one, ρ=6\rho = 6, while it comes back. Each switch to the stiff spring happens at the end of a swing, far from rest, where it multiplies the energy held by the spring; each switch back happens as the mass passes through rest, where the spring holds none. The damper cannot keep up: every swing is wider than the previous one, as when a child pumps a swing.

Figure 8: Stable at every frozen value, unstable when switched. The mass alone, from the same start. With ρ\rho frozen at −2-2 or at 66, it comes back to rest. With ρ\rho switched between these two values at the instants shown below, every swing is about 40% wider than the previous one.
Click the figure to zoom.

No eigenvalue sees this. A Lyapunov function does, provided it does not depend on ρ\rho: its derivative at an instant involves only the current value of ρ\rho, so a decrease checked at each value of a range holds for every way of moving through that range, however fast. The energy of the next example does this for ∣ρ∣<1.5|\rho| < 1.5; the switching of Figure 8 leaves that range.

Where does VV come from? For the mass alone, physics suggests it, and one correction is enough, as the example shows. For the closed loop, nobody can guess it: the matrix X\mathbf{X} becomes an unknown, which the synthesis looks for together with the controller (Steps 3 to 6). Once it is found, it acts as a certificate: the guarantee follows from a few lines of algebra, without simulating anything.

See it first on the mass alone. The statement below rests on one idea: an energy stored in the system, which can only go down. Before stating it for the closed loop, which has eight states, let us look at it where it can be drawn: the mass of Section 1 without control, u=0u = 0. Two states are enough, the position yy and the velocity v=y˙v = \dot{y}, and the motion obeys:

y˙=vm v˙=−c v−k y,k=k0 (1+α ρ(t))\begin{aligned} \dot{y} &= v \\ m\, \dot{v} &= -c\, v - k\, y, \qquad k = k_0\, (1 + \alpha\, \rho(t)) \end{aligned}
y˙=vm v˙=−c v−k yk=k0 (1+α ρ(t))\begin{aligned} \dot{y} &= v \\ m\, \dot{v} &= -c\, v - k\, y \\ k &= k_0\, (1 + \alpha\, \rho(t)) \end{aligned}

A natural candidate is the mechanical energy at the nominal stiffness, V0=12 k0 y2+12 m v2V_0 = \frac{1}{2}\, k_0\, y^2 + \frac{1}{2}\, m\, v^2. Differentiate it along the motion and replace y˙\dot{y} and v˙\dot{v} by the two equations:

dV0dt=k0 y y˙+m v v˙=k0 y v+v (−c v−k y)=−c v2−(k−k0) y v\begin{aligned} \frac{\mathrm{d}V_0}{\mathrm{d}t} &= k_0\, y\, \dot{y} + m\, v\, \dot{v} \\ &= k_0\, y\, v + v\, (-c\, v - k\, y) \\ &= -c\, v^2 - (k - k_0)\, y\, v \end{aligned}

The first term is the power lost in the damper: it never has the wrong sign. But it vanishes whenever v=0v = 0, and the second term has no sign at all as soon as k≠k0k \neq k_0: when the stiffness differs from its nominal value, this energy can grow. V0V_0 is not enough. Add to it a term that couples the position and the velocity:

V=12 k0 y2+12 m v2+c2 y v(V)V = \frac{1}{2}\, k_0\, y^2 + \frac{1}{2}\, m\, v^2 + \frac{c}{2}\, y\, v \tag{V}

It is still an energy, positive as soon as the state is not zero, as long as the damper is not too strong. Complete the square in vv:

V=m2(v+c2m y)2+12(k0−c24m)y2V = \frac{m}{2} \left( v + \frac{c}{2m}\, y \right)^2 + \frac{1}{2} \left( k_0 - \frac{c^2}{4m} \right) y^2
V=m2(v+c2m y)2=+12(k0−c24m)y2\begin{aligned} V &= \frac{m}{2} \left( v + \frac{c}{2m}\, y \right)^2 \\ &\phantom{{}={}} {} + \frac{1}{2} \left( k_0 - \frac{c^2}{4m} \right) y^2 \end{aligned}

Both squares have a positive coefficient when c2<4 m k0c^2 < 4\, m\, k_0: this is the condition for the mass alone to oscillate before it comes to rest, and it holds for the values of Table 1. The derivative of VV along the motion is computed like that of V0V_0:

dVdt=k0 y y˙+m v v˙+c2(y˙ v+y v˙)=k0 y v+v (−c v−k y)+c2 v2+c2m y (−c v−k y)=−(c k2m y2+(k−k0+c22m)y v+c2 v2)\begin{aligned} \frac{\mathrm{d}V}{\mathrm{d}t} &= k_0\, y\, \dot{y} + m\, v\, \dot{v} + \frac{c}{2} \left( \dot{y}\, v + y\, \dot{v} \right) \\ &= k_0\, y\, v + v\, (-c\, v - k\, y) + \frac{c}{2}\, v^2 + \frac{c}{2m}\, y\, (-c\, v - k\, y) \\ &= -\left( \frac{c\, k}{2m}\, y^2 + \left( k - k_0 + \frac{c^2}{2m} \right) y\, v + \frac{c}{2}\, v^2 \right) \end{aligned}
dVdt=k0 y y˙+m v v˙=+c2(y˙ v+y v˙)=k0 y v+v (−c v−k y)=+c2 v2=+c2m y (−c v−k y)=−c k2m y2=−(k−k0+c22m)y v=−c2 v2\begin{aligned} \frac{\mathrm{d}V}{\mathrm{d}t} &= k_0\, y\, \dot{y} + m\, v\, \dot{v} \\ &\phantom{{}={}} {} + \frac{c}{2} \left( \dot{y}\, v + y\, \dot{v} \right) \\ &= k_0\, y\, v + v\, (-c\, v - k\, y) \\ &\phantom{{}={}} {} + \frac{c}{2}\, v^2 \\ &\phantom{{}={}} {} + \frac{c}{2m}\, y\, (-c\, v - k\, y) \\ &= -\frac{c\, k}{2m}\, y^2 \\ &\phantom{{}={}} {} - \left( k - k_0 + \frac{c^2}{2m} \right) y\, v \\ &\phantom{{}={}} {} - \frac{c}{2}\, v^2 \end{aligned}

Complete the square in vv once more to read the sign of the bracket. Write κ=k−k0+c22m\kappa = k - k_0 + \frac{c^2}{2m} for the coefficient of its middle term:

c k2m y2+κ y v+c2 v2=c2(v+κc y)2+12c(c2km−κ2)y2\frac{c\, k}{2m}\, y^2 + \kappa\, y\, v + \frac{c}{2}\, v^2 = \frac{c}{2} \left( v + \frac{\kappa}{c}\, y \right)^2 + \frac{1}{2c} \left( \frac{c^2 k}{m} - \kappa^2 \right) y^2
c k2m y2+κ y v+c2 v2=c2(v+κc y)2=+12c(c2km−κ2)y2\begin{aligned} & \frac{c\, k}{2m}\, y^2 + \kappa\, y\, v + \frac{c}{2}\, v^2 \\ &\quad = \frac{c}{2} \left( v + \frac{\kappa}{c}\, y \right)^2 \\ &\quad \phantom{{}={}} {} + \frac{1}{2c} \left( \frac{c^2 k}{m} - \kappa^2 \right) y^2 \end{aligned}

The first square is never negative. The bracket is therefore positive for every non-zero state exactly when the coefficient of the second square is positive, that is when κ2<c2k/m\kappa^2 < c^2 k / m: if the bracket vanished, the second square would give y=0y = 0 and the first one v=0v = 0. Replace κ\kappa by its expression and expand: the terms in c2(k−k0)/mc^2 (k - k_0) / m cancel, and what remains bounds the distance between the stiffness and its nominal value:

(k−k0)2<c2m(k0−c24m)(k - k_0)^2 < \frac{c^2}{m} \left( k_0 - \frac{c^2}{4m} \right)

Since k−k0=k0 α ρk - k_0 = k_0\, \alpha\, \rho, divide by k02k_0^2 and introduce the damping ratio ζ=c/(2m k0)\zeta = c / (2 \sqrt{m\, k_0}): the condition reads α ∣ρ∣<2 ζ1−ζ2\alpha\, |\rho| < 2\, \zeta \sqrt{1 - \zeta^2}. The damper sets the room left to the parameter. Without damping there is none: a stiffness that changes at the right moments feeds energy into the mass, as a child pumps a swing.

With the values of Table 1, ζ≈0.32\zeta \approx 0.32 and the condition is ∣ρ∣<1.5|\rho| < 1.5, which contains the range ∣ρ∣≤1.17|\rho| \le 1.17 of this page. So a single energy, with no ρ\rho in it, decreases along every motion, whatever ρ(t)\rho(t) does in that range and however fast: at each instant, dV/dt\mathrm{d}V/\mathrm{d}t only sees the current value of kk. Over that range the bracket is even at least ε (y2+v2)\varepsilon\, (y^2 + v^2) for some ε>0\varepsilon > 0, because its smallest eigenvalue depends continuously on ρ\rho and is positive at every point of a closed interval: the energy falls at least in proportion to the squared size of the state. This is exactly what Result 1 asks of the closed loop.

Figure 9 shows this computation. In the plane of the states, the level curves of an energy are ellipses, and a motion is a curve. The energy decreases when the motion crosses the ellipses inwards, that is when the velocity of the state makes an obtuse angle with the outward normal: dV/dt\mathrm{d}V/\mathrm{d}t is the product of the two. Choose the mechanical energy, give ρ\rho a value other than zero, and watch the ellipse carried by the state swell at times. Choose the energy (V): it only shrinks, even when the stiffness jumps at the worst moments.

0.20.2y (m)v / ω0 (m)
110−210−410−6246

V(t)/V(0)V(t) / V(0), logarithmic scale · tt (s)

V(t)/V(0)V(t) / V(0)
9.1% of the starting energy is left
exp⁡(−βt)\exp(-\beta t)
95% guaranteed bound
dV/dt\mathrm{d}V/\mathrm{d}t
−0.036 it decreases
ρ\rho
0.00

Along this motion, this energy never grew.

EnergyV=12 k0 y2+12 m v2+c2 y vV = \tfrac{1}{2}\, k_0\, y^2 + \tfrac{1}{2}\, m\, v^2 + \tfrac{c}{2}\, y\, v
Parameter
1.2 s
Figure 9: The stored energy of the mass alone. The plane of the states (y,v)(y, v) of the mass, with the velocity divided by the natural pulsation ω0=k0/m\omega_0 = \sqrt{k_0 / m}, so that both axes are lengths drawn at the same scale. In blue, the motion and its velocity; in green, the outward normal to the level curve. In copper, the level curve of the start: the state never leaves it when the energy only decreases. The ellipse in ink is the level curve carried by the state. On the right, the energy left over time and, in copper, the bound V(0)exp⁡(−βt)V(0) \exp(-\beta t) that the proof of Result 1 guarantees. Click in the plane to launch the mass from another state.

The closed loop of this page has eight states, four for the generalized plant and four for the controller: its ellipses become ellipsoids in a space of dimension eight, which cannot be drawn, but nothing else changes. One difference of substance remains: for the mass alone we could guess the energy, while for the closed loop the matrix X\mathbf{X} is an unknown that the synthesis must find, together with the controller.

Here is the precise statement. It uses an energy stored in the closed loop, V=xcl⊤X xclV = \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X}\, \mathbf{x}_{\mathrm{cl}}, where X\mathbf{X} is symmetric positive definite: VV is positive as soon as the state is not zero.

Where the left-hand side of (D) comes from. At first sight, (D) falls from the sky. It is built in three moves, from the two things we want: performance and stability.

First move: performance is a balance. We want (b), ∥w∥L2<γ ∥r∥L2\|\mathbf{w}\|_{L_2} < \gamma\, \|r\|_{L_2}. Square it and divide by γ>0\gamma > 0:

1γ∫0∞w⊤w dt<γ∫0∞r2 dt\frac{1}{\gamma} \int_0^\infty \mathbf{w}^\top \mathbf{w}\, \mathrm{d}t < \gamma \int_0^\infty r^2\, \mathrm{d}t

Read it as a balance of energy, kept in a currency where what enters through rr counts γ\gamma times its energy and what leaves through w\mathbf{w} counts 1/γ1/\gamma times its energy: the loop must give back less than it receives. Splitting γ2\gamma^2 into γ\gamma on one side and 1/γ1/\gamma on the other changes nothing to the inequality; it gives the two ports of the loop the same form, as the third move will show.

Second move: from a balance over all times to a balance at each instant. A balance over all times cannot be checked instant by instant, because energy received now may leave later. In the meantime, the loop stores it, in a stored energy VV of the kind described above. At each instant, what is stored plus what leaves must not exceed what enters:

dVdt+1γ w⊤w−γ r2≤0\frac{\mathrm{d}V}{\mathrm{d}t} + \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} - \gamma\, r^2 \le 0

Integrated from rest, it gives V(T)+1γ∫0Tw⊤w dt≤γ∫0Tr2 dtV(T) + \frac{1}{\gamma} \int_0^T \mathbf{w}^\top \mathbf{w}\, \mathrm{d}t \le \gamma \int_0^T r^2\, \mathrm{d}t, and since V(T)≥0V(T) \ge 0, the balance over all times follows. With r=0r = 0, it says dV/dt≤0\mathrm{d}V/\mathrm{d}t \le 0: the same VV is a Lyapunov function, and stability comes with performance. Up to the terms in ε\varepsilon, this is the inequality (D′)(\mathrm{D}') of the proof below.

Third move: cut the loop at the parameter. This inequality concerns the closed loop, in which ρ(t)\rho(t) is at work, and ρ(t)\rho(t) is not known when the controller is designed. So cut the loop where ρ\rho acts, and look at MM alone. For MM, wΔ\mathbf{w}_\Delta is one more input that it does not choose, and zΔ\mathbf{z}_\Delta one more output. Treat this port like the other one, measuring sizes with the scaling L\mathbf{L} of (S): count 1γ zΔ⊤L zΔ\frac{1}{\gamma}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta for what MM sends to the parameter, and γ wΔ⊤L wΔ\gamma\, \mathbf{w}_\Delta^\top \mathbf{L}\, \mathbf{w}_\Delta for what comes back. The balance of MM with its two ports is the left-hand side of (D), term for term: what MM stores, then what goes to the parameter net of what comes back, then what leaves through w\mathbf{w} net of what enters through rr:

dVdt+(1γ zΔ⊤L zΔ−γ wΔ⊤L wΔ)+(1γ w⊤w−γ r2)\frac{\mathrm{d}V}{\mathrm{d}t} + \left( \frac{1}{\gamma}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta - \gamma\, \mathbf{w}_\Delta^\top \mathbf{L}\, \mathbf{w}_\Delta \right) + \left( \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} - \gamma\, r^2 \right)
dVdt+(1γ zΔ⊤L zΔ−γ wΔ⊤L wΔ)+(1γ w⊤w−γ r2)\begin{aligned} & \frac{\mathrm{d}V}{\mathrm{d}t} \\ &\quad {} + \left( \frac{1}{\gamma}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta - \gamma\, \mathbf{w}_\Delta^\top \mathbf{L}\, \mathbf{w}_\Delta \right) \\ &\quad {} + \left( \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} - \gamma\, r^2 \right) \end{aligned}

Asking this balance for every wΔ\mathbf{w}_\Delta, and not only for those that ρ\rho would send, removes ρ\rho from the condition: (D) is a property of MM alone, of its matrices, which a computer can test (Step 3). This has a cost: MM must behave even for inputs that no admissible ρ\rho would produce, and this is the caution discussed in Section 5.8. And it loses nothing that matters, because of (S): when the loop is closed with ∣ρ∣≤1/γ|\rho| \le 1/\gamma, what comes back from the parameter is at most γ2ρ2≤1\gamma^2 \rho^2 \le 1 times what it received, counted in the currency of its port. The net flow to the parameter is then positive or zero: the parameter can take energy from MM, never give it. Dropping this flow from (D) leaves exactly the balance of the second move. This is the small-gain theorem, read with energies: a block that gives back less than it receives cannot feed the loop.

The terms in ε\varepsilon only make each inequality strict, with a margin: the proof uses them to obtain an exponential decrease in (a) and a strict gain in (b).

Figure 10 keeps these accounts on the closed loop of this page, with the matrices X\mathbf{X} and L\mathbf{L} computed for its controller (Section 5.8). The reference is a pulse of finite energy: r=0.2r = 0.2 m for 22 s, then 00. Push the parameter beyond 1/γ1/\gamma to see it give energy back, and the guarantee fall.

ρ(t)−0.01MVzΔwΔrwdissipated
EnteredLeft or keptguarantee
γ∫0tr2 dτ\gamma \int_0^t r^2\, \mathrm{d}\tau
100% entered through rr
1γ∫0tw⊤w dτ\tfrac{1}{\gamma} \int_0^t \mathbf{w}^\top \mathbf{w}\, \mathrm{d}\tau
92.2% left through w\mathbf{w}
∫0t(1γ zΔ⊤L zΔ−γ wΔ⊤L wΔ) dτ\int_0^t \bigl( \tfrac{1}{\gamma}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta - \gamma\, \mathbf{w}_\Delta^\top \mathbf{L}\, \mathbf{w}_\Delta \bigr)\, \mathrm{d}\tau
1.9% went to ρ\rho, net
V(t)V(t)
1.6% stored
Dissipated by M
4.3%

At every instant, ∣ρ(t)∣≤1/γ|\rho(t)| \le 1/\gamma: the parameter only receives, and what leaves through w\mathbf{w} stays below what entered through rr. This is the conclusion of Result 1 (b). MM itself always dissipates: (D) is a property of MM alone.

Parameter
2.0 s
Figure 10: The energy balance of the loop of this page. The loop of the simulation, cut at the parameter, computed every millisecond with the discrete-time form of (D) (Section 5.8). On the left, the block MM: its stored energy fills the tank, and what it dissipates leaves at the bottom; the width of each arrow follows the flow it carries. On the right, the accounts since the start, as shares of what entered through rr. The two bars always have the same length: this is the balance itself.

Proof. Close the loop on the parameter: wΔ=ρ zΔ\mathbf{w}_\Delta = \rho\, \mathbf{z}_\Delta with ∣ρ∣≤1/γ|\rho| \le 1/\gamma. (D) holds whatever the inputs of MM, hence for this one too, and (S) applies. Multiply (S) by γ>0\gamma > 0, which keeps the direction of the inequality:

γ wΔ⊤L wΔ=γ ρ2 zΔ⊤L zΔ≤γ⋅1γ2 zΔ⊤L zΔ=1γ zΔ⊤L zΔ\begin{aligned} \gamma\, \mathbf{w}_\Delta^\top \mathbf{L}\, \mathbf{w}_\Delta &= \gamma\, \rho^2\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta \\ &\le \gamma \cdot \frac{1}{\gamma^2}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta \\ &= \frac{1}{\gamma}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta \end{aligned}

Bring the first and the last member to the same side: in (D), the two terms of the parameter channel add up to a quantity that is positive or zero.

1γ zΔ⊤L zΔ−γ wΔ⊤L wΔ≥0\frac{1}{\gamma}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta - \gamma\, \mathbf{w}_\Delta^\top \mathbf{L}\, \mathbf{w}_\Delta \ge 0

Now move these two terms to the right-hand side of (D), then bound that right-hand side from above, one term at a time:

dVdt+1γ w⊤w−γ r2≤−ε(∥xcl∥22+∥wΔ∥22+r2)≤−(1γ zΔ⊤L zΔ−γ wΔ⊤L wΔ)≤−ε(∥xcl∥22+∥wΔ∥22+r2)≤−ε(∥xcl∥22+r2)\begin{aligned} \frac{\mathrm{d}V}{\mathrm{d}t} + \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} - \gamma\, r^2 &\le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + \|\mathbf{w}_\Delta\|_2^2 + r^2 \right) \\ &\phantom{{}\le{}} {} - \left( \frac{1}{\gamma}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta - \gamma\, \mathbf{w}_\Delta^\top \mathbf{L}\, \mathbf{w}_\Delta \right) \\ &\le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + \|\mathbf{w}_\Delta\|_2^2 + r^2 \right) \\ &\le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + r^2 \right) \end{aligned}
dVdt+1γ w⊤w−γ r2≤−ε(∥xcl∥22+∥wΔ∥22+r2)≤−(1γ zΔ⊤L zΔ−γ wΔ⊤L wΔ)≤−ε(∥xcl∥22+∥wΔ∥22+r2)≤−ε(∥xcl∥22+r2)\begin{aligned} & \frac{\mathrm{d}V}{\mathrm{d}t} + \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} - \gamma\, r^2 \\ &\quad \le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + \|\mathbf{w}_\Delta\|_2^2 + r^2 \right) \\ &\quad \phantom{{}\le{}} {} - \left( \frac{1}{\gamma}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta - \gamma\, \mathbf{w}_\Delta^\top \mathbf{L}\, \mathbf{w}_\Delta \right) \\ &\quad \le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + \|\mathbf{w}_\Delta\|_2^2 + r^2 \right) \\ &\quad \le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + r^2 \right) \end{aligned}

The first inequality, written on two lines, is (D) itself. The second drops the bracket, which is positive or zero and carries a minus sign: the right-hand side can only grow. The third drops −ε ∥wΔ∥22-\varepsilon\, \|\mathbf{w}_\Delta\|_2^2, which is negative or zero, for the same reason. Keeping only the first and the last member:

dVdt+1γ w⊤w−γ r2≤−ε(∥xcl∥22+r2)(D′)\frac{\mathrm{d}V}{\mathrm{d}t} + \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} - \gamma\, r^2 \le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + r^2 \right) \tag{$\mathrm{D}'$}
dVdt+1γ w⊤w−γ r2≤−ε(∥xcl∥22+r2)(D′)\begin{gathered} \frac{\mathrm{d}V}{\mathrm{d}t} + \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} - \gamma\, r^2 \\ {} \le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + r^2 \right) \end{gathered} \tag{$\mathrm{D}'$}

(a) Take r=0r = 0. In (D′)(\mathrm{D}'), the term 1γ w⊤w\frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} is positive or zero: dropping it from the left-hand side keeps the inequality true.

dVdt≤dVdt+1γ w⊤w≤−ε ∥xcl∥22\begin{aligned} \frac{\mathrm{d}V}{\mathrm{d}t} &\le \frac{\mathrm{d}V}{\mathrm{d}t} + \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} \\ &\le -\varepsilon\, \|\mathbf{x}_{\mathrm{cl}}\|_2^2 \end{aligned}

To compare ∥xcl∥22\|\mathbf{x}_{\mathrm{cl}}\|_2^2 with VV, let λmin⁡\lambda_{\min} and λmax⁡\lambda_{\max} be the smallest and the largest eigenvalue of X\mathbf{X}: both are positive, since X\mathbf{X} is symmetric positive definite. In an orthonormal basis of eigenvectors of X\mathbf{X}, VV is the sum of the squared coordinates of xcl\mathbf{x}_{\mathrm{cl}}, each weighted by an eigenvalue, and ∥xcl∥22\|\mathbf{x}_{\mathrm{cl}}\|_2^2 is the same sum without the weights. Hence the double bound below, which Figure 11 draws: a level curve of VV lies between two circles.

λmin⁡ ∥xcl∥22≤V≤λmax⁡ ∥xcl∥22\lambda_{\min}\, \|\mathbf{x}_{\mathrm{cl}}\|_2^2 \le V \le \lambda_{\max}\, \|\mathbf{x}_{\mathrm{cl}}\|_2^2
Figure 11: A level curve of the energy, V(x)=V(0)V(\mathbf{x}) = V(0), between two circles. The largest circle it contains has the radius rmin⁡=V(0)/λmax⁡r_{\min} = \sqrt{V(0) / \lambda_{\max}}; the smallest circle around it has the radius rmax⁡=V(0)/λmin⁡r_{\max} = \sqrt{V(0) / \lambda_{\min}}. A state that stays inside the ellipse stays inside the large circle.
Click the figure to zoom.

The bound on the right gives ∥xcl∥22≥V/λmax⁡\|\mathbf{x}_{\mathrm{cl}}\|_2^2 \ge V / \lambda_{\max}. With β=ε/λmax⁡>0\beta = \varepsilon / \lambda_{\max} > 0:

dVdt≤−ε ∥xcl∥22≤−β V\begin{aligned} \frac{\mathrm{d}V}{\mathrm{d}t} &\le -\varepsilon\, \|\mathbf{x}_{\mathrm{cl}}\|_2^2 \\ &\le -\beta\, V \end{aligned}

The derivative of exp⁡(βt) V(t)\exp(\beta t)\, V(t), which is exp⁡(βt)(dVdt+β V)\exp(\beta t) \left( \frac{\mathrm{d}V}{\mathrm{d}t} + \beta\, V \right), is therefore negative or zero: this product never grows, and exp⁡(βt) V(t)≤V(0)\exp(\beta t)\, V(t) \le V(0) for every t≥0t \ge 0. With the bound on the left:

∥xcl(t)∥22≤V(t)λmin⁡≤V(0)λmin⁡ exp⁡(−βt)≤λmax⁡λmin⁡ ∥xcl(0)∥22 exp⁡(−βt)\begin{aligned} \|\mathbf{x}_{\mathrm{cl}}(t)\|_2^2 &\le \frac{V(t)}{\lambda_{\min}} \\ &\le \frac{V(0)}{\lambda_{\min}}\, \exp(-\beta t) \\ &\le \frac{\lambda_{\max}}{\lambda_{\min}}\, \|\mathbf{x}_{\mathrm{cl}}(0)\|_2^2\, \exp(-\beta t) \end{aligned}

The state tends to zero exponentially, wherever it starts: this is (a). The factor λmax⁡/λmin⁡\lambda_{\max} / \lambda_{\min} has a geometric meaning: the state never leaves the ellipse of its start (Figure 9), so it never leaves the circle drawn around that ellipse (Figure 11), but inside it may first move away from the origin. The rate β\beta is a guarantee, not a prediction: on Figure 9, the energy falls much faster than the copper bound.

(b) Start from zero initial conditions, xcl(0)=0\mathbf{x}_{\mathrm{cl}}(0) = \mathbf{0}, so that V(0)=0V(0) = 0, and take a non-zero reference rr of finite energy. We may assume ε<γ\varepsilon < \gamma: if (D) holds for some ε\varepsilon, it holds for every smaller ε\varepsilon, since its right-hand side only grows. In (D′)(\mathrm{D}'), the term −ε ∥xcl∥22-\varepsilon\, \|\mathbf{x}_{\mathrm{cl}}\|_2^2 is negative or zero: dropping it from the right-hand side keeps the inequality true. This is where the state leaves the computation:

dVdt+1γ w⊤w−γ r2≤−ε(∥xcl∥22+r2)≤−ε r2\begin{aligned} \frac{\mathrm{d}V}{\mathrm{d}t} + \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} - \gamma\, r^2 &\le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + r^2 \right) \\ &\le -\varepsilon\, r^2 \end{aligned}
dVdt+1γ w⊤w−γ r2≤−ε(∥xcl∥22+r2)≤−ε r2\begin{aligned} & \frac{\mathrm{d}V}{\mathrm{d}t} + \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} - \gamma\, r^2 \\ &\quad \le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + r^2 \right) \\ &\quad \le -\varepsilon\, r^2 \end{aligned}

Move γ r2\gamma\, r^2 to the right-hand side:

dVdt+1γ w⊤w≤(γ−ε) r2\frac{\mathrm{d}V}{\mathrm{d}t} + \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} \le (\gamma - \varepsilon)\, r^2

This holds at every instant, so it also holds for the integrals from 00 to TT. The integral of dV/dt\mathrm{d}V/\mathrm{d}t is V(T)−V(0)=V(T)V(T) - V(0) = V(T):

V(T)+1γ∫0Tw⊤w dt≤(γ−ε)∫0Tr2 dtV(T) + \frac{1}{\gamma} \int_0^T \mathbf{w}^\top \mathbf{w}\, \mathrm{d}t \le (\gamma - \varepsilon) \int_0^T r^2\, \mathrm{d}t
V(T)+1γ∫0Tw⊤w dt≤(γ−ε)∫0Tr2 dt\begin{aligned} & V(T) + \frac{1}{\gamma} \int_0^T \mathbf{w}^\top \mathbf{w}\, \mathrm{d}t \\ &\quad \le (\gamma - \varepsilon) \int_0^T r^2\, \mathrm{d}t \end{aligned}

V(T)V(T) is positive or zero, since X\mathbf{X} is positive definite: dropping it from the left-hand side keeps the inequality true. Multiply then by γ>0\gamma > 0. Finally, since r2≥0r^2 \ge 0 and γ−ε>0\gamma - \varepsilon > 0, the right-hand side can only grow if its integral runs over all times, which gives ∥r∥L22\|r\|_{L_2}^2:

∫0Tw⊤w dt≤γ (γ−ε)∫0Tr2 dt≤γ (γ−ε) ∥r∥L22\begin{aligned} \int_0^T \mathbf{w}^\top \mathbf{w}\, \mathrm{d}t &\le \gamma\, (\gamma - \varepsilon) \int_0^T r^2\, \mathrm{d}t \\ &\le \gamma\, (\gamma - \varepsilon)\, \|r\|_{L_2}^2 \end{aligned}

The right-hand side no longer depends on TT. The left-hand side grows with TT and stays below this bound: it has a limit, which is ∥w∥L22\|\mathbf{w}\|_{L_2}^2 by the definition above, and this limit satisfies the same bound. Since rr is not zero, ∥r∥L2>0\|r\|_{L_2} > 0, and since ε>0\varepsilon > 0:

∥w∥L22≤γ (γ−ε) ∥r∥L22<γ2 ∥r∥L22\begin{aligned} \|\mathbf{w}\|_{L_2}^2 &\le \gamma\, (\gamma - \varepsilon)\, \|r\|_{L_2}^2 \\ &< \gamma^2\, \|r\|_{L_2}^2 \end{aligned}

Taking square roots gives ∥w∥L2<γ ∥r∥L2\|\mathbf{w}\|_{L_2} < \gamma\, \|r\|_{L_2}: this is (b), and the proof is complete.

Three remarks. The proof never used the way ρ\rho varies, only ∣ρ∣≤1/γ|\rho| \le 1/\gamma at each instant: the guarantee holds for arbitrarily fast variations. Then, γ\gamma plays the two roles announced in Section 4: it bounds the gain from rr to w\mathbf{w}, and 1/γ1/\gamma bounds the parameter. Finally, (D) also ensures that the loop on ρ\rho has a solution at every instant, although zΔ\mathbf{z}_\Delta depends instantly on wΔ\mathbf{w}_\Delta and conversely: taken with a zero state and a zero reference, (D) says that the instantaneous part of MM has a gain below γ\gamma in the units of L\mathbf{L}, so that no non-zero signal can sustain itself instantly around the loop.

5.4Step 3: from trajectories to a matrix inequality

(D) must hold along every trajectory of MM. To turn it into a condition that a computer can test, write it with the two stacked signals of Step 1, the inputs ν=(wΔ,r)\boldsymbol{\nu} = (\mathbf{w}_\Delta, r) and the outputs η=(zΔ,w)\boldsymbol{\eta} = (\mathbf{z}_\Delta, \mathbf{w}). Two matrices keep the accounts of the scaling: Λν=diag⁡(L,1)\boldsymbol{\Lambda}_\nu = \operatorname{diag}(\mathbf{L}, 1) weighs the inputs and Λη=diag⁡(L,I2)\boldsymbol{\Lambda}_\eta = \operatorname{diag}(\mathbf{L}, \mathbf{I}_2) the outputs. Each one measures the parameter channel through L\mathbf{L} and leaves the other signals as they are; they only differ in size, because rr is one number and w=(e′,u′)\mathbf{w} = (e', u') is two. With them, (D) reads:

dVdt+1γ η⊤Λη η−γ ν⊤Λν ν≤−ε(∥xcl∥22+∥ν∥22)\frac{\mathrm{d}V}{\mathrm{d}t} + \frac{1}{\gamma}\, \boldsymbol{\eta}^\top \boldsymbol{\Lambda}_\eta\, \boldsymbol{\eta} - \gamma\, \boldsymbol{\nu}^\top \boldsymbol{\Lambda}_\nu\, \boldsymbol{\nu} \le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + \|\boldsymbol{\nu}\|_2^2 \right)
dVdt+1γ η⊤Λη η−γ ν⊤Λν ν≤−ε(∥xcl∥22+∥ν∥22)\begin{aligned} & \frac{\mathrm{d}V}{\mathrm{d}t} + \frac{1}{\gamma}\, \boldsymbol{\eta}^\top \boldsymbol{\Lambda}_\eta\, \boldsymbol{\eta} - \gamma\, \boldsymbol{\nu}^\top \boldsymbol{\Lambda}_\nu\, \boldsymbol{\nu} \\ &\quad \le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + \|\boldsymbol{\nu}\|_2^2 \right) \end{aligned}

At a given instant, a trajectory of MM can go through any state xcl\mathbf{x}_{\mathrm{cl}} with any input ν\boldsymbol{\nu}, and the rest is imposed by the equations of MM: x˙cl=Acl xcl+Bcl ν\dot{\mathbf{x}}_{\mathrm{cl}} = \mathbf{A}_{\mathrm{cl}}\, \mathbf{x}_{\mathrm{cl}} + \mathbf{B}_{\mathrm{cl}}\, \boldsymbol{\nu} and η=Ccl xcl+Dcl ν\boldsymbol{\eta} = \mathbf{C}_{\mathrm{cl}}\, \mathbf{x}_{\mathrm{cl}} + \mathbf{D}_{\mathrm{cl}}\, \boldsymbol{\nu}. So (D) is a condition on all pairs (xcl,ν)(\mathbf{x}_{\mathrm{cl}}, \boldsymbol{\nu}), and each term of its left-hand side is a quadratic expression of such a pair. Take them one at a time. First the stored energy, V=xcl⊤X xclV = \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X}\, \mathbf{x}_{\mathrm{cl}}:

dVdt=x˙cl⊤X xcl+xcl⊤X x˙cl=2 xcl⊤X x˙cl=2 xcl⊤X(Acl xcl+Bcl ν)=xcl⊤(Acl⊤X+XAcl)xcl+2 xcl⊤XBcl ν\begin{aligned} \frac{\mathrm{d}V}{\mathrm{d}t} &= \dot{\mathbf{x}}_{\mathrm{cl}}^\top \mathbf{X}\, \mathbf{x}_{\mathrm{cl}} + \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X}\, \dot{\mathbf{x}}_{\mathrm{cl}} \\ &= 2\, \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X}\, \dot{\mathbf{x}}_{\mathrm{cl}} \\ &= 2\, \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X} \left( \mathbf{A}_{\mathrm{cl}}\, \mathbf{x}_{\mathrm{cl}} + \mathbf{B}_{\mathrm{cl}}\, \boldsymbol{\nu} \right) \\ &= \mathbf{x}_{\mathrm{cl}}^\top \left( \mathbf{A}_{\mathrm{cl}}^\top \mathbf{X} + \mathbf{X} \mathbf{A}_{\mathrm{cl}} \right) \mathbf{x}_{\mathrm{cl}} + 2\, \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X} \mathbf{B}_{\mathrm{cl}}\, \boldsymbol{\nu} \end{aligned}
dVdt=x˙cl⊤X xcl+xcl⊤X x˙cl=2 xcl⊤X x˙cl=2 xcl⊤X(Acl xcl+Bcl ν)=xcl⊤(Acl⊤X+XAcl)xcl=+2 xcl⊤XBcl ν\begin{aligned} \frac{\mathrm{d}V}{\mathrm{d}t} &= \dot{\mathbf{x}}_{\mathrm{cl}}^\top \mathbf{X}\, \mathbf{x}_{\mathrm{cl}} + \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X}\, \dot{\mathbf{x}}_{\mathrm{cl}} \\ &= 2\, \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X}\, \dot{\mathbf{x}}_{\mathrm{cl}} \\ &= 2\, \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X} \left( \mathbf{A}_{\mathrm{cl}}\, \mathbf{x}_{\mathrm{cl}} + \mathbf{B}_{\mathrm{cl}}\, \boldsymbol{\nu} \right) \\ &= \mathbf{x}_{\mathrm{cl}}^\top \left( \mathbf{A}_{\mathrm{cl}}^\top \mathbf{X} + \mathbf{X} \mathbf{A}_{\mathrm{cl}} \right) \mathbf{x}_{\mathrm{cl}} \\ &\phantom{{}={}} {} + 2\, \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X} \mathbf{B}_{\mathrm{cl}}\, \boldsymbol{\nu} \end{aligned}

The second line uses two facts: a number is equal to its transpose, and X\mathbf{X} is symmetric, so that x˙cl⊤X xcl=xcl⊤X x˙cl\dot{\mathbf{x}}_{\mathrm{cl}}^\top \mathbf{X}\, \mathbf{x}_{\mathrm{cl}} = \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X}\, \dot{\mathbf{x}}_{\mathrm{cl}}. The last line uses them again to write 2 xcl⊤XAcl xcl2\, \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X} \mathbf{A}_{\mathrm{cl}}\, \mathbf{x}_{\mathrm{cl}} as two halves, one of them transposed. Then the outputs, replaced by their expression:

1γ η⊤Λη η=1γ(Ccl xcl+Dcl ν)⊤Λη(Ccl xcl+Dcl ν)\frac{1}{\gamma}\, \boldsymbol{\eta}^\top \boldsymbol{\Lambda}_\eta\, \boldsymbol{\eta} = \frac{1}{\gamma} \left( \mathbf{C}_{\mathrm{cl}}\, \mathbf{x}_{\mathrm{cl}} + \mathbf{D}_{\mathrm{cl}}\, \boldsymbol{\nu} \right)^\top \boldsymbol{\Lambda}_\eta \left( \mathbf{C}_{\mathrm{cl}}\, \mathbf{x}_{\mathrm{cl}} + \mathbf{D}_{\mathrm{cl}}\, \boldsymbol{\nu} \right)
1γ η⊤Λη η=1γ(Ccl xcl+Dcl ν)⊤=Λη(Ccl xcl+Dcl ν)\begin{aligned} & \frac{1}{\gamma}\, \boldsymbol{\eta}^\top \boldsymbol{\Lambda}_\eta\, \boldsymbol{\eta} \\ &\quad = \frac{1}{\gamma} \left( \mathbf{C}_{\mathrm{cl}}\, \mathbf{x}_{\mathrm{cl}} + \mathbf{D}_{\mathrm{cl}}\, \boldsymbol{\nu} \right)^\top \\ &\quad \phantom{{}={}} \quad \boldsymbol{\Lambda}_\eta \left( \mathbf{C}_{\mathrm{cl}}\, \mathbf{x}_{\mathrm{cl}} + \mathbf{D}_{\mathrm{cl}}\, \boldsymbol{\nu} \right) \end{aligned}

The term of the inputs needs no rewriting. Stack the state and the inputs into one vector, q=(xcl,ν)\mathbf{q} = (\mathbf{x}_{\mathrm{cl}}, \boldsymbol{\nu}). The three terms then add up to a single quadratic form, q⊤Φ q\mathbf{q}^\top \boldsymbol{\Phi}\, \mathbf{q}, where the symmetric matrix Φ\boldsymbol{\Phi} gathers them block by block:

Φ=[Acl⊤X+XAclXBclBcl⊤X−γ Λν]+1γ[Ccl⊤Dcl⊤]Λη[CclDcl]\boldsymbol{\Phi} = \begin{bmatrix} \mathbf{A}_{\mathrm{cl}}^\top \mathbf{X} + \mathbf{X} \mathbf{A}_{\mathrm{cl}} & \mathbf{X} \mathbf{B}_{\mathrm{cl}} \\ \mathbf{B}_{\mathrm{cl}}^\top \mathbf{X} & -\gamma\, \boldsymbol{\Lambda}_\nu \end{bmatrix} + \frac{1}{\gamma} \begin{bmatrix} \mathbf{C}_{\mathrm{cl}}^\top \\ \mathbf{D}_{\mathrm{cl}}^\top \end{bmatrix} \boldsymbol{\Lambda}_\eta \begin{bmatrix} \mathbf{C}_{\mathrm{cl}} & \mathbf{D}_{\mathrm{cl}} \end{bmatrix}
Φ=[Acl⊤X+XAclXBclBcl⊤X−γ Λν]=+1γ[Ccl⊤Dcl⊤]Λη[CclDcl]\begin{aligned} \boldsymbol{\Phi} &= \begin{bmatrix} \mathbf{A}_{\mathrm{cl}}^\top \mathbf{X} + \mathbf{X} \mathbf{A}_{\mathrm{cl}} & \mathbf{X} \mathbf{B}_{\mathrm{cl}} \\ \mathbf{B}_{\mathrm{cl}}^\top \mathbf{X} & -\gamma\, \boldsymbol{\Lambda}_\nu \end{bmatrix} \\ &\phantom{{}={}} {} + \frac{1}{\gamma} \begin{bmatrix} \mathbf{C}_{\mathrm{cl}}^\top \\ \mathbf{D}_{\mathrm{cl}}^\top \end{bmatrix} \boldsymbol{\Lambda}_\eta \begin{bmatrix} \mathbf{C}_{\mathrm{cl}} & \mathbf{D}_{\mathrm{cl}} \end{bmatrix} \end{aligned}

The first matrix comes from the stored energy and from the inputs, the product from the outputs. Since ∥xcl∥22+∥ν∥22=∥q∥22\|\mathbf{x}_{\mathrm{cl}}\|_2^2 + \|\boldsymbol{\nu}\|_2^2 = \|\mathbf{q}\|_2^2, (D) says that q⊤Φ q≤−ε ∥q∥22\mathbf{q}^\top \boldsymbol{\Phi}\, \mathbf{q} \le -\varepsilon\, \|\mathbf{q}\|_2^2 for every q\mathbf{q}.

A symmetric matrix is called negative definite, written Φ≺0\boldsymbol{\Phi} \prec 0, when q⊤Φ q<0\mathbf{q}^\top \boldsymbol{\Phi}\, \mathbf{q} < 0 for every non-zero q\mathbf{q}; all its eigenvalues are then negative. This is the same requirement as (D). If (D) holds for some ε>0\varepsilon > 0, then q⊤Φ q\mathbf{q}^\top \boldsymbol{\Phi}\, \mathbf{q} is negative for every non-zero q\mathbf{q}. Conversely, if Φ≺0\boldsymbol{\Phi} \prec 0, the computation made with the eigenvalues of X\mathbf{X} in the proof of Result 1 gives q⊤Φ q≤λmax⁡ ∥q∥22\mathbf{q}^\top \boldsymbol{\Phi}\, \mathbf{q} \le \lambda_{\max}\, \|\mathbf{q}\|_2^2, where λmax⁡\lambda_{\max} is now the largest eigenvalue of Φ\boldsymbol{\Phi}, a negative number: (D) holds with ε=−λmax⁡\varepsilon = -\lambda_{\max}.

One difficulty is left in Φ\boldsymbol{\Phi}: the matrices Ccl\mathbf{C}_{\mathrm{cl}} and Dcl\mathbf{D}_{\mathrm{cl}} appear twice in the same product. They contain the unknown controller, which would thus appear squared. A classical tool unfolds this product.

Figure 12: The quadratic form of the block matrix. It is drawn for a fixed a\mathbf{a}, as a function of b\mathbf{b}, in the case where b\mathbf{b} is a single number. Because H≺0\mathbf{H} \prec 0, it is a parabola that opens downwards. Its top is reached at b=−H−1G⊤a\mathbf{b} = -\mathbf{H}^{-1} \mathbf{G}^\top \mathbf{a}, and the height of that top, in copper, is a⊤(F−GH−1G⊤) a\mathbf{a}^\top (\mathbf{F} - \mathbf{G} \mathbf{H}^{-1} \mathbf{G}^\top)\, \mathbf{a}: the whole parabola is below zero exactly when its top is.
Click the figure to zoom.

Apply the tool to Φ\boldsymbol{\Phi}, read from right to left. Take for F\mathbf{F} the first matrix of Φ\boldsymbol{\Phi}, and:

G=[Ccl⊤ΛηDcl⊤Λη],H=−γ Λη\mathbf{G} = \begin{bmatrix} \mathbf{C}_{\mathrm{cl}}^\top \boldsymbol{\Lambda}_\eta \\ \mathbf{D}_{\mathrm{cl}}^\top \boldsymbol{\Lambda}_\eta \end{bmatrix}, \qquad \mathbf{H} = -\gamma\, \boldsymbol{\Lambda}_\eta

H≺0\mathbf{H} \prec 0 because γ>0\gamma > 0 and L≻0\mathbf{L} \succ 0. And F−GH−1G⊤\mathbf{F} - \mathbf{G} \mathbf{H}^{-1} \mathbf{G}^\top is exactly Φ\boldsymbol{\Phi}, because the three copies of Λη\boldsymbol{\Lambda}_\eta reduce to one:

−GH−1G⊤=1γ[Ccl⊤ΛηDcl⊤Λη]Λη−1[ΛηCclΛηDcl]=1γ[Ccl⊤Dcl⊤]Λη[CclDcl]\begin{aligned} -\mathbf{G} \mathbf{H}^{-1} \mathbf{G}^\top &= \frac{1}{\gamma} \begin{bmatrix} \mathbf{C}_{\mathrm{cl}}^\top \boldsymbol{\Lambda}_\eta \\ \mathbf{D}_{\mathrm{cl}}^\top \boldsymbol{\Lambda}_\eta \end{bmatrix} \boldsymbol{\Lambda}_\eta^{-1} \begin{bmatrix} \boldsymbol{\Lambda}_\eta \mathbf{C}_{\mathrm{cl}} & \boldsymbol{\Lambda}_\eta \mathbf{D}_{\mathrm{cl}} \end{bmatrix} \\ &= \frac{1}{\gamma} \begin{bmatrix} \mathbf{C}_{\mathrm{cl}}^\top \\ \mathbf{D}_{\mathrm{cl}}^\top \end{bmatrix} \boldsymbol{\Lambda}_\eta \begin{bmatrix} \mathbf{C}_{\mathrm{cl}} & \mathbf{D}_{\mathrm{cl}} \end{bmatrix} \end{aligned}
−GH−1G⊤=1γ[Ccl⊤ΛηDcl⊤Λη]Λη−1[ΛηCclΛηDcl]=1γ[Ccl⊤Dcl⊤]Λη[CclDcl]\begin{aligned} & -\mathbf{G} \mathbf{H}^{-1} \mathbf{G}^\top \\ &\quad = \frac{1}{\gamma} \begin{bmatrix} \mathbf{C}_{\mathrm{cl}}^\top \boldsymbol{\Lambda}_\eta \\ \mathbf{D}_{\mathrm{cl}}^\top \boldsymbol{\Lambda}_\eta \end{bmatrix} \boldsymbol{\Lambda}_\eta^{-1} \begin{bmatrix} \boldsymbol{\Lambda}_\eta \mathbf{C}_{\mathrm{cl}} & \boldsymbol{\Lambda}_\eta \mathbf{D}_{\mathrm{cl}} \end{bmatrix} \\ &\quad = \frac{1}{\gamma} \begin{bmatrix} \mathbf{C}_{\mathrm{cl}}^\top \\ \mathbf{D}_{\mathrm{cl}}^\top \end{bmatrix} \boldsymbol{\Lambda}_\eta \begin{bmatrix} \mathbf{C}_{\mathrm{cl}} & \mathbf{D}_{\mathrm{cl}} \end{bmatrix} \end{aligned}

So Φ≺0\boldsymbol{\Phi} \prec 0 exactly when the block matrix built from F\mathbf{F}, G\mathbf{G} and H\mathbf{H} is negative definite. In that larger matrix, Ccl\mathbf{C}_{\mathrm{cl}} and Dcl\mathbf{D}_{\mathrm{cl}} appear once each: nothing is multiplied by itself any more.

The test has a frequency-domain interpretation: the H∞\mathcal{H}_\infty norm of MM is below γ\gamma once its parameter channel is measured through L\mathbf{L}. For a linear time-invariant system and L=I\mathbf{L} = \mathbf{I}, the bounded real lemma is in fact an equivalence: such an X\mathbf{X} exists if and only if the system is stable with an H∞\mathcal{H}_\infty norm below γ\gamma. We have proved the direction that gives guarantees, from the inequality to the gain. The converse, which says that this test loses nothing for a system without parameter, is a deeper theorem, due to Kalman, Yakubovich and Popov; it is presented in [2], we admit it, and the guarantee of this page does not rest on it.

5.5Step 4: eliminating the controller

The unknowns of (B) are X\mathbf{X}, L\mathbf{L} and the controller Ω\boldsymbol{\Omega}, hidden in the four matrices of the closed loop. The trouble comes from products such as XAcl\mathbf{X} \mathbf{A}_{\mathrm{cl}}: they multiply two unknowns, X\mathbf{X} and Ω\boldsymbol{\Omega}. A set described by such products is in general not convex, and a solver can get stuck in it. The way out of [1] is to remove Ω\boldsymbol{\Omega} from the problem altogether. First, see where Ω\boldsymbol{\Omega} sits in (B). Replace the closed-loop matrices by their expression of Step 1: in each block, the part without Ω\boldsymbol{\Omega} and the part with Ω\boldsymbol{\Omega} separate.

XAcl=XA0+XBΩ Ω CΩXBcl=XB0+XBΩ Ω EΩΛηCcl=ΛηC0+ΛηDΩ Ω CΩΛηDcl=ΛηD0+ΛηDΩ Ω EΩ\begin{aligned} \mathbf{X} \mathbf{A}_{\mathrm{cl}} &= \mathbf{X} \mathbf{A}_0 + \mathbf{X} \mathbf{B}_\Omega\, \boldsymbol{\Omega}\, \mathbf{C}_\Omega \\ \mathbf{X} \mathbf{B}_{\mathrm{cl}} &= \mathbf{X} \mathbf{B}_0 + \mathbf{X} \mathbf{B}_\Omega\, \boldsymbol{\Omega}\, \mathbf{E}_\Omega \\ \boldsymbol{\Lambda}_\eta \mathbf{C}_{\mathrm{cl}} &= \boldsymbol{\Lambda}_\eta \mathbf{C}_0 + \boldsymbol{\Lambda}_\eta \mathbf{D}_\Omega\, \boldsymbol{\Omega}\, \mathbf{C}_\Omega \\ \boldsymbol{\Lambda}_\eta \mathbf{D}_{\mathrm{cl}} &= \boldsymbol{\Lambda}_\eta \mathbf{D}_0 + \boldsymbol{\Lambda}_\eta \mathbf{D}_\Omega\, \boldsymbol{\Omega}\, \mathbf{E}_\Omega \end{aligned}

The four parts with Ω\boldsymbol{\Omega} have the same factor on the left of Ω\boldsymbol{\Omega} along each block row, and the same factor on its right along each block column. They are therefore the blocks of one product, placed where (B) has them:

[XBΩ0ΛηDΩ]Ω[CΩEΩ0]=U⊤Ω V,U=[BΩ⊤X0DΩ⊤Λη]V=[CΩEΩ0]\begin{bmatrix} \mathbf{X} \mathbf{B}_\Omega \\ \mathbf{0} \\ \boldsymbol{\Lambda}_\eta \mathbf{D}_\Omega \end{bmatrix} \boldsymbol{\Omega} \begin{bmatrix} \mathbf{C}_\Omega & \mathbf{E}_\Omega & \mathbf{0} \end{bmatrix} = \mathbf{U}^\top \boldsymbol{\Omega}\, \mathbf{V}, \qquad \begin{aligned} \mathbf{U} &= \begin{bmatrix} \mathbf{B}_\Omega^\top \mathbf{X} & \mathbf{0} & \mathbf{D}_\Omega^\top \boldsymbol{\Lambda}_\eta \end{bmatrix} \\ \mathbf{V} &= \begin{bmatrix} \mathbf{C}_\Omega & \mathbf{E}_\Omega & \mathbf{0} \end{bmatrix} \end{aligned}
[XBΩ0ΛηDΩ]Ω[CΩEΩ0]=U⊤Ω VU=[BΩ⊤X0DΩ⊤Λη]V=[CΩEΩ0]\begin{gathered} \begin{bmatrix} \mathbf{X} \mathbf{B}_\Omega \\ \mathbf{0} \\ \boldsymbol{\Lambda}_\eta \mathbf{D}_\Omega \end{bmatrix} \boldsymbol{\Omega} \begin{bmatrix} \mathbf{C}_\Omega & \mathbf{E}_\Omega & \mathbf{0} \end{bmatrix} = \mathbf{U}^\top \boldsymbol{\Omega}\, \mathbf{V} \\[3pt] \mathbf{U} = \begin{bmatrix} \mathbf{B}_\Omega^\top \mathbf{X} & \mathbf{0} & \mathbf{D}_\Omega^\top \boldsymbol{\Lambda}_\eta \end{bmatrix} \\[3pt] \mathbf{V} = \begin{bmatrix} \mathbf{C}_\Omega & \mathbf{E}_\Omega & \mathbf{0} \end{bmatrix} \end{gathered}

The other blocks of (B) that contain Ω\boldsymbol{\Omega} are the transposes of these, since (B) is symmetric: they form V⊤Ω⊤U\mathbf{V}^\top \boldsymbol{\Omega}^\top \mathbf{U}. Call Ψ\boldsymbol{\Psi} what is left, that is the matrix of (B) written for Ω=0\boldsymbol{\Omega} = \mathbf{0}, with A0\mathbf{A}_0, B0\mathbf{B}_0, C0\mathbf{C}_0 and D0\mathbf{D}_0. Then (B) is:

Ψ+U⊤Ω V+V⊤Ω⊤U≺0(E)\boldsymbol{\Psi} + \mathbf{U}^\top \boldsymbol{\Omega}\, \mathbf{V} + \mathbf{V}^\top \boldsymbol{\Omega}^\top \mathbf{U} \prec 0 \tag{E}

The question becomes: Ψ\boldsymbol{\Psi}, U\mathbf{U} and V\mathbf{V} being given, when does some Ω\boldsymbol{\Omega} satisfy (E)? The answer does not involve Ω\boldsymbol{\Omega}.

Why these conditions are necessary. Multiply (E) on the left by a⊤\mathbf{a}^\top and on the right by a\mathbf{a}. If Ua=0\mathbf{U} \mathbf{a} = \mathbf{0}, the two terms that contain Ω\boldsymbol{\Omega} vanish, whatever Ω\boldsymbol{\Omega} is, and a⊤Ψ a<0\mathbf{a}^\top \boldsymbol{\Psi}\, \mathbf{a} < 0 remains. The same happens if Va=0\mathbf{V} \mathbf{a} = \mathbf{0}. In words: in the directions it cannot reach, the controller cannot help, so the inequality must already hold there without it.

Why they are sufficient: the idea, in a plane. This is the remarkable part: nothing else is required. Take first the smallest case that shows everything: a plane, with one direction that U\mathbf{U} does not see and one direction that V\mathbf{V} does not see. Call α\alpha and β\beta the coordinates of a vector along these two directions. Then Ua\mathbf{U} \mathbf{a} only depends on β\beta and Va\mathbf{V} \mathbf{a} only on α\alpha, so the two terms in Ω\boldsymbol{\Omega} add up to a multiple of the product αβ\alpha \beta, and (E) reads:

ψ11 α2+2 (ψ12+ω) αβ+ψ22 β2<0∀ (α,β)≠(0,0)\psi_{11}\, \alpha^2 + 2\, (\psi_{12} + \omega)\, \alpha \beta + \psi_{22}\, \beta^2 < 0 \quad \forall\, (\alpha, \beta) \neq (0, 0)
ψ11 α2+2 (ψ12+ω) αβ+ψ22 β2<0∀ (α,β)≠(0,0)\begin{gathered} \psi_{11}\, \alpha^2 + 2\, (\psi_{12} + \omega)\, \alpha \beta + \psi_{22}\, \beta^2 < 0 \\ \forall\, (\alpha, \beta) \neq (0, 0) \end{gathered}

Here ψ11\psi_{11}, ψ12\psi_{12} and ψ22\psi_{22} are the entries of Ψ\boldsymbol{\Psi} in these coordinates, and ω\omega is a number that Ω\boldsymbol{\Omega} sets as it likes. The first condition, read with β=0\beta = 0, says ψ11<0\psi_{11} < 0; the second, read with α=0\alpha = 0, says ψ22<0\psi_{22} < 0. Choose ω=−ψ12\omega = -\psi_{12}: the middle term disappears, and what is left, ψ11 α2+ψ22 β2\psi_{11}\, \alpha^2 + \psi_{22}\, \beta^2, is negative as soon as α\alpha or β\beta is not zero. The controller cannot change the form along the two axes, but it tilts it everywhere else, and it can cancel the coupling between them. Figure 13 lets you do it.

αβ

ψ11 α2+2 (ψ12+ω) αβ+ψ22 β2\psi_{11}\, \alpha^2 + 2\, (\psi_{12} + \omega)\, \alpha \beta + \psi_{22}\, \beta^2

ω\omega
0.00
ψ12+ω\psi_{12} + \omega
1.60

The form is positive or zero in the copper directions: (E) fails.

On the two axes, the form is always ψ11 α2\psi_{11}\, \alpha^2 or ψ22 β2\psi_{22}\, \beta^2.

Figure 13: The projection lemma in a plane. The quadratic form ψ11 α2+2 (ψ12+ω) αβ+ψ22 β2\psi_{11}\, \alpha^2 + 2\, (\psi_{12} + \omega)\, \alpha \beta + \psi_{22}\, \beta^2, with ψ11<0\psi_{11} < 0 and ψ22<0\psi_{22} < 0. In ink, one of its level curves, where it is equal to −1-1. In copper, the directions in which it is positive or zero: the inequality fails there. On the two axes the form does not depend on ω\omega: the blue axis is the direction that U\mathbf{U} does not see, the green axis the one that V\mathbf{V} does not see.

The general case: four families of directions. In a larger space, a direction can be seen by U\mathbf{U}, by V\mathbf{V}, by both or by neither. Choose coordinates that sort them. Take a basis of the vectors that both U\mathbf{U} and V\mathbf{V} send to zero; complete it into a basis of the vectors that U\mathbf{U} sends to zero; complete the first one, separately, into a basis of the vectors that V\mathbf{V} sends to zero; then complete the whole into a basis of the space. Every vector now has four pieces, a=(a1,a2,a3,a4)\mathbf{a} = (\mathbf{a}_1, \mathbf{a}_2, \mathbf{a}_3, \mathbf{a}_4): a1\mathbf{a}_1 is seen neither by U\mathbf{U} nor by V\mathbf{V}, a2\mathbf{a}_2 is seen by V\mathbf{V} only, a3\mathbf{a}_3 by U\mathbf{U} only, and a4\mathbf{a}_4 by both. In these coordinates:

U=[00U3U4],V=[0V20V4]\mathbf{U} = \begin{bmatrix} \mathbf{0} & \mathbf{0} & \mathbf{U}_3 & \mathbf{U}_4 \end{bmatrix}, \qquad \mathbf{V} = \begin{bmatrix} \mathbf{0} & \mathbf{V}_2 & \mathbf{0} & \mathbf{V}_4 \end{bmatrix}
U=[00U3U4]V=[0V20V4]\begin{gathered} \mathbf{U} = \begin{bmatrix} \mathbf{0} & \mathbf{0} & \mathbf{U}_3 & \mathbf{U}_4 \end{bmatrix} \\[3pt] \mathbf{V} = \begin{bmatrix} \mathbf{0} & \mathbf{V}_2 & \mathbf{0} & \mathbf{V}_4 \end{bmatrix} \end{gathered}

Two facts make the rest work. First, the three families built before the last completion are independent together: by the dimension formula for the sum of two subspaces, there are exactly as many vectors in them as the dimension of the space they span. Second, the columns of [ U3  U4 ][\, \mathbf{U}_3 \ \ \mathbf{U}_4 \,] are independent: if U3 a3+U4 a4=0\mathbf{U}_3\, \mathbf{a}_3 + \mathbf{U}_4\, \mathbf{a}_4 = \mathbf{0}, the vector (0,0,a3,a4)(\mathbf{0}, \mathbf{0}, \mathbf{a}_3, \mathbf{a}_4) is sent to zero by U\mathbf{U}, so it is a combination of the first two families, which is only possible if a3\mathbf{a}_3 and a4\mathbf{a}_4 are zero. The same holds for [ V2  V4 ][\, \mathbf{V}_2 \ \ \mathbf{V}_4 \,]. Now compute the term in Ω\boldsymbol{\Omega}:

U⊤Ω V=[000000000K320K340K420K44],Kij=Ui⊤Ω Vj\mathbf{U}^\top \boldsymbol{\Omega}\, \mathbf{V} = \begin{bmatrix} \mathbf{0} & \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathbf{0} & \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathbf{0} & \mathbf{K}_{32} & \mathbf{0} & \mathbf{K}_{34} \\ \mathbf{0} & \mathbf{K}_{42} & \mathbf{0} & \mathbf{K}_{44} \end{bmatrix}, \qquad \mathbf{K}_{ij} = \mathbf{U}_i^\top \boldsymbol{\Omega}\, \mathbf{V}_j
U⊤Ω V=[000000000K320K340K420K44]Kij=Ui⊤Ω Vj\begin{gathered} \mathbf{U}^\top \boldsymbol{\Omega}\, \mathbf{V} = \begin{bmatrix} \mathbf{0} & \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathbf{0} & \mathbf{0} & \mathbf{0} & \mathbf{0} \\ \mathbf{0} & \mathbf{K}_{32} & \mathbf{0} & \mathbf{K}_{34} \\ \mathbf{0} & \mathbf{K}_{42} & \mathbf{0} & \mathbf{K}_{44} \end{bmatrix} \\[3pt] \mathbf{K}_{ij} = \mathbf{U}_i^\top \boldsymbol{\Omega}\, \mathbf{V}_j \end{gathered}

The four matrices K32\mathbf{K}_{32}, K34\mathbf{K}_{34}, K42\mathbf{K}_{42} and K44\mathbf{K}_{44} can take any values we want. Indeed, gather them into one matrix K\mathbf{K}, and write U~=[ U3  U4 ]\tilde{\mathbf{U}} = [\, \mathbf{U}_3 \ \ \mathbf{U}_4 \,] and V~=[ V2  V4 ]\tilde{\mathbf{V}} = [\, \mathbf{V}_2 \ \ \mathbf{V}_4 \,]: we need U~⊤Ω V~=K\tilde{\mathbf{U}}^\top \boldsymbol{\Omega}\, \tilde{\mathbf{V}} = \mathbf{K}. Since the columns of U~\tilde{\mathbf{U}} are independent, U~⊤U~\tilde{\mathbf{U}}^\top \tilde{\mathbf{U}} has an inverse, and likewise for V~\tilde{\mathbf{V}}. The following choice works, as one checks by multiplying it by U~⊤\tilde{\mathbf{U}}^\top on the left and by V~\tilde{\mathbf{V}} on the right:

Ω=U~(U~⊤U~)−1K(V~⊤V~)−1V~⊤\boldsymbol{\Omega} = \tilde{\mathbf{U}} \left( \tilde{\mathbf{U}}^\top \tilde{\mathbf{U}} \right)^{-1} \mathbf{K} \left( \tilde{\mathbf{V}}^\top \tilde{\mathbf{V}} \right)^{-1} \tilde{\mathbf{V}}^\top

So (E), in these coordinates, is the matrix of Ψ\boldsymbol{\Psi} cut into the same four pieces, with freely chosen matrices added in seven places:

[Ψ11Ψ12Ψ13Ψ14Ψ12⊤Ψ22Ψ23+K32⊤Ψ24+K42⊤Ψ13⊤Ψ23⊤+K32Ψ33Ψ34+K34Ψ14⊤Ψ24⊤+K42Ψ34⊤+K34⊤Ψ44+K44+K44⊤]≺0\begin{bmatrix} \boldsymbol{\Psi}_{11} & \boldsymbol{\Psi}_{12} & \boldsymbol{\Psi}_{13} & \boldsymbol{\Psi}_{14} \\ \boldsymbol{\Psi}_{12}^\top & \boldsymbol{\Psi}_{22} & \boldsymbol{\Psi}_{23} + \mathbf{K}_{32}^\top & \boldsymbol{\Psi}_{24} + \mathbf{K}_{42}^\top \\ \boldsymbol{\Psi}_{13}^\top & \boldsymbol{\Psi}_{23}^\top + \mathbf{K}_{32} & \boldsymbol{\Psi}_{33} & \boldsymbol{\Psi}_{34} + \mathbf{K}_{34} \\ \boldsymbol{\Psi}_{14}^\top & \boldsymbol{\Psi}_{24}^\top + \mathbf{K}_{42} & \boldsymbol{\Psi}_{34}^\top + \mathbf{K}_{34}^\top & \boldsymbol{\Psi}_{44} + \mathbf{K}_{44} + \mathbf{K}_{44}^\top \end{bmatrix} \prec 0

The first row and the first column carry no free matrix: the piece that neither U\mathbf{U} nor V\mathbf{V} sees is out of reach. The two conditions of the lemma, written in these coordinates, say that Ψ\boldsymbol{\Psi} is negative definite on the pieces (1,2)(1, 2), which U\mathbf{U} sends to zero, and on the pieces (1,3)(1, 3), which V\mathbf{V} sends to zero. In particular Ψ11≺0\boldsymbol{\Psi}_{11} \prec 0. Make three choices, as in the plane: cancel what can be cancelled.

K42=−Ψ24⊤,K34=−Ψ34,K32=Ψ13⊤Ψ11−1Ψ12−Ψ23⊤\mathbf{K}_{42} = -\boldsymbol{\Psi}_{24}^\top, \qquad \mathbf{K}_{34} = -\boldsymbol{\Psi}_{34}, \qquad \mathbf{K}_{32} = \boldsymbol{\Psi}_{13}^\top \boldsymbol{\Psi}_{11}^{-1} \boldsymbol{\Psi}_{12} - \boldsymbol{\Psi}_{23}^\top
K42=−Ψ24⊤,K34=−Ψ34K32=Ψ13⊤Ψ11−1Ψ12−Ψ23⊤\begin{gathered} \mathbf{K}_{42} = -\boldsymbol{\Psi}_{24}^\top, \qquad \mathbf{K}_{34} = -\boldsymbol{\Psi}_{34} \\[3pt] \mathbf{K}_{32} = \boldsymbol{\Psi}_{13}^\top \boldsymbol{\Psi}_{11}^{-1} \boldsymbol{\Psi}_{12} - \boldsymbol{\Psi}_{23}^\top \end{gathered}

The matrix becomes:

[Ψ11Ψ12Ψ13Ψ14Ψ12⊤Ψ22Ψ12⊤Ψ11−1Ψ130Ψ13⊤Ψ13⊤Ψ11−1Ψ12Ψ330Ψ14⊤00Ψ44+K44+K44⊤]\begin{bmatrix} \boldsymbol{\Psi}_{11} & \boldsymbol{\Psi}_{12} & \boldsymbol{\Psi}_{13} & \boldsymbol{\Psi}_{14} \\ \boldsymbol{\Psi}_{12}^\top & \boldsymbol{\Psi}_{22} & \boldsymbol{\Psi}_{12}^\top \boldsymbol{\Psi}_{11}^{-1} \boldsymbol{\Psi}_{13} & \mathbf{0} \\ \boldsymbol{\Psi}_{13}^\top & \boldsymbol{\Psi}_{13}^\top \boldsymbol{\Psi}_{11}^{-1} \boldsymbol{\Psi}_{12} & \boldsymbol{\Psi}_{33} & \mathbf{0} \\ \boldsymbol{\Psi}_{14}^\top & \mathbf{0} & \mathbf{0} & \boldsymbol{\Psi}_{44} + \mathbf{K}_{44} + \mathbf{K}_{44}^\top \end{bmatrix}

Look at its first three pieces, and call N\mathbf{N} that block. Apply Tool 1 to it with Ψ11≺0\boldsymbol{\Psi}_{11} \prec 0 in the role of the negative block (Tool 1 was written with that block in the lower-right corner; changing the order of the pieces puts any diagonal block there). N≺0\mathbf{N} \prec 0 exactly when the matrix below is negative definite, and the choice of K32\mathbf{K}_{32} has emptied its off-diagonal blocks:

[Ψ22−Ψ12⊤Ψ11−1Ψ1200Ψ33−Ψ13⊤Ψ11−1Ψ13]\begin{bmatrix} \boldsymbol{\Psi}_{22} - \boldsymbol{\Psi}_{12}^\top \boldsymbol{\Psi}_{11}^{-1} \boldsymbol{\Psi}_{12} & \mathbf{0} \\ \mathbf{0} & \boldsymbol{\Psi}_{33} - \boldsymbol{\Psi}_{13}^\top \boldsymbol{\Psi}_{11}^{-1} \boldsymbol{\Psi}_{13} \end{bmatrix}

Its two diagonal blocks are negative definite: by Tool 1 again, the first one says that Ψ\boldsymbol{\Psi} is negative definite on the pieces (1,2)(1, 2), and the second one on the pieces (1,3)(1, 3). These are the two conditions of the lemma. So N≺0\mathbf{N} \prec 0.

The last piece remains. Call Z\mathbf{Z} the column made of Ψ14\boldsymbol{\Psi}_{14} above two zero blocks: the whole matrix has N\mathbf{N} and Z\mathbf{Z} on its first row of blocks, Z⊤\mathbf{Z}^\top and Ψ44+K44+K44⊤\boldsymbol{\Psi}_{44} + \mathbf{K}_{44} + \mathbf{K}_{44}^\top on the second. By Tool 1 with N≺0\mathbf{N} \prec 0, it is negative definite exactly when Ψ44+K44+K44⊤−Z⊤N−1Z≺0\boldsymbol{\Psi}_{44} + \mathbf{K}_{44} + \mathbf{K}_{44}^\top - \mathbf{Z}^\top \mathbf{N}^{-1} \mathbf{Z} \prec 0. Choose:

K44=12(Z⊤N−1Z−Ψ44−I)\mathbf{K}_{44} = \frac{1}{2} \left( \mathbf{Z}^\top \mathbf{N}^{-1} \mathbf{Z} - \boldsymbol{\Psi}_{44} - \mathbf{I} \right)

This matrix is symmetric, so K44+K44⊤\mathbf{K}_{44} + \mathbf{K}_{44}^\top is twice it, and the expression above is equal to −I-\mathbf{I}, which is negative definite. With these four choices (E) holds, and the formula given above turns them into a matrix Ω\boldsymbol{\Omega}: the lemma is proved. If one of the four families of directions is empty, its blocks are simply absent, and the same argument applies.

The second condition, on the plant alone. Apply the lemma to (E), starting with V\mathbf{V}. A vector on which (B) acts has three blocks, a=(xcl,ν,σ)\mathbf{a} = (\mathbf{x}_{\mathrm{cl}}, \boldsymbol{\nu}, \boldsymbol{\sigma}): the state, the inputs, and a third block σ\boldsymbol{\sigma} of the size of the outputs, the one that Tool 1 added in Step 3. And Va=CΩ xcl+EΩ ν\mathbf{V} \mathbf{a} = \mathbf{C}_\Omega\, \mathbf{x}_{\mathrm{cl}} + \mathbf{E}_\Omega\, \boldsymbol{\nu} is what the controller reads (Step 1). So Va=0\mathbf{V} \mathbf{a} = \mathbf{0} means xK=0\mathbf{x}_K = \mathbf{0}, e=Ce ξ+r=0e = \mathcal{C}_e\, \boldsymbol{\xi} + r = 0 and wθ=0w_\theta = 0: the controller reads nothing.

On these vectors, undo Tool 1. Its proof never used that the first block ranges over the whole space: for a fixed q=(xcl,ν)\mathbf{q} = (\mathbf{x}_{\mathrm{cl}}, \boldsymbol{\nu}), the largest value of a⊤Ψ a\mathbf{a}^\top \boldsymbol{\Psi}\, \mathbf{a} over σ\boldsymbol{\sigma} is q⊤Φ0 q\mathbf{q}^\top \boldsymbol{\Phi}_0\, \mathbf{q}, where Φ0\boldsymbol{\Phi}_0 is the matrix Φ\boldsymbol{\Phi} of Step 3 written for Ω=0\boldsymbol{\Omega} = \mathbf{0}. The second condition is therefore: q⊤Φ0 q<0\mathbf{q}^\top \boldsymbol{\Phi}_0\, \mathbf{q} < 0 for every non-zero q\mathbf{q} such that the controller reads nothing. By Step 3, q⊤Φ0 q\mathbf{q}^\top \boldsymbol{\Phi}_0\, \mathbf{q} is the left-hand side of (D) for the loop without controller. Compute it. With xK=0\mathbf{x}_K = \mathbf{0} and wθ=0w_\theta = 0, the matrices of Step 1 give:

xcl=[ξ0],ν=[0wρr]⟹A0 xcl+B0 ν=[A ξ+Bρ wρ+Br r0]C0 xcl+D0 ν=[0Cρ ξCw ξ+Dwr r]\begin{aligned} \mathbf{x}_{\mathrm{cl}} = \begin{bmatrix} \boldsymbol{\xi} \\ \mathbf{0} \end{bmatrix}, \quad \boldsymbol{\nu} = \begin{bmatrix} \mathbf{0} \\ w_\rho \\ r \end{bmatrix} \quad \Longrightarrow \quad \mathbf{A}_0\, \mathbf{x}_{\mathrm{cl}} + \mathbf{B}_0\, \boldsymbol{\nu} &= \begin{bmatrix} \mathcal{A}\, \boldsymbol{\xi} + \mathcal{B}_\rho\, w_\rho + \mathcal{B}_r\, r \\ \mathbf{0} \end{bmatrix} \\ \mathbf{C}_0\, \mathbf{x}_{\mathrm{cl}} + \mathbf{D}_0\, \boldsymbol{\nu} &= \begin{bmatrix} \mathbf{0} \\ \mathcal{C}_\rho\, \boldsymbol{\xi} \\ \mathcal{C}_w\, \boldsymbol{\xi} + \mathcal{D}_{wr}\, r \end{bmatrix} \end{aligned}
xcl=[ξ0],ν=[0wρr]A0 xcl+B0 ν=[A ξ+Bρ wρ+Br r0]C0 xcl+D0 ν=[0Cρ ξCw ξ+Dwr r]\begin{gathered} \mathbf{x}_{\mathrm{cl}} = \begin{bmatrix} \boldsymbol{\xi} \\ \mathbf{0} \end{bmatrix}, \quad \boldsymbol{\nu} = \begin{bmatrix} \mathbf{0} \\ w_\rho \\ r \end{bmatrix} \\[3pt] \mathbf{A}_0\, \mathbf{x}_{\mathrm{cl}} + \mathbf{B}_0\, \boldsymbol{\nu} = \begin{bmatrix} \mathcal{A}\, \boldsymbol{\xi} + \mathcal{B}_\rho\, w_\rho + \mathcal{B}_r\, r \\ \mathbf{0} \end{bmatrix} \\[3pt] \mathbf{C}_0\, \mathbf{x}_{\mathrm{cl}} + \mathbf{D}_0\, \boldsymbol{\nu} = \begin{bmatrix} \mathbf{0} \\ \mathcal{C}_\rho\, \boldsymbol{\xi} \\ \mathcal{C}_w\, \boldsymbol{\xi} + \mathcal{D}_{wr}\, r \end{bmatrix} \end{gathered}

The state and its derivative both have a zero lower half. In dV/dt=2 xcl⊤X x˙cl\mathrm{d}V/\mathrm{d}t = 2\, \mathbf{x}_{\mathrm{cl}}^\top \mathbf{X}\, \dot{\mathbf{x}}_{\mathrm{cl}}, only the upper-left block of X\mathbf{X} takes part: call it S\mathbf{S}, it weighs the plant state. Likewise the parameter channel is reduced to the plant channel, zΔ=(0,zρ)\mathbf{z}_\Delta = (\mathbf{0}, z_\rho) and wΔ=(0,wρ)\mathbf{w}_\Delta = (\mathbf{0}, w_\rho), so only the last diagonal entry of L\mathbf{L} takes part: call it L3L_3. The second condition of the lemma is: for every non-zero (ξ,wρ,r)(\boldsymbol{\xi}, w_\rho, r) such that Ce ξ+r=0\mathcal{C}_e\, \boldsymbol{\xi} + r = 0,

2 ξ⊤S(A ξ+Bρ wρ+Br r)+1γ(L3 zρ2+w⊤w)−γ(L3 wρ2+r2)<0zρ=Cρ ξ,w=Cw ξ+Dwr r(i)\begin{gathered} 2\, \boldsymbol{\xi}^\top \mathbf{S} \left( \mathcal{A}\, \boldsymbol{\xi} + \mathcal{B}_\rho\, w_\rho + \mathcal{B}_r\, r \right) + \frac{1}{\gamma} \left( L_3\, z_\rho^2 + \mathbf{w}^\top \mathbf{w} \right) - \gamma \left( L_3\, w_\rho^2 + r^2 \right) < 0 \\ z_\rho = \mathcal{C}_\rho\, \boldsymbol{\xi}, \qquad \mathbf{w} = \mathcal{C}_w\, \boldsymbol{\xi} + \mathcal{D}_{wr}\, r \end{gathered} \tag{i}
2 ξ⊤S(A ξ+Bρ wρ+Br r)+1γ(L3 zρ2+w⊤w)−γ(L3 wρ2+r2)<0zρ=Cρ ξw=Cw ξ+Dwr r(i)\begin{gathered} 2\, \boldsymbol{\xi}^\top \mathbf{S} \left( \mathcal{A}\, \boldsymbol{\xi} + \mathcal{B}_\rho\, w_\rho + \mathcal{B}_r\, r \right) \\ {} + \frac{1}{\gamma} \left( L_3\, z_\rho^2 + \mathbf{w}^\top \mathbf{w} \right) \\ {} - \gamma \left( L_3\, w_\rho^2 + r^2 \right) < 0 \\[3pt] z_\rho = \mathcal{C}_\rho\, \boldsymbol{\xi} \\ \mathbf{w} = \mathcal{C}_w\, \boldsymbol{\xi} + \mathcal{D}_{wr}\, r \end{gathered} \tag{i}

(i) is the energy balance (D) of the plant alone, without control, with the stored energy ξ⊤S ξ\boldsymbol{\xi}^\top \mathbf{S}\, \boldsymbol{\xi}, on the trajectories that the controller does not see.

The first condition, after a change of variables. U\mathbf{U} contains the unknowns X\mathbf{X} and Λη\boldsymbol{\Lambda}_\eta, so one more step is needed. Multiply (E) on both sides by the symmetric invertible matrix Π=diag⁡(X−1,Λν−1,Λη−1)\boldsymbol{\Pi} = \operatorname{diag}(\mathbf{X}^{-1}, \boldsymbol{\Lambda}_\nu^{-1}, \boldsymbol{\Lambda}_\eta^{-1}). A matrix stays negative definite under such a multiplication, because b⊤Π M Π b\mathbf{b}^\top \boldsymbol{\Pi}\, \mathbf{M}\, \boldsymbol{\Pi}\, \mathbf{b} is the quadratic form of M\mathbf{M} at the vector Π b\boldsymbol{\Pi}\, \mathbf{b}, which runs over all non-zero vectors when b\mathbf{b} does. The term in Ω\boldsymbol{\Omega} keeps its shape, with UΠ\mathbf{U} \boldsymbol{\Pi} and VΠ\mathbf{V} \boldsymbol{\Pi} in place of U\mathbf{U} and V\mathbf{V}, and:

UΠ=[BΩ⊤XX−10DΩ⊤ΛηΛη−1]=[BΩ⊤0DΩ⊤]\begin{aligned} \mathbf{U} \boldsymbol{\Pi} &= \begin{bmatrix} \mathbf{B}_\Omega^\top \mathbf{X} \mathbf{X}^{-1} & \mathbf{0} & \mathbf{D}_\Omega^\top \boldsymbol{\Lambda}_\eta \boldsymbol{\Lambda}_\eta^{-1} \end{bmatrix} \\ &= \begin{bmatrix} \mathbf{B}_\Omega^\top & \mathbf{0} & \mathbf{D}_\Omega^\top \end{bmatrix} \end{aligned}

It is free of unknowns. The lemma, applied to the multiplied inequality, gives the condition: b⊤Π Ψ Π b<0\mathbf{b}^\top \boldsymbol{\Pi}\, \boldsymbol{\Psi}\, \boldsymbol{\Pi}\, \mathbf{b} < 0 for every non-zero b\mathbf{b} such that UΠ b=0\mathbf{U} \boldsymbol{\Pi}\, \mathbf{b} = \mathbf{0}. Write b=(pcl,sν,sη)\mathbf{b} = (\mathbf{p}_{\mathrm{cl}}, \mathbf{s}_\nu, \mathbf{s}_\eta), with pcl=(p,pK)\mathbf{p}_{\mathrm{cl}} = (\mathbf{p}, \mathbf{p}_K) cut like the state and sη=(sθ,sρ,sw)\mathbf{s}_\eta = (\mathbf{s}_\theta, s_\rho, \mathbf{s}_w) cut like the outputs. With the matrices of Step 1:

UΠ b=BΩ⊤pcl+DΩ⊤sη=[pKBu⊤p+Dwu⊤swsθ]\mathbf{U} \boldsymbol{\Pi}\, \mathbf{b} = \mathbf{B}_\Omega^\top \mathbf{p}_{\mathrm{cl}} + \mathbf{D}_\Omega^\top \mathbf{s}_\eta = \begin{bmatrix} \mathbf{p}_K \\ \mathcal{B}_u^\top \mathbf{p} + \mathcal{D}_{wu}^\top \mathbf{s}_w \\ \mathbf{s}_\theta \end{bmatrix}
UΠ b=BΩ⊤pcl+DΩ⊤sη=[pKBu⊤p+Dwu⊤swsθ]\begin{aligned} \mathbf{U} \boldsymbol{\Pi}\, \mathbf{b} &= \mathbf{B}_\Omega^\top \mathbf{p}_{\mathrm{cl}} + \mathbf{D}_\Omega^\top \mathbf{s}_\eta \\ &= \begin{bmatrix} \mathbf{p}_K \\ \mathcal{B}_u^\top \mathbf{p} + \mathcal{D}_{wu}^\top \mathbf{s}_w \\ \mathbf{s}_\theta \end{bmatrix} \end{aligned}

So UΠ b=0\mathbf{U} \boldsymbol{\Pi}\, \mathbf{b} = \mathbf{0} means pK=0\mathbf{p}_K = \mathbf{0}, sθ=0\mathbf{s}_\theta = \mathbf{0} and Bu⊤p+Dwu⊤sw=0\mathcal{B}_u^\top \mathbf{p} + \mathcal{D}_{wu}^\top \mathbf{s}_w = 0: these are the directions on which the control uu has no effect. The multiplied matrix is computed block by block, each product of a matrix by its inverse reducing to the identity:

Π Ψ Π=[A0X−1+X−1A0⊤B0Λν−1X−1C0⊤Λν−1B0⊤−γ Λν−1Λν−1D0⊤C0X−1D0Λν−1−γ Λη−1]\boldsymbol{\Pi}\, \boldsymbol{\Psi}\, \boldsymbol{\Pi} = \begin{bmatrix} \mathbf{A}_0 \mathbf{X}^{-1} + \mathbf{X}^{-1} \mathbf{A}_0^\top & \mathbf{B}_0 \boldsymbol{\Lambda}_\nu^{-1} & \mathbf{X}^{-1} \mathbf{C}_0^\top \\[3pt] \boldsymbol{\Lambda}_\nu^{-1} \mathbf{B}_0^\top & -\gamma\, \boldsymbol{\Lambda}_\nu^{-1} & \boldsymbol{\Lambda}_\nu^{-1} \mathbf{D}_0^\top \\[3pt] \mathbf{C}_0 \mathbf{X}^{-1} & \mathbf{D}_0 \boldsymbol{\Lambda}_\nu^{-1} & -\gamma\, \boldsymbol{\Lambda}_\eta^{-1} \end{bmatrix}

It has the shape of Ψ\boldsymbol{\Psi}, with the roles of the inputs and of the outputs exchanged and every matrix of the plant transposed. This time the middle block sν\mathbf{s}_\nu is free, and Tool 1 removes it as it removed σ\boldsymbol{\sigma} above: for fixed pcl\mathbf{p}_{\mathrm{cl}} and sη\mathbf{s}_\eta, the largest value over sν\mathbf{s}_\nu replaces the blocks that involve sν\mathbf{s}_\nu by 1γ t⊤Λν−1 t\frac{1}{\gamma}\, \mathbf{t}^\top \boldsymbol{\Lambda}_\nu^{-1}\, \mathbf{t}, with t=B0⊤pcl+D0⊤sη\mathbf{t} = \mathbf{B}_0^\top \mathbf{p}_{\mathrm{cl}} + \mathbf{D}_0^\top \mathbf{s}_\eta. With pK=0\mathbf{p}_K = \mathbf{0} and sθ=0\mathbf{s}_\theta = \mathbf{0}, the matrices of Step 1 give:

A0⊤pcl=[A⊤p0],C0⊤sη=[Cρ⊤sρ+Cw⊤sw0]t=[0Bρ⊤pBr⊤p+Dwr⊤sw]\begin{aligned} \mathbf{A}_0^\top \mathbf{p}_{\mathrm{cl}} &= \begin{bmatrix} \mathcal{A}^\top \mathbf{p} \\ \mathbf{0} \end{bmatrix}, \qquad \mathbf{C}_0^\top \mathbf{s}_\eta = \begin{bmatrix} \mathcal{C}_\rho^\top s_\rho + \mathcal{C}_w^\top \mathbf{s}_w \\ \mathbf{0} \end{bmatrix} \\[3pt] \mathbf{t} &= \begin{bmatrix} \mathbf{0} \\ \mathcal{B}_\rho^\top \mathbf{p} \\ \mathcal{B}_r^\top \mathbf{p} + \mathcal{D}_{wr}^\top \mathbf{s}_w \end{bmatrix} \end{aligned}
A0⊤pcl=[A⊤p0]C0⊤sη=[Cρ⊤sρ+Cw⊤sw0]t=[0Bρ⊤pBr⊤p+Dwr⊤sw]\begin{gathered} \mathbf{A}_0^\top \mathbf{p}_{\mathrm{cl}} = \begin{bmatrix} \mathcal{A}^\top \mathbf{p} \\ \mathbf{0} \end{bmatrix} \\[3pt] \mathbf{C}_0^\top \mathbf{s}_\eta = \begin{bmatrix} \mathcal{C}_\rho^\top s_\rho + \mathcal{C}_w^\top \mathbf{s}_w \\ \mathbf{0} \end{bmatrix} \\[3pt] \mathbf{t} = \begin{bmatrix} \mathbf{0} \\ \mathcal{B}_\rho^\top \mathbf{p} \\ \mathcal{B}_r^\top \mathbf{p} + \mathcal{D}_{wr}^\top \mathbf{s}_w \end{bmatrix} \end{gathered}

As before, only one block of each unknown is left: the upper-left block of X−1\mathbf{X}^{-1}, which we call R\mathbf{R}, and the last diagonal entry of L−1\mathbf{L}^{-1}, which we call J3J_3. The first condition of the lemma is: for every non-zero (p,sρ,sw)(\mathbf{p}, s_\rho, \mathbf{s}_w) such that Bu⊤p+Dwu⊤sw=0\mathcal{B}_u^\top \mathbf{p} + \mathcal{D}_{wu}^\top \mathbf{s}_w = 0,

2 p⊤R(A⊤p+Cρ⊤sρ+Cw⊤sw)+1γ(J3(Bρ⊤p)2+(Br⊤p+Dwr⊤sw)2)−γ(J3 sρ2+sw⊤sw)<0(ii)\begin{aligned} & 2\, \mathbf{p}^\top \mathbf{R} \left( \mathcal{A}^\top \mathbf{p} + \mathcal{C}_\rho^\top s_\rho + \mathcal{C}_w^\top \mathbf{s}_w \right) \\ & \quad + \frac{1}{\gamma} \left( J_3 \left( \mathcal{B}_\rho^\top \mathbf{p} \right)^2 + \left( \mathcal{B}_r^\top \mathbf{p} + \mathcal{D}_{wr}^\top \mathbf{s}_w \right)^2 \right) - \gamma \left( J_3\, s_\rho^2 + \mathbf{s}_w^\top \mathbf{s}_w \right) < 0 \end{aligned} \tag{ii}
2 p⊤R(A⊤p+Cρ⊤sρ+Cw⊤sw)+1γ J3(Bρ⊤p)2+1γ(Br⊤p+Dwr⊤sw)2−γ(J3 sρ2+sw⊤sw)<0(ii)\begin{aligned} & 2\, \mathbf{p}^\top \mathbf{R} \left( \mathcal{A}^\top \mathbf{p} + \mathcal{C}_\rho^\top s_\rho + \mathcal{C}_w^\top \mathbf{s}_w \right) \\ & \quad + \frac{1}{\gamma}\, J_3 \left( \mathcal{B}_\rho^\top \mathbf{p} \right)^2 \\ & \quad + \frac{1}{\gamma} \left( \mathcal{B}_r^\top \mathbf{p} + \mathcal{D}_{wr}^\top \mathbf{s}_w \right)^2 \\ & \quad - \gamma \left( J_3\, s_\rho^2 + \mathbf{s}_w^\top \mathbf{s}_w \right) < 0 \end{aligned} \tag{ii}

(ii) is the same balance as (i), for the plant with transposed matrices and on the directions in which the control cannot act. Written with matrices, (i) and (ii) can be restricted to these subspaces using matrices NS\mathcal{N}_S and NR\mathcal{N}_R whose columns span the two sets of vectors.

5.6Step 5: the linear matrix inequalities, and why they are convex

The controller has disappeared, and with it most of X\mathbf{X} and of L\mathbf{L}: (i) and (ii) only involve S\mathbf{S} and L3L_3, taken from X\mathbf{X} and L\mathbf{L}, and R\mathbf{R} and J3J_3, taken from their inverses. One question remains. Can any two matrices S\mathbf{S} and R\mathbf{R} be the corners of a positive definite matrix and of its inverse? No, and the exact condition is simple.

Proof, from the controller to the conditions. Suppose that a controller, X≻0\mathbf{X} \succ 0 and L≻0\mathbf{L} \succ 0 satisfy (B), which is (E). By Tool 2, the two conditions of the lemma hold, and Step 4 has written them as (i) and (ii), with S\mathbf{S} and L3L_3 read in X\mathbf{X} and L\mathbf{L}, and R\mathbf{R} and J3J_3 read in their inverses. Tool 3 gives the first of the two conditions above. The same tool, applied to L\mathbf{L} and its inverse, whose lower-right corners are the numbers L3L_3 and J3J_3, gives the second one.

Proof, from the conditions to the controller. Suppose that R\mathbf{R}, S\mathbf{S}, L3L_3 and J3J_3 satisfy the four conditions. First, R\mathbf{R} and S\mathbf{S} are positive definite. Indeed the quadratic form of the first block matrix at a pair (a,b)(\mathbf{a}, \mathbf{b}) is a⊤R a+2 a⊤b+b⊤S b\mathbf{a}^\top \mathbf{R}\, \mathbf{a} + 2\, \mathbf{a}^\top \mathbf{b} + \mathbf{b}^\top \mathbf{S}\, \mathbf{b}, and it is never negative. Taking b=0\mathbf{b} = \mathbf{0} shows R⪰0\mathbf{R} \succeq 0. If R a=0\mathbf{R}\, \mathbf{a} = \mathbf{0} for some a≠0\mathbf{a} \neq \mathbf{0}, the pair (a,−t a)(\mathbf{a}, -t\, \mathbf{a}) would give −2 t ∥a∥22+t2 a⊤S a-2\, t\, \|\mathbf{a}\|_2^2 + t^2\, \mathbf{a}^\top \mathbf{S}\, \mathbf{a}, which is negative for a small t>0t > 0: impossible. So no eigenvalue of R\mathbf{R} is zero, and R≻0\mathbf{R} \succ 0. The same argument applies to S\mathbf{S}, and to the numbers L3L_3 and J3J_3, which are positive.

Tool 3 then builds a matrix X≻0\mathbf{X} \succ 0 whose corner is S\mathbf{S} and whose inverse has the corner R\mathbf{R}, and a matrix L≻0\mathbf{L} \succ 0 whose corner is L3L_3 and whose inverse has the corner J3J_3. For L\mathbf{L}, the block that the tool adds is the part of the scaling that weighs the parameter channel of the controller. The controller of this page has a single such channel, like the mass: this block is one number, and L\mathbf{L} is twice as large as its corner, as in Tool 3. With these X\mathbf{X} and L\mathbf{L}, (i) and (ii) are exactly the two conditions of Tool 2, since Step 4 has shown that these conditions only involve the four corners. So some Ω\boldsymbol{\Omega} satisfies (E), which is (B): the controller exists.

Why these conditions are convex. Count what is left: the unknowns are R\mathbf{R}, S\mathbf{S}, L3L_3 and J3J_3. Two symmetric matrices of size nn hold n (n+1)n\, (n + 1) numbers; with n=4n = 4 states for the generalized plant, that is 22 unknown numbers in all. For a fixed γ\gamma, each of them appears to the first power in every condition. Take two sets of values that satisfy the conditions and mix them, with weights 1−t1 - t and tt between 00 and 11. The left-hand side of (i), for a given (ξ,wρ,r)(\boldsymbol{\xi}, w_\rho, r), is then the same mixture of the two left-hand sides:

g1<0,g2<0⟹(1−t) g1+t g2<0g_1 < 0, \quad g_2 < 0 \quad \Longrightarrow \quad (1 - t)\, g_1 + t\, g_2 < 0
g1<0,g2<0⟹(1−t) g1+t g2<0\begin{gathered} g_1 < 0, \quad g_2 < 0 \\ \Longrightarrow \quad (1 - t)\, g_1 + t\, g_2 < 0 \end{gathered}

where g1g_1 and g2g_2 are the values of the left-hand side for the two sets. A mixture of two negative numbers is negative, so (i) holds for the mixture. The same is true of (ii), and of the last two conditions, where a mixture of two forms that are never negative is never negative. The set of solutions is therefore convex: with two of its points it contains the whole segment between them. Conditions of this kind are called Linear Matrix Inequalities (LMIs). At a fixed performance level, these inequalities form a convex feasibility problem. When a solver returns a candidate, its matrices can be substituted into the inequalities to check feasibility.

Figure 14 shows the last condition, the only one that can be drawn: with numbers, it says L3 J3≥1L_3\, J_3 \ge 1. It also shows what the method has gained. In (B), the scaling and its inverse were tied by an equality, which for numbers would read L3 J3=1L_3\, J_3 = 1: a curve, and a curve of this kind is not convex. Tool 3 has replaced the curve by the region above it.

Figure 14: The condition L3 J3≥1L_3\, J_3 \ge 1. The shaded region is convex: the segment between two of its points stays inside (in blue). The curve L3 J3=1L_3\, J_3 = 1 is not: the segment between two of its points leaves it (in copper).
Click the figure to zoom.

And γ\gamma? It multiplies L3L_3 and J3J_3 in (i) and (ii), so it is not one more unknown of the same kind. But the conditions get easier as γ\gamma grows: in (D), the terms in 1/γ1/\gamma decrease and the terms in −γ-\gamma decrease too when γ\gamma increases, so the matrices and the controller that work for one value of γ\gamma work for every larger one. The smallest γ\gamma can therefore be approached by trying values and halving the interval at each trial (Figure 15). The value found in this way is the best one of this framework.

Figure 15: Searching the smallest γ\gamma. Each trial solves the convex conditions for one value of γ\gamma: a full dot when they have a solution, an empty one when they have none. Since a solution for one value is a solution for every larger one, each trial halves the interval that contains the smallest γ\gamma.
Click the figure to zoom.

5.7Step 6: rebuilding the controller

A solution (R,S,L3,J3)(\mathbf{R}, \mathbf{S}, L_3, J_3) is not yet a controller. Two steps remain, and both are constructive: the proofs above already contain their formulas.

First, complete the matrices. The proof of Tool 3 gives X\mathbf{X} from R\mathbf{R} and S\mathbf{S}:

N=(S−R−1)1/2,X=[SNNI]\mathbf{N} = \left( \mathbf{S} - \mathbf{R}^{-1} \right)^{1/2}, \qquad \mathbf{X} = \begin{bmatrix} \mathbf{S} & \mathbf{N} \\ \mathbf{N} & \mathbf{I} \end{bmatrix}
N=(S−R−1)1/2X=[SNNI]\begin{gathered} \mathbf{N} = \left( \mathbf{S} - \mathbf{R}^{-1} \right)^{1/2} \\[3pt] \mathbf{X} = \begin{bmatrix} \mathbf{S} & \mathbf{N} \\ \mathbf{N} & \mathbf{I} \end{bmatrix} \end{gathered}

The same formula, with numbers, gives L\mathbf{L} from L3L_3 and J3J_3. This is where the order of the controller is decided: the lower-right block of X\mathbf{X} weighs the state of the controller, and it has the size of S\mathbf{S}. The controller therefore has as many states as the generalized plant, 4 here.

Then, solve for the controller. Look at (E) again with X\mathbf{X} and L\mathbf{L} now known: Ψ\boldsymbol{\Psi}, U\mathbf{U} and V\mathbf{V} are arrays of numbers, and the only unknown, Ω\boldsymbol{\Omega}, appears to the first power. (E) is an LMI in Ω\boldsymbol{\Omega}, and Tool 2 guarantees that it has a solution. Its proof even builds one, by the four choices of Step 4 and the formula that turns them into Ω\boldsymbol{\Omega}. A solver may return another solution of (E), for instance one whose entries are smaller: any of them will do. Reading Ω\boldsymbol{\Omega} block by block gives the nine constant matrices of the controller (Step 1).

5.8The controller obtained, and what its guarantee covers

Note on Controller Structure:
It is important to note that the controller structure (LPV-LFT) is not an arbitrary choice. Following the methodology of Apkarian & Gahinet [1], assigning the controller the same parameter dependence (LFT) as the plant allows the non-convex optimization problem to be transformed into a convex system of Linear Matrix Inequalities (LMIs). At a fixed γ\gamma, feasibility is convex. Bisection can approach the infimum of the levels admitted by these sufficient conditions. For the controller used here, the numerical search and the subsequent certificate establish an achievable γ\gamma. With a frozen parameter and without actuator saturation, the discrete closed loop remains stable beyond ∣ρ∣=1.17|\rho| = 1.17, down to about ρ≈−2.5\rho \approx -2.5, where the stiffness vanishes (k=0k = 0). This frozen-parameter calculation provides no guarantee for arbitrary parameter variations outside ∣ρ∣≤1/γ|\rho| \le 1/\gamma.

Where does this caution come from? From Step 2. A single matrix X\mathbf{X} and a single matrix L\mathbf{L} serve for every value of ρ(t)\rho(t) in the range and for every speed of variation. A parameter known to vary slowly, or over a smaller range, could allow a smaller γ\gamma: the method does not use that information. In exchange, it gives a controller and a guarantee by solving convex problems only.

What is inside K(ρ)K(\rho)?
As promised in Section 2, let's open the controller. Look at the bottom of Figure 4: KK is a linear time-invariant block, which never changes, looped on ρ(t)\rho(t) exactly like the plant at the top. Since ρ(t)\rho(t) is measured in real time, the controller can use its current value at every instant: this is what makes it gain-scheduled. Here it is in discrete time, as it runs in the simulation (the index θ\theta comes from [1], where the parameter block is called Θ\Theta):

xK[k+1]=AKxK[k]+BK1e[k]+BKθwθ[k]u[k]=CK1xK[k]+DK11e[k]+DK1θwθ[k]zθ[k]=CKθxK[k]+DKθ1e[k]+DKθθwθ[k]wθ[k]=ρ[k] zθ[k]\begin{aligned} \mathbf{x}_K[k+1] &= \mathbf{A}_K \mathbf{x}_K[k] + \mathbf{B}_{K1} e[k] + \mathbf{B}_{K\theta} w_\theta[k] \\ u[k] &= \mathbf{C}_{K1} \mathbf{x}_K[k] + \mathbf{D}_{K11} e[k] + \mathbf{D}_{K1\theta} w_\theta[k] \\ z_\theta[k] &= \mathbf{C}_{K\theta} \mathbf{x}_K[k] + \mathbf{D}_{K\theta 1} e[k] + \mathbf{D}_{K\theta\theta} w_\theta[k] \\ w_\theta[k] &= \rho[k]\, z_\theta[k] \end{aligned}

The matrices AK,…,DKθθ\mathbf{A}_K, \dots, \mathbf{D}_{K\theta\theta} are constant: the LMIs give them once and for all, offline, and the browser never solves anything. The controller has 4 states, as many as the generalized plant (2 for the mass, 1 for each filter). Its loop on ρ\rho has a single channel, like that of the mass, hence the block ρ(t)\rho(t) at the bottom of Figure 4. When ρ\rho changes, no matrix is recomputed: only the signal going around this loop changes, and the output uu adapts with it. One practical detail: wθw_\theta appears on both sides of its own equation, through zθz_\theta. This algebraic loop is solved at every step, before computing uu:

wθ[k]=ρ[k]1−ρ[k] DKθθ(CKθxK[k]+DKθ1e[k])w_\theta[k] = \frac{\rho[k]}{1 - \rho[k]\, \mathbf{D}_{K\theta\theta}} \left( \mathbf{C}_{K\theta} \mathbf{x}_K[k] + \mathbf{D}_{K\theta 1} e[k] \right)
wθ[k]=ρ[k]1−ρ[k] DKθθ=(CKθxK[k]+DKθ1e[k])\begin{aligned} w_\theta[k] &= \frac{\rho[k]}{1 - \rho[k]\, \mathbf{D}_{K\theta\theta}} \\ &\phantom{{}={}} \quad \left( \mathbf{C}_{K\theta} \mathbf{x}_K[k] + \mathbf{D}_{K\theta 1} e[k] \right) \end{aligned}

You may have noticed that we just switched to discrete time, while the rest of this page, proofs included, is written in continuous time. The numerical certificate applies to the unsaturated discrete model with Ts=1T_s = 1 ms. The mass uses an explicit Euler step. The synthesis discretizes the two weighting filters with a zero-order hold.

Nothing essential changes in discrete time, and [1] treats both cases. The stored energy is compared between two successive instants instead of being differentiated, and (D) becomes:

V[k+1]−V[k]+1γ zΔ⊤L zΔ−γ wΔ⊤L wΔ+1γ w⊤w−γ r2≤−ε(∥xcl∥22+∥wΔ∥22+r2)\begin{gathered} V[k+1] - V[k] + \frac{1}{\gamma}\, \mathbf{z}_\Delta^\top \mathbf{L}\, \mathbf{z}_\Delta - \gamma\, \mathbf{w}_\Delta^\top \mathbf{L}\, \mathbf{w}_\Delta \\ {} + \frac{1}{\gamma}\, \mathbf{w}^\top \mathbf{w} - \gamma\, r^2 \\ {} \le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}\|_2^2 + \|\mathbf{w}_\Delta\|_2^2 + r^2 \right) \end{gathered}

Result 1 is proved in the same way, line for line. The scaling inequality (S) holds at each instant, so the two terms of the parameter channel are dropped as before, and what is left is:

V[k+1]−V[k]+1γ w[k]⊤w[k]−γ r[k]2≤−ε(∥xcl[k]∥22+r[k]2)V[k+1] - V[k] + \frac{1}{\gamma}\, \mathbf{w}[k]^\top \mathbf{w}[k] - \gamma\, r[k]^2 \le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}[k]\|_2^2 + r[k]^2 \right)
V[k+1]−V[k]+1γ w[k]⊤w[k]−γ r[k]2≤−ε(∥xcl[k]∥22+r[k]2)\begin{aligned} & V[k+1] - V[k] \\ &\quad {} + \frac{1}{\gamma}\, \mathbf{w}[k]^\top \mathbf{w}[k] - \gamma\, r[k]^2 \\ &\quad \le -\varepsilon \left( \|\mathbf{x}_{\mathrm{cl}}[k]\|_2^2 + r[k]^2 \right) \end{aligned}

(a) Take r=0r = 0. With the largest eigenvalue λmax⁡\lambda_{\max} of X\mathbf{X}, as in continuous time, ∥xcl[k]∥22≥V[k]/λmax⁡\|\mathbf{x}_{\mathrm{cl}}[k]\|_2^2 \ge V[k] / \lambda_{\max}; and we may suppose ε≤λmax⁡\varepsilon \le \lambda_{\max}, since a smaller ε\varepsilon is always allowed:

V[k+1]≤V[k]−ε ∥xcl[k]∥22≤(1−ελmax⁡)V[k]\begin{aligned} V[k+1] &\le V[k] - \varepsilon\, \|\mathbf{x}_{\mathrm{cl}}[k]\|_2^2 \\ &\le \left( 1 - \frac{\varepsilon}{\lambda_{\max}} \right) V[k] \end{aligned}

At each step the energy is multiplied by a number that lies between 00 and 11 and is not 11: it decreases at least like a geometric sequence, and the state tends to zero. (b) Start from a zero state and add the inequalities from k=0k = 0 to k=N−1k = N - 1. The differences of VV cancel in pairs, and V[0]=0V[0] = 0:

V[N]+1γ∑k=0N−1w[k]⊤w[k]≤(γ−ε)∑k=0N−1r[k]2V[N] + \frac{1}{\gamma} \sum_{k=0}^{N-1} \mathbf{w}[k]^\top \mathbf{w}[k] \le (\gamma - \varepsilon) \sum_{k=0}^{N-1} r[k]^2
V[N]+1γ∑k=0N−1w[k]⊤w[k]≤(γ−ε)∑k=0N−1r[k]2\begin{aligned} & V[N] + \frac{1}{\gamma} \sum_{k=0}^{N-1} \mathbf{w}[k]^\top \mathbf{w}[k] \\ &\quad \le (\gamma - \varepsilon) \sum_{k=0}^{N-1} r[k]^2 \end{aligned}

V[N]V[N] is positive or zero and is dropped; the rest of the argument is the one of continuous time, with the sum of the squares of a sequence in place of the integral, and the gain from rr to w\mathbf{w} is below γ\gamma. Steps 3 to 6 keep their arguments too. One thing changes in Step 3: V[k+1]V[k+1] is the quadratic form of X\mathbf{X} at xcl[k+1]\mathbf{x}_{\mathrm{cl}}[k+1], which contains the closed-loop matrices twice. The matrix inequality gets one more block, and one more Schur complement separates the two copies before the controller is eliminated.

How the controller of this page was computed. The synthesis was run in MATLAB on the sampled model, with a single scheduling channel for the controller, as for the mass. For each scaling L\mathbf{L}, MATLAB solves the scaled H∞\mathcal{H}_\infty synthesis problem. A direct search over L\mathbf{L} from several starting points found a best level of 0.8290.829. The controller is computed 2 %2\,\% above this level, which gives better-conditioned matrices, then checked apart from its synthesis. Its scaled gain is 0.84490.8449. At γ=0.85\gamma = 0.85, a second solver, MOSEK, returns matrices X\mathbf{X} and L\mathbf{L} that satisfy the discrete-time form of (D) above, and the inequality is checked on the numbers returned. In balanced coordinates, the margin at 0.850.85 is about 3.9×10−103.9 \times 10^{-10}. The resulting parameter bound is ∣ρ∣≤1/γ|\rho| \le 1/\gamma, with 1/γ≈1.176471/\gamma \approx 1.17647. The figures use 1.171.17 as a conservative limit. Figure 10 uses these X\mathbf{X} and L\mathbf{L}.

By minimizing γ\gamma in the synthesis step, we are essentially 'squashing' this worst-case gain ratio for all parameter trajectories ρ(t)\rho(t) that stay in the range ∣ρ∣≤1/γ|\rho| \le 1/\gamma.

References

  1. [1]

    P. Apkarian and P. Gahinet, “A convex characterization of gain-scheduled H∞\mathcal{H}_\infty controllers,” IEEE Transactions on Automatic Control, vol. 40, no. 5, pp. 853–864, May 1995. doi (opens in a new tab)

  2. [2]

    P. Gahinet and P. Apkarian, “A linear matrix inequality approach to H∞\mathcal{H}_\infty control,” International Journal of Robust and Nonlinear Control, vol. 4, no. 4, pp. 421–448, 1994. doi (opens in a new tab)

An opportunity, a research collaboration, or a project to develop? Tell me about the context and what you would like to discuss.

get in touch