\section{Introduction}
The introduction of advanced sensing and communication capabilities to control systems gives rise to vulnerabilities that can be exploited with a malicious intent by an attacker (\cite{SCADA}). While the security challenges that control systems face are multifaceted and of diverse nature, the simplicity of implementation of Denial of Service (DoS) attacks in field zones and control zones makes them particularly suitable to exploit software and hardware faults. In this paper we study DoS attacks over control systems that experience packet losses over an actuator communication channel.

To account for packet loss, we consider the two protocols proposed in \cite{1}. The first one in which the packet loss is not monitored, termed UDP-like for its similarity to the communication protocol. The second protocol is termed as TCP-like and monitors the packet loss realisation by sending a packet receipt acknowledgement message back to the receiver. Both protocols and the systems they constitute are depicted in Fig. \ref{fig1} and Fig. \ref{fig2}.
In the literature these are termed {\it like} due to previous transmissions being monitored and not retransmitted~(\cite{1}),~(\cite{4}),~(\cite{7}),~(\cite{8}). In \cite{paper1} the authors consider a deterministic DoS attack strategy on a system with power constraints whereas we consider a random DoS attack construction that operates within a no-detection region using an MPC formulation. We first study attack sequences that are constructed as an independent and identically distributed (IID) process. The rationale for this attack construction stems from the simplicity of the attack implementation and the robust attack performance for a wide range of system parameters. We then propose a non-stationary random attack construction and show that for some systems their dynamics can be exploited by the attacker to improve upon the IID construction.

\section{Plant Model}

We consider the plant model given by
\vspace{-3mm}
\begin{eqnarray}\label{eq1}
X_{k+1}&=&{{{\bf A}}} X_k + {{\bf B}}{{\bf V}_k}U_k +W_k,
\end{eqnarray}
where ${{{\bf A}}}\in \mathds{R}^{n\times n}$ is the dynamics matrix, $X_k \in \mathds{R}^n$ describes the state of the plant at time step $k\in\mathds{N}$,
${{\bf B}} \in \mathds{R}^{n \times m}$ is the
control
matrix, ${U}_k\in \mathds{R}^m$ is the vector of control inputs at the $k$-th time step, $W_k \in \mathds{R}^n$ is the process noise modelled by a Gaussian distributed vector of random variables with mean ${\bf 0} \in \mathds{R}^n$ and covariance matrix
${ \Sigma_{W}} \in S^n_{++}$ where, $S^n_{++}$ is the set of $n\times n$ symmetric positive definite matrices,
and ${\bf V}_k \in S^{m}_{+}$ is the packet loss variable where the $i$-th diagonal entry is an IID Bernoulli random variable with mean $\mu_i$. We assume that the current state of the plant is determined by the vector of Gaussian distributed random variables $X_k$ with mean ${\overline{X}\in\mathds{R}^n}$ and covariance matrix ${ \Sigma_{X}} \in S^n_{++}$.

In this paper, we adopt the MPC formulation used in \cite{MPC} to describe the plant model in (\ref{eq1}) over the prediction horizon $N\in\mathds{N}_+$, resulting in the prediction model given by
\vspace{-3mm}
 \begin{eqnarray}\label{eq2}
\chi_k^{}=\Phi X_k +\Gamma {\nu }_k{\Upsilon_k} +\Lambda {\Xi_k},
\end{eqnarray}
where $\Phi \in \mathds{R}^{Nn\times n}$ is the dynamics matrix over the prediction horizon, $\chi_k^{} \in \mathds{R}^{Nn}$ is the state prediction vector, $\Gamma \in \mathds{R}^{Nn\times Nm}$  is the propagation matrix for the control law over the prediction horizon, ${\Upsilon_k} \in \mathds{R}^{mN}$ is the realisation at the $k$-th time step of the control law, $\Lambda \in \mathds{R}^{Nn\times Nn}$ is the propagation matrix for the process noise, ${\Xi_k} \in \mathds{R}^{Nn}$ is the process noise over the prediction horizon, and $\nu _k$ is a diagonal matrix with the Bernoulli random variables describing the packet losses over the prediction horizon along the diagonal. All the terms in (\ref{eq2}) are presented in (\ref{big}).
Due to the lossy communication between the controller and the plant, the operator implements a communication protocol to monitor the state of the packets transmitted to the plant. We adopt the two protocol paradigms proposed by \cite{1}, namely a UDP-like protocol that does not monitor the channel and a TCP-like protocol that acknowledges receipt of the packet from the controller by sending an {\it acknowledgement} message to the controller over an auxiliary channel. The difference between both protocol paradigms is depicted in Fig. \ref{fig1} and Fig. \ref{fig2}, which show the UDP-like and the TCP-like protocols, respectively. The information set available to the controller is determined by the choice of the protocol. We define the information sets as
\begin{equation}
{\cal I}_k=
\begin{cases}
{\cal F}_k=\left\lbrace X^k, {\bf V}^{k-1}\right\rbrace,&\mbox{TCP-like,}\\
{\cal G}_k=\left\lbrace X^k\right\rbrace,&\mbox{UDP-like},\\
\end{cases}
\end{equation}
where ${\bf V}^{k-1}=\left\lbrace {\bf V}_0, {\bf V}_1, \ldots, {\bf V}_{k-1}\right\rbrace$, $X^{k}=\left\lbrace X_0, X_1, \ldots, X_{k}\right\rbrace$ and all sets are monotonically increasing, i.e. there is a filtration such that $\mathcal{I}_{k} \subseteq \mathcal{I}_{k+1}$. It is shown in \cite{MPC} that for both protocols the optimal control law is determined by the mean of the packet loss variable $\bar{\nu }\stackrel{\Delta}{=} \mathds{E}[\nu _k]$. Following in the steps of \cite{1}, the performance of the controller is characterised by a linear quadratic Gaussian (LQG) cost function. The description of the cost function in the MPC framework proposed in \cite{MPC} is the cost function
\vspace{-5mm}
 \begin{eqnarray}\label{eq4}
\!\!\! J^*\!\!\left({\cal I}_k\right)\triangleq \min_{\Upsilon_k}\left\{\!\mathds{E}\left[X_k^{^{\sf T}} {\bf Q} X_k + \chi_k^{^ {\sf T}} \Omega \chi_k^{} + {\Upsilon_k}^{\sf T} \nu ^{^{\sf T}}_k {\Psi} \nu _k {\Upsilon_k}\big|\mathcal{I}_k\right]\!\right\}\!\!,
\end{eqnarray}
where $\Omega\in S_{++}^{Nn}$ is the state penalty diagonal matrix, ${\Psi}\in S_{++}^{Nm}$ is the input penalty diagonal matrix, and the diagonal matrix ${\bf Q} \in S_{++}^{n}$. The optimal control law for~(\ref{eq4}) is obtained in~\cite{MPC} for each protocol and shown to be
\vspace{-3mm}
\begin{eqnarray}
\label{eq:Upsilon}
\Upsilon_{k|\!\mathcal{I}_k}^*\!\!\!\!=\!\! \left\{\begin{array}{cc} \!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\! \Upsilon_{k|\mathcal{F}_k}^*\!\!=\!\!-\left(\!{\Psi} + {\Delta}^{\Gamma}\overline{\nu }\right)^{-1}{\bf F} X_k, \qquad &\!\! \mbox{TCP-like,} \\
\!\!\!\! \Upsilon_{k|\mathcal{G}_k}^*\!\!=\!\!-\left(\!{\Psi} + {\Delta}^{\Gamma}\overline{\nu } +\left(\!{\bf I} \odot {\Delta}^{\Gamma}\right)\!\!\left(\!1 -\overline{\nu }\right) \right)^{-1}\!\!{\bf F} X_k, &\!\! \mbox{UDP-like,} \end{array} \right.\!\!\!\!\!\!\!\!\!\!\! \nonumber
\\
\end{eqnarray}
where $\odot$ is the element-wise Hadamard product.
\begin{figure}[!t]
	\captionsetup{justification=centering,margin=2cm,width=\linewidth}
	\centering
	\includegraphics[scale=1]{Figures/UDP_Plant.pdf}
	\caption{The UDP-like protocol where the realisation of the packet loss ${\bf V}_k$ is not monitored}\label{fig1}
	%
\end{figure}
\subsection{Attack Model}
The performance of the controller is determined by the mean of the packet losses in the actuation channel. In view of this, we study the security risk posed by an attacker that governs the statistics of the packet losses on the actuation channel. In practice, this can be achieved by the attacker via DoS attacks over the communication channel. We are not concerned with the particular implementation of the DoS attacks, instead we study the packet loss attack strategy that aims to disrupt the operation of the controller. In particular, we consider the case in which the attacker constructs the attack sequence by designing a random distribution. The rationale for this stems from the fact that the operator expects the packet losses to be IID, and therefore, the attacker mimics the {\it nominal} operation of the channel. That being the case, the optimal attack construction is characterised by the probability of packet loss in the actuation channel, described by the diagonal matrix ${\bf V}^\alpha_k \in S^{m}_{++}$ where the $i$-th diagonal entry is an IID Bernoulli random variable with mean $\mu^\alpha_i$.

\begin{figure}[!t]
	\captionsetup{justification=centering,margin=2cm,width=\linewidth}
	\centering
	\includegraphics[scale=1]{Figures/TCP_Plant.pdf}
	\caption[center]{The TCP-like protocol where the realisation of the packet loss ${\bf V}_k$ is transmitted back to the controller.}\label{fig2}
\end{figure}
\begin{figure*}[!t]
	\fontsize{10pt}{2pt}
	\begin{align}\label{big}\!\!\!
	\underset{\chi_k^{}}{\underbrace{\left(\begin{array}{c}X_{k+1} \\ X_{k+2} \\ \vdots \\ X_{k+N}
			\end{array}\right)}}\!\!\!
	= \!\!\!
	\underset{\Phi}{\underbrace{\left(\begin{array}{c}
			{{{\bf A}}} \\ {{\bf A}}^2 \\ \vdots \\ {{{\bf A}}}^N
			\end{array}\right)}}X_k\!
	+ \!\!\!
	\underset{\Gamma}{\underbrace{\left(\begin{array}{cccc}
			{\bf B} &\bf 0 &\dots & \bf 0\\
			{{\bf A}}{{\bf B}} & {{\bf B}}& \ddots& \vdots\\
			\vdots& \ddots& \ddots& \bf 0 \\
			{{\bf A}}^{N-1}{\bf B} & \dots & {{\bf A}} {\bf B} & {\bf B}
			\end{array}\right)}}\
	\underset{\nu _k}{\underbrace{\left(\begin{array}{cccc}
			{\bf V}_k &\bf 0 &\dots & \bf 0 \\
			\bf 0 & {\bf V}_{k+1} & \ddots & \vdots \\
			\vdots & \ddots & \ddots & \bf 0 \\
			\bf 0 &\dots & \bf 0 & {\bf V}_{k+N-1}
			\end{array} \right)}}\
	\underset{{\Upsilon_k}}{\underbrace{\left(\begin{array}{c}
			U^n_k\\
			U^n_{k+1}\\
			\vdots\\
			U^n_{k+N-1}
			\end{array}\right)}}\!\!
	+\!\!
	\underset{\Lambda}{\underbrace{\left(\begin{array}{cccc}
			{\bf I} &\bf 0 &\dots & \bf 0\\
			{{\bf A}} & {\bf I} & \ddots& \vdots\\
			\vdots& \ddots& \ddots& \bf 0 \\
			{{\bf A}}^{N-1} & \dots & {{\bf A}} & {\bf I}
			\end{array}\right)}}\
	\underset{\Xi_k}{\underbrace{\left(\begin{array}{c}
			W_k \\
			W_{k+1}\\
			\vdots \\
			W_{k+N-1}
			\end{array}\right)}}\!\!\!\!\!\!\!\!
	\end{align}
	\hrulefill
	\vspace*{4pt}
\end{figure*}

To achieve this, the attacker has knowledge of the information set given by
\vspace{-0.3cm}
\begin{eqnarray}\label{eq5}
\mathcal{A}_k &=& \left\{{{\bf A}},{{\bf B}},\Sigma_{W},\bar{\nu}, \Omega, {\Psi}, {\cal I}_k \right\}.
\end{eqnarray}
It is shown later that knowledge of the state of the plant is not necessary to construct the optimal attack and is only required to compute the cost induced by the attack for a particular realisation of the state variables.
The controller operates under the assumption that the packet losses over the actuation channel are IID with a mean defined by ${\bf M}\stackrel{\Delta}{=}\mathds{E}[{\bf V}_k]$ for $k\in\mathds{N}$, with ${\bf M}\in S^m_{++}$. By changing the statistics of the actuation channel, the attacker induces a different distribution over the sequence of packet losses. To distinguish the induced case from the nominal case the induced sequence of packet losses is defined as the diagonal matrix ${\bf V}^\alpha_k$ as above. Similarly, the channel is characterised by ${\bf M}^\alpha\stackrel{\Delta}{=}\mathds{E}[{\bf V}^\alpha_k]$ for $k\in\mathds{N}$, with ${\bf M}^\alpha\in S^m_{++}$.
Note that the mean does not depend on the time step $k$, and therefore, the sequence of random variables describing the packet loss in the $i$-th position is IID.
The sequence of packet losses over the prediction horizon is described by the diagonal matrix $\nu _k^\alpha$ with the Bernoulli sequences along the diagonal and $\bar{\nu }^\alpha\triangleq \mathds{E}[\nu ^\alpha_k]$ for $k=1,2,\ldots,N$.

The objective of the attacker, in contrast to the objective of the controller, is to maximise the cost function~(\ref{eq4}). The cost function of the attacker is
\vspace{-3mm}
\begin{eqnarray}
 J_A\left({\cal A}_k\right)&\triangleq&
\min_{\Upsilon_{k|\mathcal{I}_k}^{*}}\left\{\mathds{E}\left[ X_k^{\sf T} {\bf Q} X_k+\chi_k^{\sf T} \Omega \chi_k+\Upsilon_k^{\sf T}{\nu }^{\alpha{\sf T}}_k {\Psi} {\nu }^{\alpha}_k \Upsilon_k\big|\mathcal{A}_k\right]\right\}\nonumber,
\end{eqnarray}

and the optimal attack construction is defined as
\vspace{-3mm}
\begin{eqnarray}\label{eq6}
J^*_A\left({\cal A}_k\right)\triangleq\max_{\bar{\nu }^\alpha}\left\{J_A\left({\cal A}_k\right)\right\}.
\end{eqnarray}
Note that, the cost function of the operator in (\ref{eq4}) is nested inside (\ref{eq6}), i.e. the attacker chooses the worst case packet loss mean under the assumption that the controller operates optimally. The state estimation performed by the attacker accounts for the true statistics of the actuation channel to produce the state prediction
\vspace{-5mm}
\begin{eqnarray}\label{eq8}
\hat{\chi}_{k}^{\alpha} &\stackrel{\Delta}{=}& \mathds{E}\left[\chi_k\big|\mathcal{A}_k\right] = \Phi X_k +\Gamma \bar{\nu }^\alpha \Upsilon_k ,
\end{eqnarray}
and the state error prediction of the attack construction for the two protocols is given by
\vspace{-3mm}
\begin{subequations}
	\begin{eqnarray}
	{\bf E}_{k|\mathcal{F}_k}^\alpha &\stackrel{\Delta}{=}& \chi_k^{} - \mathds{E}\left[\chi_k^{}\big|\mathcal{F}_k, \nu ^{\alpha}_k\right]

	= \Lambda {\Xi_k}, \label{eq9a}\\
	{\bf E}_{k|\mathcal{G}_k}^\alpha &\stackrel{\Delta}{=}& \chi_k^{} - \mathds{E}\left[\chi_k^{}\big|\mathcal{G}_k\right]

	= \Gamma\left(\nu ^\alpha_k - \bar{\nu }^\alpha\right){\Upsilon_k} + \Lambda {\Xi_k^{}},
	\label{eq9b}
	\end{eqnarray}
\end{subequations}
for the TCP-like protocol and the UDP-like protocol, respectively. Note that the TCP-like prediction includes the knowledge of $\nu ^{\alpha}_k$, this is the same knowledge the operator has when calculating this expectation. Specifically, the acknowledgement link removes the effect of the actuation from the estimation. Even though at time step $k$ the realisation of ${\bf V}_{k+1}$ is not known, it is known at time step $k+1$, and therefore, the operator knows that any chosen actuation law does not affect the estimation at future time steps as this contribution can be removed from the estimation. This is not possible if the acknowledgement channel is not a perfect channel.
The proof of the error trajectories is analogous to the proof in~\cite{MPC} and is omitted.
We describe the attack induced cost by rewriting (\ref{eq6}) in terms of the state prediction and the state prediction error as in~\cite{MPC} which yields
\vspace{-3mm}
\begin{eqnarray}
J^*_A\left({\cal A}_k\right)&=&\max_{\bar{\nu }^\alpha}\left\{\min_{\Upsilon_{k|\mathcal{I}_k}^{*}}\left\{\mathds{E}\left[ \vphantom{\Big |}X_k^{\sf T} {\bf Q} X_k +  \Upsilon_k^{\sf T}{\nu }^{\alpha{\sf T}}_k {\Psi}{\nu }^{\alpha}_k\Upsilon_k  \right.\right. \right.\nonumber \\%Not strictly necessary
&& \qquad\quad\left.\left. \left.+ \left(\hat{\chi}_{k}^{\alpha}+{\bf E}_k^{\alpha} \right)^{\sf T} \Omega \left(\hat{\chi}_{k}^{\alpha}+{\bf E}_k^{\alpha} \right) {\Big|}\mathcal{A}_k\right]\right\}\right\},\nonumber \\
&& \mkern-18mu =X_k^{\sf T}\left( {\bf Q} + {\Delta}^\Phi \right) X_k + \max_{\bar{\nu }^\alpha}\left\{ \min_{\Upsilon_{k|\mathcal{I}_k}^{*}}\left\{\mathds{E}\left[ {\bf E}_k^{\alpha{\sf T}} \Omega {\bf E}_k^{\alpha} {\Big|}\mathcal{A}_k\right]\right\}\right.\nonumber \\
&& \left. \quad +  \Upsilon_{k|\mathcal{I}_k}^{*{\sf T}}\bar{\nu }^\alpha \left( 2{\bf F} X_k + \left({\Delta}^\Gamma \bar{\nu }^\alpha +{\Psi} \right)\Upsilon_{k|\mathcal{I}_k}^*\right) \right\},\label{eq11}
\end{eqnarray}
where ${\Delta}^{\Phi}=\Phi^{\sf T}\Omega\Phi$, ${\Delta}^{\Gamma}=\Gamma^{\sf T}\Omega\Gamma$, and ${\bf F}=\Gamma^{\sf T}\Omega\Phi$.
\subsection{Monitoring of Packet Losses and Attack Detection}
The optimal control law for both protocols is determined by the mean of packet losses as shown in (\ref{eq:Upsilon}). In view of this, the operator monitors the average number of losses on the actuation channel to check that it agrees with the postulated statistic used to construct the control law. Given that the packet losses form a Bernoulli IID sequence, the distribution is fully characterised by the mean of packet losses ${\bf M}$. To that end, the system computes the average number of packet losses over each dimension on the channel up to time step $k\in\mathds{N}$ thus producing the estimate for dimension $i$ given by
\begin{equation}
\hat{\mu}_{i,k}=\frac1k\sum_{j=1}^k ({\bf V}_j)_{i,i}
\end{equation}
where $({\bf V}_j)_{i,i}$ describes the $i,i$-th element of ${\bf V}_j$. The resulting estimate of the mean probability of packet loss at time step $k$ is given by
\begin{equation}
\widehat{{\bf M}}_k=\textnormal{diag}(\hat{\mu}_{1,k}, \hat{\mu}_{2,k}, \ldots, \hat{\mu}_{m,k}).
\end{equation}
The system uses the estimate to check whether the actuation channel is nominal. In this setting, nominal operation entails that the estimated mean does not deviate significantly from the postulated mean used by the controller to implement the control law. Specifically, the operator determines a safe operation region shaped as a hypercube centered around ${\bf M}$ and with edge lengths determined by ${\bf L}\in S^m_+$, where the structure of the lengths is such that ${\bf L}=\textnormal{diag}(\epsilon_1,\epsilon_2, \ldots, \epsilon_m)$ to account for the different detection thresholds $\{\epsilon_i\}_{i=1}^m$ for each dimension of the actuation channel. The resulting safe operation region is given by
\begin{equation}
\label{eq:region}
{\cal C}({\bf M}, {\bf L})=\left\{\widehat{{\bf M}}_k\in \left[0,1\right]^{m\times m}:-{\bf L}\preceq\widehat{{\bf M}}_k-{\bf M}\preceq {\bf L}\right\}.\end{equation}
In this setting, an attack is declared at time step $k\in\mathds{N}$ if $\widehat{{\bf M}}_k\notin{\cal C}({\bf M}, {\bf L})$. Otherwise, normal operation of the system continues and the operator monitors the packet losses by updating its estimate $\widehat{{\bf M}}_k$ at time step $k\in\mathds{N}$. Note that the operator does not incorporate a monitoring performance metric in the cost function; instead, the packet loss monitoring procedure operates concurrent to the system operation but independently of the controller. The detection criteria chosen is optimal, the false alarm rate is determined by ${\bf L} $, if the operator decides upon a time varying ${\bf L}_k$ instead of a fixed ${\bf L}$ then instead define the ${\cal C}({\bf M}, {\bf L})$ above as the intersection of all the time varying regions. In view of this, the attack construction is concerned with two performance metrics: the cost increase induced by the attack on the performance of the controller and satisfying that the calculated average of the packet losses induced by the attack conforms to the safe region defined by (\ref{eq:region}). In the following, we discuss optimal attack construction strategies. It should be noted that the attacker has access to the variables ${\bf L}$ and ${\bf M}_k$.
\section{IID Attack Construction}

As a result of having access to different information sets, the UDP-like protocol error trajectory given in (\ref{eq9b}) depends on the mean of the control variable for the attacker, while the TCP-like protocol does not depend on the mean of the control variable, as shown in (\ref{eq9a}). For that reason, the derivation is presented separately for the each protocol.
\subsection{UDP-like Protocol}
The optimal attack strategy  for the UDP-like protocol is the solution to the optimisation problem
\vspace{-3mm}
\begin{subequations}\label{eq:UDP-opt}
\begin{eqnarray}
	&&\max_{\bar{\nu }^\alpha}\; \;J_A\left({\cal A}_k\right) \\
	&& \mbox{s.t.}\;\quad {\bf M}^\alpha \in {\cal C}\left({\bf M},{\bf L}\right).
\end{eqnarray}
\end{subequations}
Note that the maximisation aims to increase the cost incurred by the controller as a result of the packet losses induced by the attack while the constraint aims to keep the attack within the safe operation region. Additionally, the maximisation in (\ref{eq:UDP-opt}) and the minimisation of the control law in~\cite{MPC} differ in that ${\bf M}^{\alpha}\neq {\bf M}$, and therefore, the terms within $\Upsilon_{k|\mathcal{G}_k}^*$ described in (\ref{eq:Upsilon}) do not cancel. In the UDP-like setting the information set, ${\cal A}_k$, does not have access to the previous realisations of packet losses for estimation, that is, ${\cal I}_k={\cal G}_k$ in (\ref{eq5}).
Using Lemma 1 from~\cite{MPC} and (\ref{eq11}) yields the equivalent cost function given by
\vspace{-3mm}
\begin{eqnarray}
\label{eq:basic}
J^*_A\left({\cal A}_k\right)&=& X_k^{\sf T}\!\left( {\bf Q} + {\Delta}^\Phi \right) X_k+\textnormal{tr}\left({\Delta}^{\Lambda} \Sigma_{\Xi}\right) +\max_{\bar{\nu }^\alpha}\!\left\{\! \Upsilon_{k|\mathcal{G}_k}^{*{\sf T}}\bar{\nu }^\alpha\!\! \left( 2{\bf F} X_k \right.\right.\nonumber \\
&& \left.\left.+  \left({\Delta}^\Gamma \bar{\nu }^\alpha +{\Psi} +\left({\bf I}\odot {\Delta}^{\Gamma}\right)\left({\bf I}- \bar{\nu }^{\alpha}\right)\right)\Upsilon_{k|\mathcal{G}_k}^*\right)\right\},
\end{eqnarray}
where ${\Delta}^\Lambda=\Lambda^{\sf T}\Omega\Lambda$ and the maximisation is subject to ${\bf M}^\alpha \in {\cal C}\left({\bf M},{\bf L}\right)$. In the following, without loss of generality and for the sake of presentation clarity, it is assumed that all actuators for the system share a single communication channel as in~\cite{1}. This simplifies the attack construction while displaying the same properties of the general attack construction.
That being the case, $\bar{\nu }^\alpha$ is a diagonal matrix with equal entries, and therefore, $\bar{\nu }^\alpha=\alpha{\bf I} $ where
$\alpha \in \mathds{R}$ is the control variable of the attacker and $\alpha{\bf I} \in {\cal C}\left({\bf M},{\bf L}\right)$. Similarly, the detection region ${\cal C}\left({\bf M},{\bf L}\right)$ is described, in this case, by the interval ${\cal C}\left({\mu},\epsilon\right)$ where $\mu\in [0,1)$ is the mean of the Bernoulli random variable describing the packet losses in the scalar case and $\epsilon\in [0,1]$ denotes the detection threshold set by the operator.
Within this setting, the attack strategy is characterised by the attack design parameter $\alpha$. In view of this, substituting $\alpha$ as the control variable in (\ref{eq:basic}) reduces the optimisation problem to
\begin{eqnarray}
J^*_A\left({\cal A}_k\right)&=&X_k^{\sf T}\left( {\bf Q} +{\Delta}^\Phi \right)X_k + \textnormal{tr}\left(\Sigma_{\Xi}{\Delta}^{\Lambda}\right) \nonumber\\
&&\mkern-36mu\nqquad +\!\!\!\! \max_{\alpha\in{\cal C}\left({\mu},\epsilon\right)}\!\!\left\{\!\Upsilon_{k|\mathcal{G}_k}^{\sf T} \alpha\left(\alpha{\Delta}^\Gamma\!\! +\! \left(1-\alpha\right)\left({\bf I} \odot{\Delta}^\Gamma \right)\!+\! {\Psi} - 2 {\bf G}_{\mathcal{G}_k}\right)\!\!\Upsilon_{k|\mathcal{G}_k}\right\}.\nonumber
\end{eqnarray}
Note that the first two terms on the right hand side of the equation above are constants that do not depend on $\alpha$. Therefore, it is sufficient to maximise the last term. Substituting $-{\bf G}_{\mathcal{G}_k}^{-1}{\bf F} X_k$ for $\Upsilon_{k|\mathcal{G}_k}$ we write the term inside the maximisation as
\begin{eqnarray}\label{eq:f-UDP}
f\left(\alpha\right) &\triangleq& X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1} \alpha\left(\alpha{\Delta}^\Gamma + \left(1-\alpha\right)\left({\bf I} \odot{\Delta}^\Gamma \right)+ {\Psi} \qquad\qquad  \right. \nonumber \\
&&\qquad \qquad \qquad \qquad \qquad\qquad  \left. - 2 {\bf G}_{\mathcal{G}_k}\right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k.
\end{eqnarray}
The function (\ref{eq:f-UDP}) is concave, convex, or linear in $\alpha$ depending on the system parameters, and therefore, the attacker has no control over the convexity of the cost function used for the attack construction.
However, the information set available to the attacker determines the convexity of the cost function, and therefore, the attacker is able to construct the optimal attack by solving (\ref{eq:f-UDP}) for any system parameters.
In the following lemma we show that for the convex and linear systems the optimal attack construction is equivalent.
\begin{lem}\label{lem2}
	Let (\ref{eq:f-UDP}) be convex or linear in $\alpha$ over ${\cal C}\left(\mu,\epsilon\right)$. Then it's maximum is given by
	\vspace{-3mm}
	\begin{eqnarray}
	\max\{f(\alpha)\} =\max \left\{ f(\min\{{\cal C}\left(\mu,\epsilon\right)\}),f(\max\{{\cal C}\left(\mu,\epsilon\right)\})\vphantom{\Big |}\right\}.\nonumber
	\end{eqnarray}
\end{lem}
\begin{pf}
	Assume there is a maximum of (\ref{eq:f-UDP}), $f(a)$, such that $a \in \textnormal{Int}\{{\cal C}\left(\mu,\epsilon\right)\}$, we prove by contradiction that this is false, and therefore, the maximum is on the boundary of ${\cal C}\left(\mu,\epsilon\right)$. By the definition of convexity, for $\delta>0$ it holds that
	%
	\vspace{-3mm}
	\begin{eqnarray}
	f(a) &\ge& \max\{f(a +\delta),f(a -\delta)\},\\
	f(a) &\ge& t f(a +\delta) + (1-t)f(a -\delta).
	\end{eqnarray}
It follows that $f(a)$ is greater than any point of the line connecting $f(a +\delta)$ and $f(a -\delta))$ however, this breaks the convexity assumption of (\ref{eq:f-UDP}), and therefore, the maximum is on the boundary. This concludes the proof.
\hfill \hfill$\blacksquare$
\end{pf}

When the function is concave there is a third maximising possibility, the case for which the global maximum of the function exists within the interval ${\cal C}\left(\mu,\epsilon\right)$. The following lemma describes this case.
\begin{lem}\label{lem5}
	Let (\ref{eq:f-UDP}) be concave in $\alpha$ over ${\cal C}\left(\mu,\epsilon\right)$. Then the maximum of the function is given by
	\vspace{-3mm}
	\begin{eqnarray}
	\label{eq:concave_sol}
	\max\{f(\alpha)\} &=& \max\left\{ f(\min\{{\cal C}\left(\mu,\epsilon\right)\}),\vphantom{\Big |}\qquad\qquad\qquad\right. \nonumber \\
	 && \mkern-36mu\nqquad  \left. f(\max\{{\cal C}\left(\mu,\epsilon\right)\}), f\left({\mathds 1}_{{\cal C}\left(\mu,\epsilon\right)}\left(\alpha_{\max}\right) \alpha_{\max}\right)\vphantom{\Big |}\right\},
	\end{eqnarray}
	where $ {\mathds 1}_{\cal B}\left(\alpha_{\max}\right)$ is the indicator function as a function of $\alpha_{\max}$ over the set ${\cal B}$ and $\alpha_{\max} \in\mathds{R}$ is the global maximum of $f\left(\alpha\right)$.
\end{lem}
\begin{pf}
	In the concave case a global maximum exists, but is not necessarily within the interval ${\cal C}\left(\mu,\epsilon\right)$, and therefore, we restrict the domain to the safe operation region with the indicator function ${\mathds 1}_{{\cal C}\left(\mu,\epsilon\right)}\left(\alpha\right)$. The concavity of the function implies
	%
	%
	\vspace{-3mm}
	\begin{eqnarray}

	f^{\prime}(\alpha) &=& \Upsilon^{* \sf T}_{k|{\cal G}_k}\!\!\!\left(2\alpha{\Delta}^\Gamma\!\! +\! \left(1-2\alpha\right)\left({\bf I} \odot{\Delta}^\Gamma \right)\! + {\Psi}\! -\! 2 {\bf G}_{\mathcal{G}_k}\right)\!\! \Upsilon^{*}_{k|{\cal G}_k}\!,\ \quad \label{eq:firstderiv}\\
	f^{\prime\prime}(\alpha)&=& 2 \Upsilon^{* \sf T}_{k|{\cal G}_k}\left({\Delta}^\Gamma -\left({\bf I} \odot{\Delta}^\Gamma \right)\right) \Upsilon^{*}_{k|{\cal G}_k} < 0, \label{eq:secondderiv}
	\end{eqnarray}
	%
	where (\ref{eq:secondderiv}) follows from the strict concavity of (\ref{eq:f-UDP}). Setting (\ref{eq:firstderiv}) equal to zero gives
	%
	\begin{eqnarray}
	&& \Upsilon^{* \sf T}_{k|{\cal G}_k}\left(2\alpha{\Delta}^\Gamma + \left(1-2\alpha\right)\left({\bf I} \odot{\Delta}^\Gamma \right) + {\Psi} - 2 {\bf G}_{\mathcal{G}_k}\right) \Upsilon^{*}_{k|{\cal G}_k} =0,\nonumber
\end{eqnarray}
which results in
\begin{eqnarray}
\label{eq:alpha_solve}
	&&\mkern-36mu\mkern-18mu	2\alpha X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1}\left({\Delta}^\Gamma -\left({\bf I} \odot{\Delta}^\Gamma \right)\right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k = \nonumber \\
	&& \qquad X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1}\left(2{\bf G}_{\mathcal{G}_k}-{\Psi} -\left({\bf I} \odot{\Delta}^\Gamma \right)\right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k.
	\end{eqnarray}
It follows from the strict concavity of (\ref{eq:f-UDP}), as in (\ref{eq:secondderiv}), that
\begin{eqnarray}
X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1}\left({\Delta}^\Gamma -\left({\bf I} \odot{\Delta}^\Gamma \right)\right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k\ne0.
\end{eqnarray}
In view of this (\ref{eq:alpha_solve}) can be solved for $\alpha$ yielding
	\begin{eqnarray}
	\alpha_{\max} &=&

	\!\!{{1}\over{2}}h^{-1}_\textnormal{UDP}\!\!\left(\!X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1}\!\!\left(2{\bf G}_{\mathcal{G}_k}-{\Psi} -\left({\bf I} \odot{\Delta}^\Gamma \right)\right)\!\!{\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k\!\right),\qquad \label{eq24}
	\end{eqnarray}
where $h_\textnormal{UDP}\stackrel{\Delta}{=}\Upsilon^{* \sf T}_{k|{\cal G}_k}\left({\Delta}^\Gamma -\left({\bf I} \odot{\Delta}^\Gamma \right)\right) \Upsilon^{*}_{k|{\cal G}_k}$.
The global maximum is the solution when $\alpha_{\max} \in {\cal C}\left(\mu,\epsilon\right)$, i.e. the term $\alpha_{\max}\mathds{1}_{{\cal C}\left(\mu,\epsilon\right)}\left(\alpha_{\max}\right)$ in (\ref{eq:concave_sol}). When $\alpha_{\max}\notin{\cal C}\left(\mu,\epsilon\right)$ the solution follows as in the convex scenario by noticing that the inequality is strict and in the opposite direction.
Therefore, if $\alpha_{\max}\notin{\cal C}\left(\mu,\epsilon\right)$ the attack construction reverts to selecting the value of~$\alpha$ on the maximising boundary.
For a concave function this is equivalent to finding the boundary that is closest to $\alpha_{\max}$.
Let~$a,b\in{\cal C}\left(\mu,\epsilon\right)$ and assume $f(a)>f(b)$ and that $|a-\alpha_{\max}|<|b-\alpha_{\max}| $, then
	\begin{eqnarray}
	f(b) &<& t f(a) + (1-t)f(\alpha_{\max}).
	\end{eqnarray}
However, this line segment lies above the function which contradicts the fact that this function is concave, and therefore, the maximising $\alpha$ is on the boundary that is closest to $\alpha_{\max}$. This concludes the proof. \hfill$\blacksquare$
\end{pf}
Note that the $\alpha_{max}$ attack construction provides a globally optimal performance for the attacker from within the safe operation region. In fact, it also provides a lower probability of attack detection as it allows the attacker to operate away from the boundary.

The following lemma highlights that an attack that minimises the cost of the operator is not achieved by setting $\alpha=1$.
In the following we show that the optimal attack construction does not necessarily imply increasing the number of packet losses incurred by the operator. Indeed, there exist system parameters for which the optimal attack entails increasing the number of actuations. Whilst this might not be implementable in all attack scenarios, it is feasible to envision settings in which the attacker has full control of the actuation channel and can set the packet loss statistics at will.
The following lemma captures this notion, namely, that the performance of the operator does not necessarily improve with the average number of received packets. Reiterating that the operator assumes a mean packet loss, and in doing so, creates an opportunity for the attacker to exploit the channel.
\begin{lem}\label{lem1}
For any choice of system parameters it holds that
\begin{equation}
\min_{a\in [0,1)} f(a)\leq \min\left\{f(1),f(\mu)\right\},
\end{equation}
where $f$ is defined in (\ref{eq:f-UDP}).
\end{lem}
\begin{pf}
	%
	Setting (\ref{eq:firstderiv}) equal to zero, and substituting in $\alpha = 1$ yields
	%
	\begin{eqnarray}
	f^\prime(1) =\Upsilon_{k|\mathcal{G}_k}^{*\sf T} \left(2\left(\mathbf{I}-\bar{\nu }\right){\Delta}^{\Gamma} - {\Psi} -\left(3\mathbf{I} -2\bar{\nu }\right)\left({\bf I} \odot {\Delta}^{\Gamma}\right)  \right)\Upsilon_{k|\mathcal{G}_k}^*. \nonumber
	\end{eqnarray}
	%
	For this to be a minimising solution it needs to hold that, ${\Psi}$ is equal to $2\left({\bf I}-\bar{\nu }\right){\Delta}^{\Gamma}-\left(3{\bf I}-2\bar{\nu }\right)\left({\bf I} \odot {\Delta}^{\Gamma}\right)$. Due to ${\Psi} $ being a diagonal matrix and the structure of ${\Delta}^\Gamma$ it is only possible for this equality to hold in a system with ${{\bf A}}={\bf 0}$ and a diagonal ${\bf B}$. In this scenario, ${\Delta}^{\Gamma}=\left({\bf I} \odot {\Delta}^{\Gamma}\right)$, this results in, ${\Psi}=-\left({\bf I} \odot {\Delta}^\Gamma\right)$. By assumption ${\Psi}\succ 0$, however, it is shown in Lemma \ref{lem4} that $\left({\bf I} \odot {\Delta}^\Gamma\right)\succ 0$ which is a contradiction, and therefore, $f^\prime(\alpha=1)\ne 0$ and thus $\alpha=1$ is not a minimising solution. Substituting $\alpha{\bf I}=\mu{\bf I} = {\bar{\nu }}$ in  (\ref{eq:firstderiv}) results in	%
	\begin{eqnarray}
	f^\prime(\alpha) &=&\Upsilon_{k|\mathcal{G}_k}^{*\sf T} \left(2\bar{\nu }{\Delta}^\Gamma + \left(\mathbf{I}-2\bar{\nu }\right)\left({\bf I} \odot{\Delta}^\Gamma \right)+ {\Psi} - 2 {\bf G}_{\mathcal{G}_k}\right)\Upsilon_{k|\mathcal{G}_k}^{*},\nonumber\\
	&=&-X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1} \left( {\Psi} +\left({\bf I} \odot {\Delta}^{\Gamma}\right)\right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k .\label{eq49}
	\end{eqnarray}
	%
	This is not equal to $0$ due to ${\Psi}+\left({\bf I} \odot {\Delta}^\Gamma\right)\succ 0$. Therefore,~(\ref{eq49}) is strictly negative and not a minimising solution. This concludes the proof. \hfill$\blacksquare$
\end{pf}

\begin{thm}\label{thm1}
Let ${\cal A}_k=\left\{{{\bf A}},{{\bf B}},\Sigma_{W},\bar{\nu}, \Omega, {\Psi}, {\cal G}_k \right\}$ be the information set available to construct the attack, then the optimal mean packet loss probability for an IID attack is given by
	\begin{eqnarray}
	\alpha^*_{\textnormal{UDP}} &=& \max\left\{f\left(\min\{{\cal C}\left(\mu,\epsilon\right)\}\right),\vphantom{\Big |}f\left(\max\{{\cal C}\left(\mu,\epsilon\right)\}\right),\nonumber \right.\\
	&&\left.\qquad\qquad\qquad\qquad\qquad  f\left({\mathds 1}_{{\cal C}\left(\mu,\epsilon\right)}\left(\alpha_{\max}\right)\alpha_{\max}\right)\vphantom{\Big |}\right\},\nonumber
	\end{eqnarray}
where
	\begin{eqnarray}
	f\left(a\right) &\triangleq& X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1} a\left(a{\Delta}^\Gamma + \left(1-a\right)\left({\bf I} \odot{\Delta}^\Gamma \right)+ {\Psi} \qquad\qquad  \right. \nonumber \\
	&&\qquad \qquad \qquad \qquad \qquad\qquad  \left. - 2 {\bf G}_{\mathcal{G}_k}\right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k.\nonumber
	\end{eqnarray}

\end{thm}

\begin{pf}
The result follows from the application of Lemma 1 for the convex and linear cases, Lemma 2 for the concave case, and by noticing that the set of solutions for the convex and linear cases is a subset of of the set of solutions of the concave case. This concludes the proof. \hfill$\blacksquare$
\end{pf}
\subsection{TCP-like Protocol}
The optimal attack strategy  for the TCP-like protocol is the solution to the optimisation problem
\begin{subequations}\label{eq:TCP-opt}
	\begin{eqnarray}
	&&\max_{\bar{\nu }^\alpha}\; \;J_A\left({\cal A}_k\right), \\
	&& \mbox{s.t.}\;\quad {\bf M}^\alpha \in {\cal C}\left({\bf M},{\bf L}\right).
	\end{eqnarray}
\end{subequations}
Note that in this case the information set ${\cal A}_k$ contains the realisations of the packet losses as given in ${\cal F}_k$. For that reason, the optimisation problem differs from that in (\ref{eq:UDP-opt}) in that the cost function exhibits a different structure induced by the conditioning of the previous packet loss realisations.
From (\ref{eq11}) and Lemma 1 in \cite{MPC} with substitution of the optimal control law under the TCP-like protocol in (\ref{eq:Upsilon}) yields
\begin{eqnarray}
&& J^*({\cal A}_k)=
X_k^{\sf T}\left( {\bf Q} + {\Delta}^\Phi \right) X_k+\textnormal{tr}\left({\Delta}^{\Lambda} \Sigma_{\Xi}\right) \nonumber \\
&& +\max_{\bar{\nu }^\alpha}\left\{ X_k^{\sf T}{\bf F}^{\sf T} {\bf G}_{\mathcal{F}_k}^{-1}\bar{\nu }^\alpha \left( {\Delta}^\Gamma \bar{\nu }^\alpha   +{\Psi} -2{\bf G}_{\mathcal{F}_k} \right){\bf G}_{\mathcal{F}_k}^{-1}{\bf F} X_k\right\}\!, \quad\label{eq:31}
\end{eqnarray}
where the maximisation is subject to ${\bf M}^\alpha \in {\cal C}\left({\bf M},{\bf L}\right)$. As with the UDP-like protocol attack construction, it is assumed without loss of generality, that all actuators share a single communication channel~(\cite{1}). Therefore, $\bar{\nu }^\alpha=\alpha{\bf I}$. Noting that the first two terms in (\ref{eq:31}) do not depend on $\bar{\nu }^\alpha$ and that ${\bf G}_{\mathcal{F}_k}=\left({\Delta}^\Gamma\bar{\nu }+{\Psi}\right)$  as shown in (\cite{MPC}), then the term inside the maximisation can be rewritten as
\begin{eqnarray}
g\left(\alpha\right)&\triangleq& -X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{F}_k}^{-1}\alpha \left( {\Delta}^{\Gamma}\left(2\bar{\nu }-\alpha\mathbf{I} \right) + {\Psi} \right){\bf G}_{\mathcal{F}_k}^{-1}{\bf F} X_k. \label{eq:g-TCP}
\end{eqnarray}
Differentiating (\ref{eq:g-TCP}) results in
\begin{eqnarray}
g^{\prime}\left(\alpha\right) &= & -X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{F}_k}^{-1}\left( {\Delta}^{\Gamma}\left(2\bar{\nu }-2\alpha\mathbf{I} \right) + {\Psi} \right){\bf G}_{\mathcal{F}_k}^{-1}{\bf F} X_k,\label{eq32} \\
g^{\prime\prime}\left(\alpha\right) &= & 2 X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{F}_k}^{-1}{\Delta}^{\Gamma}{\bf G}_{\mathcal{F}_k}^{-1}{\bf F} X_k.\label{eq:second-deriv-TCP}
\end{eqnarray}

\begin{lem}\label{lem4}
	Let the pair $({{\bf A}},{\bf B})$ be reachable and the state penalty matrix $\Omega$ be positive definite. Then the function defined by (\ref{eq:g-TCP}) is convex in $\alpha$ over ${\cal C}\left(\mu,\epsilon\right)$ almost surely.
	%
	\end{lem}
	\begin{pf}
	It follows from (\ref{eq:second-deriv-TCP}) that if ${\Delta}^{\Gamma}\succ 0$ and $X_k\neq{\bf 0}$ then (\ref{eq:second-deriv-TCP}) is strictly greater than zero. Therefore, (\ref{eq:g-TCP}) is convex in $\alpha$ over ${\cal C}\left(\mu,\epsilon\right)$. It is shown in~\cite[p.225, 10.31(c)]{6} that when $\textnormal{rank}\left(\Gamma\right)=\max\{Nn,Nm\}$ and $\Omega$ is positive definite then ${\Delta}^\Gamma\succ 0$. Since $ ({{\bf A}},{\bf B})$ is a reachable pair then $\textnormal{rank}\left[ {\bf B}, {\bf A}{\bf B},\ldots,{\bf A}^{N-1}{\bf B}\right]=\max\{n,m\}$. Therefore, due to the triangular structure of $\Gamma$ we have that $\textnormal{rank}\left(\Gamma\right)=\max\{Nn,Nm\}$. Under these assumptions (\ref{eq:second-deriv-TCP}) is convex in $\alpha$ over ${\cal C}\left(\mu,\epsilon\right)$ when $X_k\neq0$, which holds with probability $1$.
	%

	This concludes the proof.\hfill$\blacksquare$
	\end{pf}
\begin{thm}\label{thm2}
	Consider a system operating with a TCP-like protocol.
	%
	\begin{eqnarray}
	g\left(\alpha\right)&\triangleq& -X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{F}_k}^{-1}\alpha \left( {\Delta}^{\Gamma}\left(2\bar{\nu }-\alpha{\bf I} \right) + {\Psi} \right){\bf G}_{\mathcal{F}_k}^{-1}{\bf F} X_k,\nonumber
	\end{eqnarray}
	 %
	 Therefore, the optimal choice of $\alpha$ is
	\begin{eqnarray}
	\alpha^*_\textnormal{TCP} = \max\left\{g\left(\min\{{\cal C}\left(\mu,\epsilon\right)\}\right),g\left(\max\{{\cal C}\left(\mu,\epsilon\right)\}\right)\vphantom{\Big |}\right\}.\nonumber
	\end{eqnarray}
\end{thm}
\begin{pf}
	Note from Lemma \ref{lem4} that $g(\alpha)$ is convex therefore, as shown in Lemma \ref{lem1}, $\alpha^{*}_{TCP}$ is known to be on the boundary. This concludes the proof.
	\end{pf}
Note that due to the convexity of (\ref{eq:g-TCP}) the solution of (\ref{eq32}) results in the minimising value of $\alpha$, which interestingly is not $\alpha{\bf I}=\bar{\nu }$, or $\alpha = 1$ but instead is given by
\begin{eqnarray}
\alpha_{\min}={{1}\over{2}}h_\textnormal{TCP}^{-1} \left(X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1}\!\!\left(2{\Delta}^\Gamma\bar{\nu } + {\Psi}\right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k\right),
\end{eqnarray}
where $h_{TCP}= X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{F}_k}^{-1}{\Delta}^{\Gamma}{\bf G}_{\mathcal{F}_k}^{-1}{\bf F} X_k > 0$. When considering the TCP-like protocol without detection constraints, additional insight can be obtained by analysing the attack construction
\begin{eqnarray}
g\left(1\right)&=&X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{F}_k}^{-1} \left( {\Delta}^{\Gamma}\left({\bf I}- 2\bar{\nu }\right) - {\Psi} \right){\bf G}_{\mathcal{F}_k}^{-1}{\bf F} X_k, \ g\left(0\right)= 0.\ \ \ \ \label{eq:g1}
\end{eqnarray}
From (\ref{eq:g1}), if ${\Delta}^{\Gamma}\left({\bf I}- 2\bar{\nu }\right) \succ {\Psi} $ the maximising value of $\alpha$ is $1$ or $0$.
The ${\Delta}^{\Gamma}\left({\bf I}- 2\bar{\nu }\right) $ term is the state penalty matrix $\Omega$ weighted by the reachability of the system and the packet loss probability.
The terms in (\ref{eq:g1}) capture the average impact of actuation in the cost reduction with respect to the input penalty matrix ${\Psi}$.
Therefore, the optimal attack is $1$ when the average cost increase per actuation is greater than the average penalty induced by the actuation.
As a result, for a system with a high probability of packet loss that penalises state error more than actuation, the optimal attack strategy is to allow perfect communication, i.e. all packets are received by the plant.
Additionally, for $\bar{\nu }\succ{{1}\over{2}}{\bf I} $ the optimal attack strategy is $\bar{\nu }={\bf 0}$. That being the case, for a system with a low probability of packet losses the operator could simplify their detection criteria to a one-sided test.
\section{Cost Increase Analysis}
In this section we evaluate the cost increase induced by the optimal IID attack by comparing the expected cost when an attack is present to the expected cost when no attack is present, i.e.  $\mathds{E}\left[J^*_A({\cal A}_k)\right] - \mathds{E}\left[ J^*({\cal I}_k)\right]$. The expected cost increase of the three attack strategies are studied separately. The analysis is carried out for the case ${\cal C}\left(\mu,\epsilon\right)=[0,1)$, i.e. the extreme cases of the average attack packet drop.
Note that there is no loss of generality as the case with detection constraints can be analysed following the same approach with the appropriate scaling. Additionally, when considering the different cases of $\alpha^*$ it should be noted that for a given set of detection parameters $\alpha^*$ is unique. Since, the detection parameters, $\mu,\epsilon$, are not fixed. The region $[0,1)$ is continuous with respect to $\alpha^*$.
\newsavebox{\smlA
\savebox{\smlA}{$\left(\begin{smallmatrix} 1.03&0.005\\0.35&0.5\end{smallmatrix}\right)$}
\newsavebox{\smlB
\savebox{\smlB}{$\left(\begin{smallmatrix}1&0\\0&1\end{smallmatrix}\right)$}
\newsavebox{\smlV
\savebox{\smlV}{$\left(\begin{smallmatrix}0.7&0\\0&0.01\end{smallmatrix}\right)$}
\subsection{UDP-like Cost Analysis}
\subsubsection{Attack performance when $\alpha^*\rightarrow0$.}

We first analyse the case when the attacker losses all the packets and induces the cost
\begin{equation}
\mathds{E}\left[J^0_A({\cal A}_k)\right]\stackrel{\Delta}{=} \lim_{\alpha^*\rightarrow 0}\mathds{E}\left[J_A({\cal A}_k)\right].
\end{equation}
The expected cost
when there is an attack is given by
\begin{equation}
\mathds{E}\left[J^0_A({\cal A}_k)\right]= \textnormal{tr}\left(\Sigma_{X}\left({\bf Q} + {\Delta}^\Phi\right) + \Sigma_{\Xi}{\Delta}^{\Lambda}\right)+ \max\{f(\alpha)\}.
\end{equation}
Since (\ref{eq:f-UDP}) is continuous in $\alpha$ we have that $\alpha^*\rightarrow0$ implies $f\left(\alpha^*\right)\rightarrow0$, and therefore, the cost increase is
\begin{equation}
\mathds{E}\left[J^0_A({\cal A}_k)\right]-\mathds{E}\left[J^*({\mathcal{G}_k})\right]\
= X_k^{\sf T} {\bf F}^{\sf T} {\bf G}_{\mathcal{G}_k}^{-1}\bar{\nu } {\bf F} X_k >0.\label{eq39}
\end{equation}
Note that the $\alpha^*\rightarrow0$ attack strategy forces the system into open loop, and therefore, the expected cost increase coincides with the expected cost reduction introduced by the controller when there is no attack present in the communication channel.
\subsubsection{Attack performance when $\alpha^*=1$.}
In this case, the attacker allows successful reception of all packets, i.e. the actuation communication channel is perfect. Surprisingly, there exist systems for which the cost increase, given by
\begin{equation}
\mathds{E}\left[J^1_A({\cal A}_k)\right]\stackrel{\Delta}{=} \mathds{E}\left[J_A({\cal A}_k)\right]\Big |_{\alpha^*=1},
\end{equation}
is positive despite the fact that the communication channel of the operator improves. Evaluation of (\ref{eq:f-UDP}) with perfect communication results in

\begin{eqnarray}
\mathds{E}\left[J^1({\cal A}_k)\right]&=& \textnormal{tr}\left(\Sigma_{X}\left({\bf Q} + {\Delta}^\Phi\right) + \Sigma_{\Xi}{\Delta}^{\Lambda}\right)\nonumber \\
&&+ X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1} \left({\bf I}-2\bar{\nu }\right)\left({\Delta}^{\Gamma} - \left({\bf I} \odot {\Delta}^{\Gamma}\right)\right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k \nonumber \\
&& -X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1} \left(\left({\bf I} \odot {\Delta}^{\Gamma}\right)+ {\Psi}  \right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k.
\end{eqnarray}
Unlike the $\alpha^*\rightarrow0$ case, the $\alpha^*=1$ construction does not guarantee an increase in cost for every system. In fact, the cost only increases when
\begin{eqnarray}
&&X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1} \left({\bf I}-2\bar{\nu }\right)\left({\Delta}^{\Gamma} - \left({\bf I} \odot {\Delta}^{\Gamma}\right)\right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k\ \ge \nonumber \\
&&\qquad\qquad X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1} \left(\left({\bf I} \odot {\Delta}^{\Gamma}\right)+ {\Psi}  \right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k> 0. \label{eq44}
\end{eqnarray}
However, all variables that determine (\ref{eq44}) are system parameters known by the attacker, and therefore, the attacker decides the optimal attack strategy accordingly. The expected cost increase is
\begin{eqnarray}
&&\mathds{E}\left[J^1_A({\cal A}_k)\right]-\mathds{E}\left[J^*({\cal G}_k)\right]\nonumber \\
&&= X_k^{\sf T} {\bf F}^{\sf T} {\bf G}_{\mathcal{G}_k}^{-1} \left({\Delta}^\Gamma + {\Psi} \right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k +\left(\bar{\nu }-2{\bf I}\right)X_k^{\sf T} {\bf F}^{\sf T} {\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k. \nonumber
\end{eqnarray}
\subsubsection{Attacker performance when $\alpha^* ={\mathds{1}_{{\cal C}\left(\mu,\epsilon\right)}\left(\alpha_{\max}\right)}\alpha_{\max}$.}
We tackle next the introduction of a general detection constraint.
In this case, the expected cost for the attacker is
\begin{eqnarray}
\mathds{E}\left[J^{\alpha_{\max}}({\cal A}_k)\right]&\stackrel{\Delta}{=}& \mathds{E}\left[J_A({\cal A}_k)\right]\Big |_{\alpha^*=\alpha_{\textnormal{max}}}\nonumber\\
&=&\textnormal{tr}\left(\Sigma_{X}\left({\bf Q} + {\Delta}^\Phi\right) + \Sigma_{\Xi}{\Delta}^{\Lambda}\right) + f(\alpha_{\max}).\nonumber
\end{eqnarray}
Algebraic maniupulation of $f(\alpha_{\max})$ and substituting (\ref{eq24}) yields:
\begin{eqnarray}
 f(\alpha_{\max})\!\!= \!\!\frac{ h_\textnormal{UDP}^{-1} }{4
\left(X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1}\left(2{\bf G}_{\mathcal{G}_k}-{\Psi} -\left({\bf I} \odot{\Delta}^\Gamma \right)\right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k\right)^2\!\!,\nonumber
\end{eqnarray}

where the inequality comes from the fact that $f$ is concave when $\alpha_{\textnormal{max}}$ is a feasible optimal attack strategy. The resulting cost increase is
\begin{eqnarray}
\mathds{E}\left[J^{\alpha_{\max}}\left({\cal A}_k\right)\right] - J^*({\cal G}_k)
&=&X_k^{\sf T} {\bf F}^{\sf T} {\bf G}_{\mathcal{G}_k}^{-1}\bar{\nu } {\bf F} X_k \nonumber \\
&& \mkern-36mu\nqquad\mkern-36mu\nqquad \mkern-36mu\nqquad \ \ \ + {{1}\over{4}} h_\textnormal{UDP}^{-1}\left(X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{G}_k}^{-1}\left(2{\bf G}_{\mathcal{G}_k}-{\Psi} -\left({\bf I} \odot{\Delta}^\Gamma \right)\right){\bf G}_{\mathcal{G}_k}^{-1} {\bf F} X_k\right)^2 > 0. \nonumber
\end{eqnarray}
Note that the inequality is strict, i.e. the attack guarantees a performance loss of the operator. As mentioned previously this attack strategy is only feasible when $\alpha_{\max}\in{\cal C}\left(\mu,\epsilon\right)$ and (\ref{eq:f-UDP}) is concave. Additionally, $\mathds{E}\left[J^0\left({\cal A}_k\right)\right]-\mathds{E}\left[J^*\left({\cal G}_k\right)\right]$ is a upper bounded by the cost increase induced by the $\alpha^* ={\mathds{1}_{{\cal C}\left(\mu,\epsilon\right)}\left(\alpha_{\max}\right)}\alpha_{\max}$ strategy.

\subsection{TCP-like Cost Analysis}
The cost increase analysis for TCP-like protocols contains only two attack strategies. The analysis is again performed on the ${\cal C}\left(\mu,\epsilon\right)=[0,1)$ interval.
\subsubsection{Attacker performance when $\alpha^*\rightarrow0$.}
For the attack construction that forces the  system into open loop the expected cost is given by
\begin{eqnarray}
\hfill\mathds{E}\left[J^0\left({\cal A}_k\right)\right]&=& \textnormal{tr}\left(\Sigma_{X}\left({\bf Q} + {\Delta}^\Phi\right) + \Sigma_{\Xi}{\Delta}^{\Lambda}\right)+ \lim_{\alpha^*\rightarrow 0}g(\alpha^*). \nonumber
\end{eqnarray}
Since (\ref{eq:g1}) is continuous in $\alpha$ we have that $\alpha^*\rightarrow0$ implies $g(\alpha^*)\rightarrow0$. Therefore, the expected cost increase is:
\begin{equation}
\mathds{E}\left[J^0\left({\cal A}_k\right)\right]-\mathds{E}\left[J^*\left({\cal F}_k\right)\right
= X_k^{\sf T} {\bf F}^{\sf T} {\bf G}_{\mathcal{F}_k}^{-1}\bar{\nu } {\bf F} X_k >0. \nonumber
\end{equation}
As with the UDP-like protocol, by implementing the $\alpha^*\rightarrow0$ attack strategy the attacker forces the system into open loop. Note that the cost increase for the TCP-like protocol and the UDP-like protocol under the $\alpha^*\rightarrow0$ strategy differ only in the ${\bf G}_{{\cal I}_k}$ designed by the controller, i.e. on the available information.
\subsubsection{Attacker performance when $\alpha^*=1$.}
In the TCP case, the attack that provides a perfect communication channel induces an expected cost given by
\begin{eqnarray}
\mathds{E}\left[J^1\left({\cal A}_k\right)\right]&=& \textnormal{tr}\left(\Sigma_{X}\left({\bf Q} + {\Delta}^\Phi\right) + \Sigma_{\Xi}{\Delta}^{\Lambda}\right)+ g(1). \nonumber
\end{eqnarray}
Therefore, it follows form (\ref{eq:g1}) that the expected cost increase induced by the $\alpha^*=1$ strategy is
\begin{eqnarray}
\mathds{E}\left[J^1\left({\cal A}_k\right)\right]-\mathds{E}\left[J^*\left({\cal F}_k\right)\right] &&\nonumber \\
&&\mkern-36mu\nqquad \mkern-36mu\nqquad \mkern-36mu =\underbrace{X_k^{\sf T} {\bf F}^{\sf T}{\bf G}_{\mathcal{F}_k}^{-1} \left( {\Delta}^{\Gamma}\left({\bf I}- 2\bar{\nu }\right) - {\Psi} \right){\bf G}_{\mathcal{F}_k}^{-1}{\bf F} X_k}
_{> 0}
+\!\!\! \underbrace{X_k^{\sf T} {\bf F}^{\sf T} {\bf G}_{\mathcal{F}_k}^{-1}\bar{\nu } {\bf F} X_k}_{\mathds{E}\left[J^0\left({\cal A}_k\right)\right]-\mathds{E}\left[J^*\left({\cal F}_k\right)\right]}, \nonumber
\end{eqnarray}
where the first term is strictly positive following the assumption that the $\alpha^*=1$ attack construction is optimal. Therefore, $\alpha*=1$ is strictly greater than the $\alpha^*\rightarrow0$ attack strategy only when ${\Delta}^{\Gamma}\left({\bf I}- 2\bar{\nu }\right) \succ {\Psi}$, which is the condition needed for the $\alpha^*=1$ construction to be optimal.
\section{Non-Stationary Random attacks}
Since the plant given in (\ref{eq1}) is Markovian, it seems reasonable to assume that the attacker should be able to exploit the memory of the system in the construction of the attack. In that sense, the IID attack construction does not provide sufficient flexibility to incorporate the time dependency between consecutive packet losses. Motivated by this insight, in the following we investigate the extension of random attacks to non-IID settings. Specifically, we consider the case in which the statistics of the attack are non-stationary. The resulting non-stationary attack construction extends the IID attack construction to an attack that corrupts a system with independent actuator channels. As in the IID case, the aim of the attacker is to increase the cost function while remaining in the safe operation region by adjusting the value of ${\bf M}^\alpha$. Additionally, the attack construction is no longer restricted to a constant ${\bf M}^\alpha$, i.e. ${\bf M}_k^\alpha\stackrel{\Delta}{=}\mathds{E}[{\bf V}^\alpha_k]$ for $k\in\mathds{N}$. The derivation of the non-stationary attack construction is equivalent to the IID attack construction up to (\ref{eq:basic}). The reason for the necessity of a different derivation stems from the fact that $\bar{{\nu }}^\alpha\neq\alpha{\bf I}$ since ${\bf M}^\alpha_{k}\neq{\bf M}^\alpha_{k+1}$ for $k\in\mathds{N}$.

We first consider the non-stationary attack construction for the UDP-like protocol. Notice that for the non-stationary construction maximising (\ref{eq:basic}) is equivalent to is equivalent to maximising the function
\begin{eqnarray}
&&\!\!  f\left(\bar{{\nu }}^\alpha\right) =\! \Upsilon_{\mathcal{G}_k}^{*{\sf T}}\bar{\nu }^\alpha\!\! \left( {\Delta}^\Gamma \bar{\nu }^\alpha +{\Psi} +\left({\bf I}\odot {\Delta}^{\Gamma}\right)\left({\bf I}- \bar{\nu }^{\alpha}\right)\vphantom{\bar{\nu }^\alpha}-2{\bf G}_{\mathcal{G}_k}\right)\Upsilon_{\mathcal{G}_k}^*,\nonumber\\
&&\!\! =\mbox{tr}\left(\!\! \bar{\nu }^\alpha\!\! \left( \left({\Delta}^\Gamma\!\!-\! \left({\bf I} \odot{\Delta}^\Gamma \right)\right)\!\!\bar{\nu }^\alpha +\left({\bf I} \odot{\Delta}^\Gamma \right) +\!\! {\Psi}\! - 2 {\bf G}_{\mathcal{G}_k}\right)\Upsilon_{\mathcal{G}_k}^{*}\Upsilon_{\mathcal{G}_k}^{* {\sf T}} \right), \nonumber
\end{eqnarray}
where the maximisation is subject to ${{\bf M}}_k^{\alpha} \in {\cal C}\left({\bf M},{\bf L}\right)$ for $k\in\mathds{N}$.
Letting ${\Delta}^H={\Delta}^\Gamma -\left({\bf I} \odot{\Delta}^\Gamma \right)$, and substituting ${\bf G}_{\mathcal{G}_k}$ allows the optimal attack strategy for the UDP-like protocol to be posed as a quadratic optimisation problem (QP) given by
\begin{eqnarray}
&& \max_{\bar{{\nu }}^\alpha}\quad \mbox{tr}\left( \left[ \bar{\nu }^\alpha{\Delta}^H \bar{\nu }^\alpha -
\bar{\nu }^\alpha\left(\left({\bf I} \odot{\Delta}^\Gamma \right) + {\Psi} + 2 \bar{{\nu }}{\Delta}^H \right)\right]\Upsilon_{\mathcal{G}_k}^{*}\Upsilon_{\mathcal{G}_k}^{* {\sf T}} \right), \nonumber \\
&& \mbox{s.t.}\qquad \!\!{{\bf M}}_k^{\alpha} \in {\cal C}\left({\bf M},{\bf L}\right) \qquad \textnormal{for } k\in\mathds{N}.
  \end{eqnarray}
Note that the set of IID attack strategies is a subset of the strategies generated with this formulation. Therefore, if IID is indeed the optimal attack then the proposed non-stationary attack construction coincides with the strategy presented in the previous section. If however, the cost induced by the non-stationary attack is greater than that induced by $\alpha{\bf I}$, then it follows that memory in the attack yields larger cost increases while satisfying the same detection constraints. Performing the same analysis for the TCP-like system results in an analogous QP formulation given by
\begin{eqnarray}
&& \max_{\bar{{\nu }}^\alpha}\quad \mbox{tr}\left( \left[ \bar{\nu }^\alpha{\Delta}^\Gamma \bar{\nu }^\alpha -
\bar{\nu }^\alpha\left(2 \bar{{\nu }}{\Delta}^\Gamma + {\Psi} \right)\right]\Upsilon_{\mathcal{F}_k}^{*}\Upsilon_{\mathcal{F}_k}^{* {\sf T}} \right), \nonumber \\
&&  \mbox{s.t.}\qquad\!\! {{\bf M}}_k^{\alpha} \in {\cal C}\left({\bf M},{\bf L}\right) \qquad \textnormal{for } k\in\mathds{N}.
\end{eqnarray}
In the TCP-like scenario the terms ${\Delta}^\Gamma$, ${\Psi}$, and $\Upsilon_{\mathcal{F}_k}^{*}\Upsilon_{\mathcal{F}_k}^{* {\sf T}}$ are positive semidefinite. Both UDP-like and TCP-like QP formulations can be modified to include IID attacks on non-scalar systems provided that the additional constraint ${\bf M}^\alpha_k={\bf M}^\alpha_{k+1}$ for $k\in\mathds{N}$ is included.
\section{Numerical Results}
The comparison between the IID attack and the non-stationary attack is conducted over two communication channels for the same system. To that end, we use the same test system as in~\cite{MPC}. The first simulation is performed over a scalar communication channel with ${\bf M}=0.7$ by averaging $1000$ realisations of the state trajectories and is shown in Fig. \ref{fig3} and \ref{fig3a}.  Additionally, when under attack the UDP-like system trajectory depicted in Fig. \ref{fig3a} displays a larger change from the nominal state trajectory when compared with TCP-like trajectory depicted in  Fig. \ref{fig3}. For the second channel model, i.e. ${\bf M}=\usebox{\smlV}$, the non-stationary attack results in a larger increase from the nominal state trajectory when compared to the IID attack as shown in Fig. \ref{fig4} and  Fig. \ref{fig4a}, which are obtained by averaging $1000$ realisations of the state trajectories. As in the previous case, the results suggest that the system operating with a UDP-like protocol is more vulnerable to attacks than a system operating with a TCP-like protocol.
The nominal terminal cost of the system with no attack present is $7.671$ for the UDP-like protocol shown in Fig. \ref{fig4a}. Interestingly, the terminal cost induced by the non-stationary attack is $18.217$ while the terminal cost induced by the IID attack is $13.26$. This suggests that UDP-like protocols are more vulnerable to non-stationary attacks than to IID attacks. However, the difference in the induced cost for the scalar channel shown in Fig. \ref{fig3a} is not as significant as that for the multiple input channel. Surprisingly, for the TCP-like case shown in Fig. \ref{fig4} the performance of the IID attack outperforms the non-stationary attack. Specifically, the terminal cost induced by the IID attack is $8.689$ whereas the terminal cost induced by the non-stationary attack is $8.525$. This small difference is due to numerical error in the simulations, indeed when the accuracy is increased the non-stationary cost converges to the IID attack cost. These results seem to suggest that there is no significant advantage in implementing non-stationary attacks in TCP-like systems.

\begin{figure}[!t]
	\captionsetup{justification=centering,margin=2cm,width=\linewidth}
		\includegraphics[width=0.9\linewidth]{Figures/Av_Attack_S-eps-converted-to.pdf}

	\caption{System with TCP-like protocol with $ {\bf A} =\usebox{\smlA}$, ${\bf M}=0.7$, and $\epsilon=0.1$.}\label{fig3}

\end{figure}
\begin{figure}[!t]
	\captionsetup{justification=centering,margin=2cm,width=\linewidth}
	\includegraphics[width=0.9\linewidth]{Figures/Av_Attack_UDP_S-eps-converted-to.pdf}
	\caption{System with UDP-like protocol with ${\bf A} =\usebox{\smlA}$, ${\bf M}=0.7$, and $\epsilon=0.1$.}\label{fig3a}

\end{figure}

\section{Conclusion and Comparison}

We have characterised the optimal IID attack construction for UDP-like and TCP-like systems with lossy actuation channels. The attacks are envisioned as DoS attacks over the actuation communication channel which results in packet losses being induced by the attacker. Under the assumption that the operator monitors the state of the channel with the average packet loss as the decision statistic, we have shown that the optimal attack strategy does not always increase the number of packet losses. In fact, we have characterised the effect of the system parameters over the solution structure and shown that  three different scenarios emerge for which the attack strategy is different.
Interestingly, under both protocols the attacker only needs to know ${\Delta}^{\Gamma} $, ${\Psi}$, and ${\bf M}$ to decide the optimal strategy, unless the system operates with a UDP-like protocol and the function is concave, in which case all system parameters must be known. For all cases, the cost increase of the optimal IID construction has been characterised and analysed. We have also shown that the IID attack construction is not optimal by proposing an achievability scheme that constructs attacks with non-stationary statistics. It is shown numerically that the proposed non-stationary attack outperforms the IID attack in most settings although at the expense of increased computational complexity.
\begin{figure}[!t]
	\captionsetup{justification=centering,margin=2cm,width=\linewidth}
	\includegraphics[width=0.9\linewidth]{Figures/Av_Attack-eps-converted-to.pdf}
	\caption{System with TCP-like protocol with ${\bf A} =\usebox{\smlA}$, ${\bf M}=\usebox{\smlV}$, and ${\bf L}=0.1 {\bf I}$.}\label{fig4}
\end{figure}
\begin{figure}[!t]
	\captionsetup{justification=centering,margin=2cm,width=\linewidth}
	\includegraphics[width=0.9\linewidth]{Figures/Av_Attack_UDP-eps-converted-to.pdf}
	\caption{System with UDP-like protocol with ${\bf A} =\usebox{\smlA}$, ${\bf M}=\usebox{\smlV}$, and ${\bf L}=0.1{\bf I}.$}\label{fig4a}
\end{figure}

\bibliographystyle{ifacconf}


\section*{Introduction}
Nagel-Nickel-Romanelli studied extrapolation spaces for unbounded operators in their paper \cite{NagelIdent} in Quaest.\ Math.\ in 1996. This paper extends this work by considering another scenario where extrapolation spaces occur.

It is motivated by non-autonomous Cauchy problems.
Such a problem can be treated as an abstract Cauchy problem on a Banach space $X$. It takes the form
\begin{align}\label{eqn:nACP}\tag{nACP}
\begin{cases}
\dot{u}(t)=A(t)u(t),&\quad t,s\in\RR,\ t\geq s,\\
u(s)=x,
\end{cases}
\end{align}
where $(A(t),\dom(A(t)))_{t\in\RR}$ is a family of linear operators on $X$ (see \cite[Chapter VI, Section 9]{EngelNagel}). The solution of such a problem, if it exists, is given by a so-called evolution family $(U(t,s))_{t\geq s}$, see \cite[Chapter VI, Def.~9.2]{EN}.
One of the problems of evolution families is that, in contrast to $C_0$-semigroups, they do not yield a differentiable solution, e.g., it is possible that the map $t\mapsto U(t,s)x$ is differentiable only for $x=0$.

	However, if we have a solution by means of an evolution family, we obtain a differentiable structure by means of a strongly continuous semigroup $(T(t))_{t\geq0}$ on the Bochner space $\Ell^p(\RR,X)$ ($1\leq p<\infty$) by
\[
(T(t)f)(s):=U(s,s-t)f(s-t),\quad t\geq0,\ f\in\mathrm{L}^p(\RR,X),\ s\in\RR
\]
(see \cite[Chapter 9, Part b., especially Remark 9.12)]{EngelNagel}).
One important challenge is to determine the exact domain of the corresponding generator $(G,\dom(G))$, \CB{since it determines the space of differentiability for the semigroup, cf. \cite[Chapter II, Lemma~1.3]{EN}}. By \cite[Thm.~3.4.7]{ThomPhD} operator-valued multiplication operators now arise naturally. Indeed, the evolution family provides a solution to \eqref{eqn:nACP} if and only if there exists an invariant core $D\subseteq\mathrm{W}^{1,p}(\RR,X)\cap\dom(\mathcal{A})$ with
\[Gf=\mathcal{A}f-f'\]
for $f\in D$. Here $\mathcal{A}$ is the multiplication operator on $\Ell^p(\RR,X)$ defined by
$$
  \left( \mathcal{A}f
  \right)(\cdot) = A(\cdot)f(\cdot) \ \text{ for } \ f\in \Ell^p(\RR,X) \text{ with } A(\cdot)f(\cdot)\in\Ell^p(\RR,X),
$$
where $A(t), t\in\RR,$ is the family of linear operators in \eqref{eqn:nACP}.
One answer, in the special case where $A(t)\equiv A$ for some semigroup generator $(A,\dom(A))$, is due to Nagel, Nickel and Romanelli \cite[Sect.~4]{NagelIdent}. In \cite{Graser1997} T.~Graser studied bounded and unbounded operator-valued multiplication operators on the space of continuous functions $\mathrm{C}_0(\RR,X)$ as well as their extrapolation spaces. We will see that extrapolation spaces of multiplication operators on $\Ell^p(\RR,X)$ can be constructed similarly. Later on, S.~Thomaschewski studied properties of such multiplication operators on Bochner $\Ell^p$-spaces \cite[Sect.~2.2 \&~2.3]{ThomPhD} in connection with non-autonomous problems. \RH{In particular}, she connects multiplication semigroups with unbounded operator-valued multiplication operators.
In order to construct our extrapolation spaces, the notion of fiber integrable functions is essential and leads to so-called $L^p$ fibre spaces, see \cite{HeymannPHD}.

We start this paper with some preliminaries on fiber integrable functions and continue with unbounded multiplication operators in the second section. In Section \ref{sec:ExtraFiberMultSemi} we discuss multiplication semigroups whose generators are multiplication operators. Furthermore, we determine the extrapolation spaces of such multiplication operators by means of $\Ell^p$-fiber spaces. We remark that the results of this paper appear in similar fashion in \cite[Chapter 3]{BuddePhD}.

\section{$\mathrm{L}^p$-fiber spaces}

Firstly, we recall the notion of a measurable Banach fiber bundle as it was introduced by R.~Heymann, cf. \cite[Def.~VI.1.i]{HeymannPHD}. To do so, let $(\Omega,\Sigma,\mu)$ be a $\sigma$-finite measure space. Furthermore, let $V$ be a complex vector space together with a family of seminorms $\left\{\opnorm{\cdot}_s:\ s\in\Omega\right\}$ on $V$. Assume that there exists a countable set of elements $\B:=\left\{b_k:\ k\in\NN\right\}\subseteq V$ such that $\B$ is a vector space over $\QQ+i\QQ$ and such that for each $k\in\NN$ the map $s\mapsto\opnorm{b_k}_s$ is measurable as a map from $\Omega$ to $\RR$. For every $s\in\Omega$ we define the set $N_s:=\left\{b_k\in\B:\ \opnorm{b_k}_s=0\right\}$ and take the completion of the quotient space $\B/N_s$ with respect to the induced norms $\left\|\cdot\right\|_s$ on $\B/N_s$. This Banach space is denoted by $X_s$.

\begin{definition}\label{def:mBfs}
The family of Banach spaces $(X_s,\left\|\cdot\right\|_s)_{s\in\Omega}$ is called a \emph{measurable Banach fiber bundle}.
\end{definition}

Next, we follow \cite[Def.~VI.1.iii]{HeymannPHD} in order to define what it means for a function $f:\Omega\to\bigcup_{s\in\Omega}{X_s}$ to be measurable.

\begin{definition}\label{def:fibrem}
Let $(X_s,\left\|\cdot\right\|_s)_{s\in\Omega}$ be a measurable Banach fiber bundle. We define a function $f:\Omega\rightarrow\bigcup_{s\in\Omega}{X_s}$ with $f(s)\in X_s$ for $\mu$-almost every $s\in\Omega$ to be \emph{fiber measurable} if it is almost everywhere a pointwise limit with respect to $\left\|\cdot\right\|_s$ of measurable simple functions with values in $\B$. More precisely, this means that there exists a sequence $(f_j)_{j\in\NN}$ of functions $f_j:\Omega\rightarrow\bigcup_{s\in\Omega}{X_s}$ such that
\begin{num}
	\item $\displaystyle{f_j=\sum_{i=1}^{n_j}{\left(b_{\pi(i)}+N_s\right)\textbf{1}_{\Omega_i}}}$, where $\pi:\NN\rightarrow\NN$, $n_j\in\NN$, $\Omega_i\in\Sigma$, $\Omega_i\cap\Omega_j=\varnothing$, $i\neq j$, and $b_i\in\B$ for each $1\leq i\leq n_j$,
	\item $\displaystyle{f(s)=\lim_{j\to\infty}{f_j(s)}}$ with respect to $\left\|\cdot\right\|_s$ for $\mu$-almost every $s\in\Omega$.
\end{num}
The set of fiber measurable functions on $\Omega$ together with the pointwise addition and scalar multiplication is a $\mathbb{C}$-vector space, which we will call a \emph{measurable Banach fiber bundle}.
\end{definition}

Having the concept of measurability we continue with the notion of integrability for functions from $\Omega$ to measurable Banach fiber bundles, see \cite[Def.~VI.1.vi]{HeymannPHD}. Especially, we define what it means to be $p$-integrable for $1\leq p<\infty$. To do so, we remark that, for a fiber-measurable function $f$, the map $s\mapsto\left\|f(s)\right\|_s^p$ is measurable, since, by construction, the map $s\mapsto\left\|f(s)\right\|_s$ is a pointwise limit of measurable functions.

\begin{definition}\label{def:FibInt}
Let $1\leq p<\infty$. We call a fiber measurable function $f:\Omega\rightarrow\bigcup_{s\in\Omega}{X_s}$ \emph{fiber $p$-integrable} if the integral
\[
\int_{\Omega}{\left\|f(s)\right\|_s^p}\ \dd\mu(s),
\]
exists and is finite. In this case, we call
\[
\left\|f\right\|_p:=\left(\int_{\Omega}{\left\|f(s)\right\|_s^p}\ \dd\mu(s)\right)^{\frac{1}{p}}
\]
the \emph{$\Ell^p$-fiber norm} of $f$.
\end{definition}

\begin{remark}
\begin{iiv}
	\item Observe that the set of fiber $p$-integrable functions with pointwise addition and scalar multiplication is a vector space.
	\item The relation defined by $f\sim g$ $\Leftrightarrow$ $f=g$ $\mu$-almost everywhere is an equivalence relation on the set of fiber $p$-integrable functions.
	\item The set of equivalence classes of fiber $p$-integrable functions with the canonical vector space structure is called a \emph{$\mathrm{L}^p$-fiber space} and is denoted by $\Ell^p(\Omega,(X_s)_{s\in\Omega})$.
	\item By \cite[Prop.~VI.1.xi]{HeymannPHD} the space $\Ell^p(\Omega,(X_s)_{s\in\Omega})$ is a Banach space with respect to the $\Ell^p$-fiber norm.
	\item \CB{The notion of $\Ell^p$-fiber spaces is closely related to the one of measurable Banach bundles, cf. \cite{Gut1993} and \cite{GM2013}.}
\end{iiv}
\end{remark}

\section{Operator-valued multiplication operators}\label{sec:UnbMult}

The main objects of this section are
operator-valued multiplication operators, cf. \cite[Def.~2.3.1]{ThomPhD}.

\begin{definition}\label{def:UnOpVMult}
Let $X$ be a Banach space and let $(M(s),\dom(M(s)))_{s\in\Omega}$ be a family of (possibly) unbounded linear operators on $X$, i.e., $M(s):\dom(M(s))\subseteq X\rightarrow X$ for $s\in\Omega$. The operator $(\M,\dom(\M))$ on $\Ell^p(\Omega,X)$ defined by
\begin{align*}
\dom(\M)&:=\left\{f\in\Ell^p(\Omega,X):\ f(s)\in\dom(M(s))\ \mu\text{-a.e.}, (s\mapsto M(s)f(s))\in\Ell^p(\Omega,X)\right\},\\
(\M f)(s)&:=M(s)f(s),\quad f\in\dom(\M), s\in\Omega,\ \mu\text{-almost everywhere},
\end{align*}
is called the corresponding \emph
	operator-valued multiplication operator}. The operators $(M(s),\dom(M(s)))$, $s\in\Omega$, are called \emph{fiber operators}.
\end{definition}

As already mentioned in the beginning, the concept of unbounded multiplication operators was studied by S.~Thomaschewski \cite{ThomPhD} on Bochner $\Ell^p$-spaces in connection with non-autonomous Cauchy problems. Here we summarize some important results

Firstly, the closedness of the fiber operators implies the closedness of the multiplication operator, see \cite[Lemma~2.3.4]{ThomPhD}.

\begin{lemma}
If $(M(s),\dom(M(s)))$ is closed for $\mu$-almost every $s\in\Omega$, then $(\M,\dom(\M))$ is closed.
\end{lemma}

In what follows we assume that $(\M,\dom(\M))$ is a closed operator-valued multiplication operator with closed fiber operators $(M(s),\dom(M(s)))_{s\in\Omega}$. The following result \cite[Lemma~2.3.5]{ThomPhD} shows that the resolvent operator of $(\M,\dom(\M))$ \RH{also gives} rise to a multiplication operator. For this we remind the reader of the following definition \cite[Def.~2.2.3]{ThomPhD}:
\[
\mathrm{L}^{\infty}\left(\Omega,\LLL_\mathrm{s}(X)\right):=\left\{M:\Omega\to\LLL(X):\ s\mapsto M(s)x\in\Ell^{\infty}(\Omega,X)\ \text{for all}\ x\in X\right\}.
\]

\begin{lemma}\label{lem:ResMultOp}
Let $(\M,\dom(\M))$ be a multiplication operator and assume that $\lambda\in\rho(\M)$ \RH{where $\rho(\M)$ denotes the resolvent set of $\M$}. Then $R(\lambda,\M)$ is a bounded multiplication operator, i.e., there exists $M\in\mathrm{L}^{\infty}\left(\Omega,\LLL_\mathrm{s}(X)\right)$ such that $(R(\lambda,\M)f)(s)=M(s)f(s)$ for all $f\in\Ell^p(\Omega,X)$.
\end{lemma}

Unfortunately, since the proof of the above lemma uses a characterization of bounded multiplication operators, the converse cannot be proved in a similar way and has not been proved in general, cf. \cite[Thm.~2.2.17]{ThomPhD}.
However, the following result \cite[Thm.~2.3.6]{ThomPhD} holds.

\begin{theorem}
Let $(\M,\dom(\M))$ be a densely defined closed von $\Ell^p(\Omega,X)$. Assume that there exists an unbounded sequence $(\lambda_n)_{n\in\NN}$ in $\rho(\M)$ such that for all $f\in\Ell^p(\Omega,X)$ one has\\ $\lim_{n\to\infty}{\lambda_nR(\lambda_n,\M)f}=f$. If $R(\lambda_n,\M)$ is a bounded multiplication operator for every $n\in\NN$, then there exists a family $(M(s),\dom(M(s)))_{s\in\Omega}$ of densely defined closed operators on $X$ such that $(\M,\dom(\M))$ is a multiplication operator with fiber operators $(M(s),\dom(M(s)))_{s\in\Omega}$. Furthere there exists a $\mu$-null-set $\mathscr{N}$ such that for every $s\in\Omega\setminus\mathscr{N}$ and for each $n\in\NN$ one has $\lambda_n\in\rho(M(s))$.
\end{theorem}

Finally, if $(\M,\dom(\M))$ is already supposed to be a multiplication operator on $\Ell^p(\Omega,X)$, then the resolvent of $\M$ and the resolvents of the fiber operators are related by the following result \cite[Prop.~2.3.7]{ThomPhD}.

\begin{proposition}\label{prop:ResolventMultFiber}
Let $(\M,\dom(\M))$ be a closed multiplication operator with closed fiber operators $(M(s),\dom(M(s)))_{s\in\Omega}$.
\begin{abc}
	\item  If $\lambda\in\rho(M(s))$ for $\mu$-almost every $s\in\Omega$ and $R(\lambda,M(\cdot))\in\Ell^\infty\left(\Omega,\LLL_\mathrm{s}(X)\right)$, then $\lambda\in\rho(\M)$ and $(R(\lambda,\M)f)(s)=R(\lambda,M(s))f(s)$ for all $f\in\Ell^p(\Omega,X)$ and $\mu$-almost every $s\in\Omega$.
	\item If there exists an unbounded sequence $(\lambda_n)_{n\in\NN}$ in $\rho(\M)$ such that for all $f\in\Ell^p(\Omega,X)$ one has $\lambda_nR(\lambda_n,\M)f\to f$ for $n\to\infty$, then for $\mu$-almost all $s\in\Omega$ and all $n\in\NN$ one has $\lambda_n\in\rho(M(s))$ and $(R(\lambda_n,\M)f)(s)=R(\lambda_n,M(s))f(s)$ for all $f\in\Ell^p(\Omega,X)$ and $\mu$-almost every $s\in\Omega$.
\end{abc}
\end{proposition}

In \cite[Sect.~2.2.3]{ThomPhD} S.~Thomaschewski
studies multiplication semigroups on $\Ell^p(\Omega,X)$.
The definition is as follows.

\begin{definition}
A $C_0$-semigroup $(\mathcal{T}(t))_{t\geq0}$ on $\Ell^p(\Omega,X)$ is called a \emph{multiplication semigroup} if for every $t\geq0$ the operator $\mathcal{T}(t)$ is a bounded multiplication operator, i.e., for every $t\geq0$ there exists $T_{(\cdot)}(t)\in\Ell^{\infty}\left(\Omega,\LLL_\mathrm{s}(X)\right)$ such that $(\mathcal{T}(t)f)(s)=T_s(t)f(s)$ for $\mu$-almost every $s\in\Omega$.
\end{definition}

By \cite[Thm.~2.3.15]{ThomPhD}, stated below, these multiplication semigroups have unbounded multiplication operators as generators.

\begin{theorem}\label{thm:MultGenC0Thom}
Let $(\M,\dom(\M))$ be the generator of a strongly continuous semigroup $(\mathcal{T}(t))_{t\geq0}$ on $\Ell^p(\Omega,X)$ such that $\left\|\mathcal{T}(t)\right\|\leq M\ee^{\omega t}$ for some $M\geq0$, $\omega\in\RR$ and for all $t\geq0$. The following are equivalent.
\begin{abc}
	\item $(\mathcal{T}(t))_{t\geq0}$ is a multiplication semigroup.
	\item $(\M,\dom(\M))$ is an unbounded operator-valued multiplication operator with fiber operators\\ $(M(s),\dom(M(s)))_{s\in\Omega}$. Moreover, for $\mu$-almost every $s\in\Omega$, $\lambda\in\rho(M(s))$ whenever $\mathrm{Re}(\lambda)>\omega$, $(R(\lambda,\M)f)(\cdot)=R(\lambda,M(\cdot))f(\cdot)$ and $(M(s),\dom(M(s)))$ is the generator of a $C_0$-semigroup $(T_s(t))_{t\geq0}$ such that $(\mathcal{T}(t)f)(s)=T_s(t)f(s)$ for all $t\geq0$.
\end{abc}
\end{theorem}

\section{Extrapolation of unbounded multiplication operators}\label{sec:ExtraFiberMultSemi}

We recall the construction of extrapolation spaces of unbounded operators,
\CB
as described, for example, in \cite[Chapter II, Sect.~5(a)]{EN}, \cite{N1997} or in a more general framework in \cite{BF2019}: Let $(T(t))_{t\geq0}$ be a $C_0$-semigroup on a Banach space $X$ with generator $(A,\dom(A))$. Without loss of generality one may assume that $0\in\rho(A)$. On $X$ one defines a new norm $\left\|\cdot\right\|_{-1}$ by
\[
\left\|x\right\|_{-1}:=\left\|A^{-1}x\right\|,\quad x\in X.
\]
The completion of $X$ with respect to $\left\|\cdot\right\|_{-1}$ is called the \emph{(first) extrapolation space} and will be denoted by $X_{-1}$. The original space $X$ is densely embedded in $X_{-1}$. By continuity one can extend the original semigroup $(T(t))_{t\geq0}$ to a $C_0$-semigroup $(T_{-1}(t))_{t\geq0}$ on $X_{-1}$. The corresponding generator is denoted by $(A_{-1},\dom(A_{-1}))$. As a matter of fact, one obtains $\dom(A_{-1})=X$ and $A_{-1}:X\to X_{-1}$ becomes an isometric isomorphism.}\\
We now consider a multiplication operator $(\M,\dom(\M))$ generating a multiplication semigroup $(\mathcal{T}(t))_{t\geq0}$, cf. Theorem \ref{thm:MultGenC0Thom}. By $(M(s),\dom(M(s)))_{s\in\Omega}$ we denote the fiber operators corresponding to $(\M,\dom(\M))$, i.e., $(\M f)(s)=M(s)f(s)$, $f\in\dom(\M)$ and $s\in\Omega$. By Theorem \ref{thm:MultGenC0Thom} the operator $(M(s),\dom(M(s)))$, $s\in\Omega$, generates a $C_0$-semigroup $(T_s(t))_{t\geq0}$. We assume without loss of generality that $0\in\rho(M(s))$ for $\mu$-almost every $s\in\Omega$. The extrapolated operators will be denoted by $(M_{-1}(s),\dom(M_{-1}(s)))$, $s\in\Omega$. The extrapolation space of $\Ell^p\left(\Omega,X\right)$ corresponding to the operator $(\M,\dom(\M))$ will be denoted by $\mathcal{X}:=\left(\Ell^p(\Omega,X)\right)_{-1}(\M)$. \CB{By the extrapolation procedure described above, $\mathcal{X}$} is formally given by
\[
\mathcal{X}=\left\{f\in\prod_{s\in\Omega}{X_{-1,s}}:\ \exists g\in\Ell^p(\Omega,X):\ f=M_{-1}(\cdot)g\right\}
\]
The norm $\left\|f\right\|_{\mathcal{X}}:=\left(\int_\Omega{\left\|f(s)\right\|^p_{-1,s}\ \dd\mu(s)}\right)^{1/p}$ turns $\mathcal{X}$ into a Banach space.

\begin{lemma}\label{lem:ExtMultSemiAssumpGen}
Let $(\M,\dom(\M))$ be a multiplication operator on $\Ell^p(\Omega,X)$ with fiber operators\\ $(M(s),\dom(M(s)))_{s\in\Omega}$. Moreover, let $(\mathcal{T}(t))_{t\geq0}$ the multiplication semigroup \CB{of type $(M,\omega)$} generated by $(\M,\dom(\M))$. Moreover, denote by $(T_s(t))_{t\geq0}$ the $C_0$-semigroups of type $(M,\omega)$ generated by the fiber operators $(M(s),\dom(M(s)))_{s\in\Omega}$. The associated extrapolated semigroups are denoted by $(T_{-1,s}(t))_{t\geq0}$, $s\in\Omega$. Define
\[
(\mathcal{S}(t)f)(s):=T_{-1,s}(t)f(s),\quad t\geq0,\ f\in\mathcal{X},\ s\in\Omega.
\]
This defines a $C_0$-semigroup on $\mathcal{X}$ which is generated by the operator $(\M_{-1},\dom(\M_{-1}))$ defined by
\begin{align}\label{eqn:ExtraMultFiberOp}
(\M_{-1}f)(s)=M_{-1}(s)f(s),\quad \dom(\M_{-1})=\Ell^p(\Omega,X).
\end{align}
\end{lemma}

\begin{proof}
First of all, to see that $(\mathcal{S}(t))_{t\geq0}$ is indeed a semigroup is easy, since $(T_{-1,s}(t))_{t\geq0}$ is a semigroup for each $s\in\Omega$. As a matter of fact, $(T_{-1,s}(t))_{t\geq}$ is an extension of $(T_s(t))_{t\geq0}$ for each $s\in\Omega$ and hence $(\mathcal{S}(t))_{t\geq0}$ extends $(\mathcal{T}(t))_{t\geq0}$. Since, by construction, $\Ell^p(\Omega,X)$ is dense in $\mathcal{X}$, the semigroup $(\mathcal{S}(t))_{t\geq0}$ is strongly continuous. In order to show that the generator of $(\mathcal{S}(t))_{t\geq0}$ is of the form mentioned in the lemma, let us denote the generator of $(\mathcal{S}(t))_{t\geq0}$ by $(\mathcal{A},\dom(\mathcal{A}))$. \CB{We will show that $(\mathcal{A},\dom(\mathcal{A}))=(\M_{-1},\dom(\M_{-1}))$. Firstly, assume that $f\in\dom(\mathcal{A})$, then since $\lambda\in\rho(M_{-1}(s))$ for all $\lambda>\omega$ and almost every $s\in\Omega$ we conclude that $\lambda\in\rho(\M_{-1})$. By assumption $(\mathcal{A},\dom(\mathcal{A}))$ is the generator of $(\mathcal{S}(t))_{t\geq0}$ with $\left\|\mathcal{S}(t)\right\|\leq M\ee^{\omega t}$ meaning that $\lambda\in\rho(\mathcal{A})$. From surjectivity one obtain $f\in\dom(\mathcal{A})$, $g\in\mathcal{X}$ and $h\in\dom(\M_{-1})$ satisfying the following equality
\[
f=R(\lambda,\mathcal{A})g=R(\lambda,\mathcal{A})(\lambda-\M)h=R(\lambda,\mathcal{A})(\lambda-\mathcal{A})h=h\in\dom(\M_{-1}),
\]
showing that $\mathcal{A}\subseteq\M_{-1}$. For the converse, let $f\in\dom(\M_{-1})$ and observe that from the fact $f(s)\in\dom(M_{-1}(s))$ for almost every $s\in\Omega$ one conclude that
\[
(\mathcal{S}(t)f)(s)-f(s)=T_{-1,s}(t)f(s)-f(s)=\int_0^t{T_{-1,s}(t)M_{-1}(s)f(s)\ \dd\mu(s)}=\int_0^t{(\mathcal{S}(t)\mathcal{M}_{-1}f)(s)\ \dd\mu(s)},
\]
showing that $\M_{-1}\subseteq\mathcal{A}$, which concludes the proof.
}\end{proof}

The previous result shows actually that the extrapolated multiplication operator is again a multiplication operator. In this case the fiber operators are the extrapolated fiber operators\\ $(M_{-1}(s),\dom(M_{-1}(s)))_{s\in\Omega}$, i.e., \eqref{eqn:ExtraMultFiberOp} holds.
We now characterize the space $\mathcal{X}:=\left(\Ell^p(\Omega,X)\right)_{-1}(\M)$. Assume
that the Banach space $X$ we are working with is separable, i.e., there exists a countable dense set in $X$. Denote the extrapolation spaces corresponding to the fiber operator $(M(s),\dom(M(s))$ by $\left(X_{-1,s},\left\|\cdot\right\|_{-1,s}\right)$, $s\in\Omega$. The following result prepares for the extrapolation procedure. .
\begin{lemma}\label{lem:BFSExtrap}
Suppose $X$ is a separable Banach space. If $0\in\rho(M(s))$ for almost every $s\in\Omega$ and $s\mapsto M(s)^{-1}x$ is measurable for each $x\in X$, then the family $\left(X_{-1,s},\left\|\cdot\right\|_{-1,s}\right)_{s\in\Omega}$ is a measurable Banach fiber bundle.
\end{lemma}

\begin{proof}
We make use of the separability of $X$ and take a dense countable subset of $X$ and make a $\QQ+i\QQ$ vector space $\mathcal{B}$ out of it. Observe that $\mathcal{B}$ is still countable, i.e, $\B:=\left\{b_k:\ k\in\NN\right\}\subseteq X$. We define a family of seminorms $\left\{\opnorm{\cdot}_s:\ s\in\Omega\right\}$ on $X$ by
\[
\opnorm{x}_{s}:=\left\|M(s)^{-1}x\right\|,\quad x\in X,\ s\in\Omega.
\]
Then $\opnorm{\cdot}_s$ is actually a norm on $X$. By the assumption $s\mapsto M(s)^{-1}x$ is measurable for each $x\in X$ and hence so is the map $s\mapsto\left\|b_k\right\|_s$ for each $k\in\NN$. Since $N_s=\left\{0\right\}$ for each $s\in\Omega$ we obtain $\B/N_s=\B$. Finally, the completion of $\B$ with respect to $\opnorm{\cdot}_s$ is just the space $X_{-1,s}$, $s\in\Omega$. By Definition \ref{def:mBfs} we therefore obtain that $\left(X_{-1,s},\left\|\cdot\right\|_{-1,s}\right)_{s\in\Omega}$ is a measurable Banach fiber bundle.
\end{proof}

Since we know that $\left(X_{-1,s},\left\|\cdot\right\|_{-1,s}\right)_{s\in\Omega}$ is a measurable Banach fiber bundle, we can consider the space of fiber $p$-integrable functions over this set of Banach spaces. In what follows we relate this space to the extrapolation space of $\Ell^p(\Omega,(X_s)_{s\in\Omega})$ with respect to the
 operator-valued multiplication operator $(\M,\dom(\M))$.

\begin{theorem}\label{cor:FibLp}
Let $1\leq p<\infty$ and consider the unbounded multiplication operator $(\M,\dom(\M))$ on $\Ell^p(\Omega,X)$, induced by the family of unbounded operators $(M(s),\dom(M(s)))_{s\in\Omega}$ on $X$. Let $(M(s),\dom(M(s)))$ be a semigroup generator for $\mu$-almost every $s\in\Omega$. Suppose that $0\in\rho(M(s))$ for $\mu$-almost every $s\in\Omega$ and that $s\mapsto M(s)b$ and $s\mapsto M(s)^{-1}b$ are measurable for each $b\in\B$. Then
\[
\left[\Ell^p(\Omega,X)\right]_{-1}(\M)=\Ell^p(\Omega,(X_{-1,s})_{s\in\Omega}).
\]
\end{theorem}

\begin{proof}
Let $f\in\left[\Ell^p(\Omega,X)\right]_{-1}(\M)$ and find $g\in\Ell^p(\Omega,X)$ such that $f=\mathcal{M}_{-1}g$, where $\M_{-1}:\Ell^p(\Omega,X)\to\Ell^p(\Omega,X)_{-1}(\M)$. Since $g$ is measurable, we can find a sequence $(g_n)_{n\in\NN}$ of simple functions approximating $g$ pointwise, i.e.,
\[
g_n:=\sum_{i=1}^{m_n}{x_{n,i}\textbf{1}_{\Omega_{n,i}}}\ \text{and}\ g_n\to g\ \mu\text{-almost everywhere.}
\]
Without loss of generality, we assume that $x_{n,i} \in \B$ for every $i=1,2,\ldots m_n$ and $n\in\mathbb{N}$.
In order to show that $f\in\Ell^p(\Omega,(X_{-1,s})_{s\in\Omega})$ define $f_n:=\M_{-1}g_n$. Then
\[
f_n(s):=(\M_{-1}g_n)(s)=\sum_{i=1}^{m_n}{M_{-1}(s)x_{n,i}\textbf{1}_{\Omega_{n,i}}(s)},
\]
where we use Lemma \ref{lem:ExtMultSemiAssumpGen} as well as the fact that $M_{-1}(s)x_{n,i}\in X_{-1,s}$, $s\in\Omega$. Since the function $\Omega\rightarrow X; s\mapsto M(s)b$ is measurable for each $n\in\B$, it is easy to see that $f_n$ is fiber-measurable for each $n\in\mathbb{N}$.

 Furthemore,
\[
\left\|f\right\|^p_{\Ell^p\left(\Omega,(X_{-1,s})_{s\in\Omega}\right)}=\int_\Omega{\left\|f(s)\right\|_{-1,s}^p\ \dd{s}}=\int_{\Omega}{\left\|g(s)\right\|^p\ \dd{s}}=\left\|g\right\|^p_{\Ell^p(\Omega,X)}<\infty,
\]
showing that $f$ is a fiber $p$-integrable function, i.e., $f\in\Ell^p(\Omega,(X_{-1,s})_{s\in\Omega})$.

\medskip
For the converse inclusion, suppose that $f\in\Ell^p(\Omega,(X_{-1,s})_{s\in\Omega})$. We have to show that there exists $g\in\Ell^p(\Omega,X)$ such that $f=\M_{-1}g$. Since $f$ is fiber measurable, there exists a sequence $(f_j)_{j\in\NN}$ of simple functions $f_j:\Omega\to\bigcup_{s\in\Omega}{X_{-1,s}}$ with $f(s)\in X_{-1,s}$ for $\mu$-almost every $s\in\Omega$ and
\[
f_j=\sum_{i=1}^{n_j}{b_{k_i}\textbf{1}_{\Omega_i}},
\]
where $b_{k_i}\in\mathcal{B}$, $\Omega_i\in\Sigma$, $\Omega_i\cap\Omega_j=\varnothing$, $i\neq j$, for $1\leq i\leq n_j$, and
\begin{align}\label{eqn:CauchyFiber}
\left\|f(s)-f_j(s)\right\|_{-1,s}\to0,
\end{align}
for $j\to\infty$ and $\mu$-almost every $s\in\Omega$. By the assumption that $0\in\rho(M(s))$ for $\mu$-almost every $s\in\Omega$ we conclude by Proposition \ref{prop:ResolventMultFiber} that $0\in\rho(\M)$. So we define
\[
g_j:=(\M^{-1}_{-1} f_j)(\cdot)=\sum_{i=1}^{n_j}{\left(M^{-1}_{-1}(\cdot)b_{k_i}\right)\textbf{1}_{\Omega_i}(\cdot)}.
\]
We observe that $M_{-1}^{-1}(s)b_{k_i}\in X$ for $\mu$-almost every $s\in\Omega$ and hence $g_j$ is a simple function. By \eqref{eqn:CauchyFiber} we conclude that $(g_j(s))_{j\in\NN}$ is a Cauchy sequence with respect to $\left\|\cdot\right\|_s$ for $\mu$-almost every $s\in\Omega$ and hence convergent. This yields a measurable function $g:\Omega\to X$ by taking the pointwise limit, i.e.,
\[
g(s):=\lim_{j\to\infty}{g_j(s)},\quad s\in\Omega.
\]
By the continuity of $M_{-1}(s)$, $s\in\Omega$, on $X$ and the fact that $M_{-1}(s)M_{-1}^{-1}(s)=\Id$ for $\mu$-almost every $s\in\Omega$, we directly obtain that $\M_{-1}g=f$. Moreover,
\[
\left\|g\right\|_{\Ell^p(\Omega,X)}^p=\int_{\Omega}{\left\|g(s)\right\|^p\ \dd{s}}=\int_{\Omega}{\left\|f(s)\right\|_{-1,s}^p\ \dd{s}}=\left\|f\right\|^p_{\Ell^p(\Omega,(X_{-1,s})_{s\in\Omega}}<\infty,
\]
and therefore $g\in\Ell^p(\Omega,X)$.
\end{proof}

\CB{As a direct consequence we recover the following result, which has previously been used in in the continuous setting in \cite[Sect.~4]{NagelIdent}.

\begin{corollary}
Let $(A,\dom(A))$ be a generator of a $C_0$-semigroup on a Banach space $X$ and denote ist first extrapolation space by $X_{-1}^A$. Define the operator $(\M,\dom(\M))$ on $\Ell^p(\Omega,X)$ by
\[
(\M f)(s):=Af(s),\quad f\in\dom(\M):=\Ell^p(\Omega,\dom(A)),\ s\in\Omega.
\]
Then $\left(\Ell^p(\Omega,X)\right)_{-1}(\M)=\Ell^p(\Omega,X_{-1}^A)$.
\end{corollary}
}

\section*{Acknowledgement}
We would like to thank B\'{a}lint Farkas for a discussion in which the idea for the collaboration which resulted in this paper was initiated. Furthermore, we are indepted to Rainer Nagel for helpful feedback.