Stability of discrete-time linear systems with Markovian jumping parameters

This paper deals with the robustness of a class of discrete-time linear systems with Markovian jumping parameters and unknown but bounded uncertainties. Assuming that the Markovian jump process (disturbance) has finite state space and that there is complete access to the system's state and its mode, we establish necessary and sufficient conditions for stochastic stability of the autonomous nominal model. We also establish sufficient conditions for robust stability for this class of uncertain systems under matching conditions and with bounded uncertainties.