Abstract
We take a stochastic optimization approach to opportunity tracking and access in self-similar primary traffic. Based on a multiple time-scale hierarchical Markovian model, we formulate opportunity tracking and access in self-similar primary traffic as a Partially Observable Markov Decision Process. We show that for independent and stochastically identical channels under certain conditions, the myopic sensing policy has a simple round-robin structure that obviates the need to know the channel parameters; thus it is robust to channel model mismatch and variations. Furthermore, the myopic policy achieves comparable performance as the optimal policy that requires exponential complexity and assumes full knowledge of the channel model.
Original language | English |
---|---|
Article number | 762547 |
Journal | Eurasip Journal on Advances in Signal Processing |
Volume | 2009 |
DOIs | |
Publication status | Published - 2009 |