Dynamic power management based on continuous-time Markov decision processes

Qinru Qiu, Massoud Pedram

Research output: Chapter in Book/Entry/PoemChapter

194 Scopus citations


This paper introduces a continuous-time, controllable Markov process model of a power-managed system. The system model is composed of the corresponding stochastic models of the service queue and the service provider. The system environment is modeled by a stochastic service request process. The problem of dynamic power management in such a system is formulated as a policy optimization problem and solved using an efficient `policy iteration' algorithm. Compared to previous work on dynamic power management, our formulation allows better modeling of the various system components, the power-managed system as a whole, and its environment. In addition it captures dependencies between the service queue and service provider status. Finally, the resulting power management policy is asynchronous, hence it is more power-efficient and more useful in practice. Experimental results demonstrate the effectiveness of our policy optimization algorithm compared to a number of heuristic (time-out and N-policy) algorithms.

Original languageEnglish (US)
Title of host publicationProceedings - Design Automation Conference
PublisherIEEE Computer Society
Number of pages7
StatePublished - 1999
Externally publishedYes
EventProceedings of the 1999 36th Annual Design Automation Conference (DAC) - New Orleans, LA, USA
Duration: Jun 21 1999Jun 25 1999


OtherProceedings of the 1999 36th Annual Design Automation Conference (DAC)
CityNew Orleans, LA, USA

ASJC Scopus subject areas

  • Hardware and Architecture
  • Control and Systems Engineering


Dive into the research topics of 'Dynamic power management based on continuous-time Markov decision processes'. Together they form a unique fingerprint.

Cite this