Applications of Markov Decision Processes in Communication Networks

By Eitan Altman. 2000

128 citations recorded by the source corpus.

Subfields: Computer Networks and Communications, Electrical and Electronic Engineering, Management Information Systems

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Networks and Communications

1. Mohsen ElHafsi
2. Tingliang Huang
3. S. Benjaafar
4. Sean P. Meyn
5. John N. Tsitsiklis
6. Shie Mannor
7. Ioannis Kontoyiannis
8. Petros Dellaportas

In Electrical and Electronic Engineering

1. Mohsen ElHafsi
2. Tingliang Huang
3. S. Benjaafar
4. Sean P. Meyn
5. Shie Mannor
6. John N. Tsitsiklis
7. Ioannis Kontoyiannis
8. Petros Dellaportas

In Management Information Systems

1. Mohsen ElHafsi
2. Tingliang Huang
3. S. Benjaafar
4. Sean P. Meyn
5. Ioannis Kontoyiannis
6. Petros Dellaportas
7. Shie Mannor
8. John N. Tsitsiklis

Citations in the corpus

• Optimal and Approximate Q-value Functions for Decentralized POMDPs (2008, neutral): “Other approaches to communication networks using decentralized, stochastic, partially observable systems are given by Ooi and Wornell (1996), Tao, Baxter, and Weaver (2001), Altman (2002).”
• Point-based Dynamic Programming for DEC-POMDPs (2006, unknown): “2005), or where the communication act itself constitutes the parameter to be optimized, such as in computer networks (Altman 2000).”
• Control Techniques for Complex Networks: Workload (2007, background): “Altman [10] contains a survey on applications to queues, and an extensive history on priority policies.”
• Optimal control of a production‐inventory system with both backorders and lost sales (2008, methodology): “Reviews of this literature can be found in Stidham (1985), Altman (2001), and Koole (2007); for a recent example application see Savin et al. (2005).”
• BLACKWELL OPTIMALITY IN MARKOV DECISION PROCESSES WITH PARTIAL OBSERVATION (2002, background): “arise naturally in many contexts, such as models of machine replacement and quality control problems (see [12] and the references therein for this and additional applications), telecommunication networks (see [1] and the references therein), and intra-seasonal decisions of fishing vessel operators [”