Cooperative Decision Making.Christopher
Amato. In Decision Making Under Uncertainty: Theory and Application
edited by Mykel J. Kochenderfer. MIT Press, 2015. [pdf]
Policy Search for Multi-Robot Coordination under
Uncertainty. Christopher Amato, George Konidaris, Ariel
Anders, Gabriel Cruz, Jonathan P. How and Leslie P. Kaelbling. In Proceedings
of the 2015 Robotics: Science and Systems Conference (RSS-15),
July 2015. (nominated for the RSS-15 best paper award) [pdf]
Planning with Macro-Actions in Decentralized
POMDPs.Christopher Amato, George Konidaris and Leslie P.
Kaelbling. In Proceedings of the Thirteenth International Conference
on Autonomous Agents and Multi-Agent Systems (AAMAS-14), Paris,
France, May 2014. [pdf]
Exploiting Separability in Multi-Agent Planning
with Continuous-State MDPs.Jilles S. Dibangoye,
Christopher Amato, Olivier Buffet and François Charpillet. In Proceedings
of the Thirteenth International Conference on Autonomous Agents and
Multi-Agent Systems (AAMAS-14), Paris, France, May 2014. (winner
of the AAMAS-14 best paper award) [pdf]
2013
Multiagent Planning, Control, and Execution. E. Durfee and S.
Zilberstein. In G. Weiss (Ed.), Multiagent Systems, Second
Edition, 485-546, MIT Press, 2013. [link]
Qualitative Planning under Partial Observability in Multi-Agent
Domains. Ronen I. Brafman, Guy Shani and Shlomo Zilberstein. In Proceedings
of the Twenty-Seventh Conference on Artificial Intelligence
(AAAI), 130-137, Bellevue, Washington, 2013. [pdf]
Optimally Solving Dec-POMDPs as Continuous-State MDPs. Jilles
S. Dibangoye, Christopher Amato, Olivier Buffet and François Charpillet.
In Proceedings of the Twenty-Third International Joint Conference on
Artificial Intelligence (IJCAI-13), Beijing, China, August, 2013.
[pdf]
Automated Generation of Interaction Graphs for Value-Factored
Dec-POMDPs. William Yeoh, Akshat Kumar, and Shlomo Zilberstein.
In Proceedings of the Twenty-Third International Joint Conference on
Artificial Intelligence (IJCAI-13), Beijing, China, August, 2013.
[pdf]
Monte-Carlo Expectation Maximization for Decentralized POMDPs.
Feng Wu, Shlomo Zilberstein and Nicholas R. Jennings. In Proceedings
of the Twenty-Third International Joint Conference on Artificial
Intelligence (IJCAI-13), Beijing, China, August, 2013. [pdf]
Incremental Clustering and Expansion for Faster Optimal Planning
in Decentralized POMDPs. Frans A. Oliehoek, Matthijs T. J. Spaan,
Christopher Amato and Shimon Whiteson. Journal of Artificial
Intelligence Research (JAIR), 2013. [link]
Bayesian Reinforcement Learning for Multiagent Systems with State
Uncertainty. Christopher Amato and Frans A. Oliehoek. To appear in
Proceedings of the Workshop on Multi-Agent Sequential Decision Making
in Uncertain Domains (MSDM) at the Twelfth International
Conference on Autonomous Agents and Multi-Agent Systems (AAMAS-08),
Saint Paul, MN, May 2013. [pdf forthcoming]
Producing Efficient Error-bounded Solutions for Transition
Independent Decentralized MDPs. Jilles S. Dibangoye, Christopher
Amato, Arnaud Doniec and François Charpillet. To appear in
Proceedings of the Tenth International Joint Conference on Autonomous
Agents and Multi-Agent Systems (AAMAS-13), Saint Paul, MN, May
2013. [pdf]
2012
Scaling Up Decentralized MDPs Through Heuristic Search.
Jilles S. Dibangoye, Christopher Amato and Arnaud Doniec. In
Proceedings of the Twenty-Eighth Conference on Uncertainty in
Artificial Intelligence (UAI-12), Catalina Island, California,
August 2012. [pdf]
2011
Online Planning for Multi-Agent Systems with Bounded
Communication. F. Wu, S. Zilberstein, and X. Chen. Artificial
Intelligence, 175(2):487-511, 2011. [pdf]
Scalable Multiagent Planning Using Probabilistic Inference.
A. Kumar, S. Zilberstein, and M. Toussaint. In Proceedings of the
Twenty-Second International Joint Conference on Artificial
Intelligence (IJCAI), 2140-2146, Barcelona, Spain, 2011. [pdf]
Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental
Expansion. Frans A. Oliehoek, Matthijs T. J. Spaan and
Christopher Amato. In Proceedings of the Twenty-Second International
Joint Conference on Artificial Intelligence (IJCAI-11),
Barcelona, Spain, July, 2011. [pdf]
Online Planning for Ad Hoc Autonomous Agent Teams. F. Wu, S.
Zilberstein, and X. Chen. In Proceedings of the Twenty-Second
International Joint Conference on Artificial Intelligence (IJCAI),
439-445, Barcelona, Spain, 2011. [pdf]
Decentralized Monitoring of Anytime Decision Making. A.
Carlin and S. Zilberstein. In Proceedings of the Tenth
International Conference on Autonomous Agents and Multiagent Systems
(AAMAS), 157-164, Taipei, Taiwan, 2011. [pdf]
Message Passing Algorithms for Large Structured Decentralized
POMDPs. A. Kumar and S. Zilberstein. In Proceedings of the
Tenth International Conference on Autonomous Agents and Multiagent
Systems (AAMAS), 1087-1088, Taipei, Taiwan, 2011. [pdf]
Towards Realistic Decentralized Modeling for Use in a Real-World
Personal Assistant Agent Scenario. Christopher Amato, Nathan
Schurr and Paul Picciano. In Proceedings of the Workshop on
Optimisation in Multi-Agent Systems (OptMAS) at the Tenth
International Conference on Autonomous Agents and Multi-Agent Systems
(AAMAS-11), Taipei, Taiwan, May 2011. [pdf]
Bounded Rationality in Multiagent Systems Using Decentralized
Metareasoning. A. Carlin and S. Zilberstein. In T. Guy, M. Karny,
and D. Wolpert (Eds.), Decision Making with Imperfect Decision
Makers, 1-28, Springer, 2011. [pdf]
2010
Finite-state controllers based on Mealy machines for centralized
and decentralized POMDPs. Christopher Amato, Blai Bonet and Shlomo
Zilberstein. Proceedings of the Twenty-Fourth National Conference on
Artificial Intellgence (AAAI-10), Atlanta, GA, July, 2010. [pdf]
Trial-Based Dynamic Programming for Multi-Agent Planning.
Feng Wu, Shlomo Zilberstein and Xiaoping Chen. Proceedings of the
Twenty-Fourth National Conference on Artificial Intellgence (AAAI-10),
Atlanta, GA, July, 2010. [pdf]
Anytime Planning for Decentralized POMDPs using Expectation
Maximization. Akshat Kumar and Shlomo Zilberstein.
Proceedings of the Twenty-Sixth International Conference on
Uncertainty in Artificial Intelligence (UAI-10), Catalina Island,
CA, July 2010. [pdf]
Rollout Sampling Policy Iteration for Decentralized POMDPs.
Feng Wu, Shlomo Zilberstein and Xiaoping Chen. Proceedings of the
Twenty-Sixth International Conference on Uncertainty in Artificial
Intelligence (UAI-10), Catalina Island, CA, July 2010. [pdf]
Point-Based Backup for Decentralized POMDPs: Complexity and New
Algorithms. Akshat Kumar and Shlomo Zilberstein. Proceedings
of the Ninth International Conference on Autonomous Agents and
Multi-Agent Systems (AAMAS-10), Toronto, Canada, May, 2010. [pdf]
Point-Based Policy Generation for Decentralized POMDPs. Feng
Wu, Shlomo Zilberstein and Xiaoping Chen. Proceedings of the Ninth
International Conference on Autonomous Agents and Multi-Agent Systems
(AAMAS-10), Toronto, Canada, May, 2010. [pdf]
2009
A Bilinear Programming Approach for Multiagent Planning. Marek
Petrik and Shlomo Zilberstein. Journal of Artificial Intelligence
Research (JAIR) vol. 35, pages 235-274, 2009. [pdf]
Complexity of Decentralized Control: Special Cases. Martin
Allen and Shlomo Zilberstein. Proceedings of Neural Information
Processing Systems (NIPS-09), Vancouver, British Columbia,
December 2009. [pdf]
Myopic and Non-Myopic Communication Under Partial Observability.
Alan Carlin and Shlomo Zilberstein. Proceedings of the 2009 IEEE
Conference on Intelligent Agent Technology (IAT-09), Milan,
Italy, September, 2009. [pdf]
Incremental Policy Generation for Finite-Horizon DEC-POMDPs.
Christopher Amato, Jilles Steeve Dibangoye and Shlomo Zilberstein. Proceedings
of the Nineteenth International Conference on Automated Planning and
Scheduling (ICAPS-09), Thessaloniki, Greece, September, 2009. [pdf]
Multi-Agent Online Planning with Communication. Feng Wu,
Shlomo Zilberstein and Xiaoping Chen. Proceedings of the Nineteenth
International Conference on Automated Planning and Scheduling
(ICAPS-09), Thessaloniki, Greece, September, 2009.
Event-Detecting Multi-Agent MDPs: Complexity and Constant-Factor
Approximations. Akshat Kumar and Shlomo Zilberstein. Proceedings
of the Twenty-first International Joint Conference on Artificial
Intelligence (ICAPS-09), Pasadena, CA, July, 2009. [pdf]
Dynamic Programming Approximations for Partially Observable
Stochastic Games. Akshat Kumar and Shlomo Zilberstein. Proceedings
of the Twenty-Second International FLAIRS Conference , Sanibel
Island, Florida, May, 2009. [pdf]
Value of Communication In Decentralized POMDPs. Alan Carlin
and Shlomo Zilberstein. Proceedings of the Workshop on Multi-Agent
Sequential Decision Making in Uncertain Domains (MSDM). Held in
conjunction with the Eighth International Joint Conference on Autonomous
Agents and Multi-Agent Systems (AAMAS-09), Budapest, Hungary, May, 2009.
[pdf]
Achieving Goals in Decentralized POMDPs. Christopher Amato
and Shlomo Zilberstein. Proceedings of the Eighth International
Joint Conference on Autonomous Agents and Multi-Agent Systems
(AAMAS-09), Budapest, Hungary, May, 2009. [pdf]
Constraint-Based Dynamic Programming for Decentralized POMDPs
with Structured Interactions. Akshat Kumar and Shlomo Zilberstein.
Proceedings of the Eighth International Joint Conference on
Autonomous Agents and Multi-Agent Systems (AAMAS-09), Budapest,
Hungary, May, 2009. [pdf]
Analyzing Myopic Approaches for Multi-Agent Communication.
Raphen Becker, Alan Carlin, Victor Lesser, and Shlomo Zilberstein.
Computational Intelligence , vol. 25, February, 2009. [pdf]
Policy Iteration for Decentralized Control of Markov Decision
Processes. Daniel S. Bernstein, Christopher Amato, Eric A. Hansen
and Shlomo Zilberstein. Journal of AI Research (JAIR), vol. 34,
pages 89-132, February, 2009. [pdf]
2008
Interaction Structure and Dimensionality Reduction in Decentralized
MDPs. Martin Allen, Marek Petrik and Shlomo Zilberstein. Proceedings
of the Twenty-Third National Conference on Artificial Intelligence
(AAAI-08), Chicago, Illinois, July, 2008. [pdf]
Value-Based Observation Compression for DEC-POMDPs. Alan
Carlin and Shlomo Zilberstein. Proceedings of the the Seventh
International Joint Conference on Autonomous Agents and Multi-Agent
Systems (AAMAS-08), Estoril, Portugal, May, 2008. [pdf]
Heuristic Policy Iteration for Infinite-Horizon Decentralized
POMDPs. Christopher Amato and Shlomo Zilberstein. Proceedings
of the Workshop on Multi-Agent Sequential Decision Making in Uncertain
Domains (MSDM). Held in conjunction with the Seventh
International Joint Conference on Autonomous Agents and Multi-Agent
Systems (AAMAS-08), Estoril, Portugal, May, 2008. [pdf]
Formal Models and Algorithms for Decentralized Decision Making
Under Uncertainty. Sven Seuken and Shlomo Zilberstein. Journal
of Autonomous Agents and Multi-Agent Systems (JAAMAS). 17:2,
pages 190-250, 2008. [pdf]
2007
Learning to Communicate in a Decentralized Environment.
Claudia V. Goldman, Martin Allen, and Shlomo Zilberstein.
Autonomous Agents and Multi-Agent Systems 15(1):47-90, 2007. [pdf]
Agent Influence as a Predictor of Difficulty for Decentralized
Problem-Solving. Martin Allen and Shlomo Zilberstein. Proceedings
of the Twenty-Second National Conference on Artificial Intelligence
(AAAI-07), Vancouver, BC, Canada, July, 2007. [pdf]
Anytime Coordination Using Separable Bilinear Programs. Marek
Petrik and Shlomo Zilberstein. Proceedings of the Twenty-Second
National Conference on Artificial Intelligence (AAAI-07),
Vancouver, BC, Canada, July, 2007. [pdf]
Optimizing Memory-Bounded Controllers for Decentralized POMDPs.
Christopher Amato, Daniel S. Bernstein and Shlomo Zilberstein. Proceedings
of the Twenty-Third Conference on Uncertainty in Artificial
Intelligences (UAI-07), Vancouver, BC, Canada, July, 2007. [pdf]
Improved Memory-Bounded Dynamic Programming for Decentralized
POMDPs. Sven Seuken and Shlomo Zilberstein. Proceedings of the
Twenty-Third Conference on Uncertainty in Artificial Intelligences
(UAI-07), Vancouver, BC, Canada, July, 2007. [pdf]
Bounded Dynamic Programming for Decentralized POMDPs.
Christopher Amato, Alan Carlin and Shlomo Zilberstein. Proceedings
of the Workshop on Multi-Agent Sequential Decision Making in Uncertain
Domains (MSDM). Held in conjunction with the Sixth International
Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS-07)
, Honolulu, Hawai'i, May, 2007. [pdf]
Memory-Bounded Dynamic Programming for DEC-POMDPs. Sven Seuken
and Shlomo Zilberstein. Proceedings of the Twentieth International
Joint Conference on Artificial Intelligences (IJCAI-07), January
2007 [pdf]
Average-Reward Decentralized Markov Decision Processes. Marek
Petrik and Shlomo Zilberstein. Proceedings of the Twentieth
International Joint Conference on Artificial Intelligences
(IJCAI-07), January 2007 [pdf]
2006
Optimal Fixed-Size Controllers for Decentralized POMDPs.
Christopher Amato, Daniel S. Bernstein and Shlomo Zilberstein.
Proceedings of the Workshop on Multi-Agent Sequential Decision Making
in Uncertain Domains (MSDM). Held in conjunction with the Fifth
International Joint Conference on Autonomous Agents and Multi-Agent
Systems (AAMAS-06) , Future University-Hakodate, May, 2006. [pdf]
2005
Learning to Communicate in Decentralized Systems. Martin Allen,
Claudia V. Goldman, and Shlomo Zilberstein. Proceedings of the
Wokshop on Multiagent Learning, 20th National Conference on Artificial
Intelligence (AAAI-05), Pittsburgh, PA, July, 2005. [pdf]
Bounded Policy Iteration for Decentralized POMDPs. Daniel S.
Bernstein, Eric A. Hansen, and Shlomo Zilberstein. Proceedings of
the 19th International Joint Conference on Artificial Intelligence
(IJCAI-05), Edinburgh, Scotland, July 2005. [pdf]
MAA*: A Heuristic Search Algorithm for Solving Decentralized
POMDPS. Daniel Szer, Francois Charpillet, Shlomo Zilberstein. Proceedings
of the 21st International Conference on Uncertainty in Artificial
Intelligence (UAI-05), Edinburgh, Scotland, July 2005. [ps]
2004
Decentralized Markov Decision Processes with Event-Driven
Interactions. Raphen Becker, Shlomo Zilberstein, and Victor
Lesser. Proceedings of the Third International Joint Conference on
Autonomous Agents and Multi Agent Systems (AAMAS-04), July, 2004.
[pdf]
Decentralized Control of Cooperative Systems: Categorization and
Complexity Analysis. Claudia Goldman and Shlomo Zilberstein. Journal
of Artificial Intelligence Research (JAIR-04), Volume 22, pp.
143-174, November, 2004. [ps][pdf]
Decentralized Language Learning Through Acting. Claudia V.
Goldman, Martin Allen and Shlomo Zilberstein. Proceedings of the
Third International Joint Conference on Autonomous Agents and
Multi-Agent Systems (AAMAS-04), July, 2004. [pdf]
Dynamic Programming for Partially Observable Stochastic Games.
Eric A. Hansen, Daniel S. Bernstein, and Shlomo Zilberstein. Proceedings
of
the 19th National Conference on Artificial Intelligence (AAAI-04),
709-715, San Jose, California, July 2004. [pdf]
2003
Transition-Independent Decentralized Markov Decision Processes.
Raphen Becker, Shlomo Zilberstein, Victor Lesser and Claudia V. Goldman.
Proceedings of the Second International Conference on Autonomous
Agents and Multi-agent Systems. (AAMAS-03), Melbourne, Australia,
July, 2003. (winner of the AAMAS-03 best paper award) [pdf]
Mechanism Design for Communication in Cooperative Systems.
Claudia V. Goldman and Shlomo Zilberstein. Game Theoretic and
Decision Theoretic Agents Workshop at the Second International Joint
Conference on Autonomous Agents and Multi-Agent Systems
(AAMAS-03), Melbourne, Australia, July, 2003. [ps]
Optimizing Information Exchange in Cooperative Multi-agent
Systems. Claudia V. Goldman and Shlomo Zilberstein. Proceedings
of the Second International Joint Conference on Autonomous Agents and
Multi-Agent Systems (AAMAS-03), Melbourne, Australia, July, 2003.
[pdf]
2002
The Complexity of Decentralized Control of Markov Decision
Processes. Daniel S. Bernstein, Robert Givan, Neil Immerman, and
Shlomo Zilberstein. Mathematics of Operations Research,
27(4):819-840, November 2002. (An earlier version appeared in UAI-00.)
[pdf]
2001
Communication Decisions in Multi-agent Cooperation: Model and
Experiments. Ping Xuan, Victor Lesser and Shlomo
Zilberstein. Proceedings of the Fifth International Conference on
Autonomous Agents, ACM Press, pp. 616-623. January 2001. [ps]
2000
The Complexity of Decentralized Control of Markov Decision
Processes. Daniel S. Bernstein, Shlomo Zilberstein, and Neil
Immerman. Proceedings of the 16th International Conference on
Uncertainty in Artificial Intelligence (UAI), 32-37, Stanford,
California, June 2000. [ps][pdf]
Some Other Publications
2005
A Framework for Sequential Planning in Multi-Agent Settings. Piotr
Gmytrasiewicz and Prashant Doshi. Journal of Artificial
Intelligence Research (JAIR), Volume 24, pp. 49-79, 2005. [ps][pdf]
Networked Distributed POMDPs: A Synthesis of Distributed Constraint
Optimization and POMDPs. Ranjit Nair, Pradeep Varakantham, Milind
Tambe and Makoto Yokoo. Proceedings of the Twentieth National
Conference on Artificial Intelligence (AAAI-05), Pittsburgh, PA,
July, 2005. [pdf]
An Optimal Best-first Search Algorithm for Solving Infinite Horizon
DEC-POMDPs. Daniel Szer and Francois Charpillet. Proceedings
of the Sixteenth European Conference on Machine Learning (ECML-05),
Porto, Portugal, October, 2005. [ps]
2004
An Approximate Dynamic Programming Approach to Decentralized
Control of Stochastic Systems. Randy Cogill, Michael Rotkowitz,
Benjamin Van Roy, and Sanjay Lall. Proceedings of the Forty-Third
Allerton Conference on Communication, Control, and Computing ,
Champaign-Urbana, Il, 2004. [pdf]
Approximate Solutions for Partially Observable Stochastic Games
with Common Payoffs. Rosemary Emery-Montemerlo, Geoff Gordon, Jeff
Schneider and Sebastian Thrun. Proceedings of the Third International
Joint Conference on Autonomous Agents and Multi Agent Systems
(AAMAS-04), July, 2004. [ps]
2003
Taming Decentralized POMDPs: Towards Efficient Policy Computation
for Multiagent Settings. Ranjit Nair, David Pynadath, Makoto
Yokoo, Milind Tambe and Stacy Marsella. Proceedings of the
Eighteenth International Joint Conference on Artificial Intelligence
(IJCAI-03), Acapulco, Mexico, August, 2003. [ps][pdf]
Role Allocation and Reallocation in Multiagent Teams: Towards a
Practical Analysis. Ranjit Nair, Milind Tambe and Stacy Marsella .
Proceedings of the Second International Joint Conference on
Autonomous Agents and Multi-Agent Systems (AAMAS-03), Melbourne,
Australia, July, 2003. [ps][pdf]
The Communicative Multiagent Team Decision Problem: Analyzing
Teamwork Theories and Models. David V. Pynadath and Milind Tambe.
Journal of Artificial Intelligence Research (JAIR), Volume 16,
pp. 389-423. 2002. [ps][pdf]
Multi-Agent Policies: From Centralized Ones to Decentralized Ones.
Ping Xuan and Victor Lesser. Proceedings of the 1st International
Joint Conference on Autonomous Agents and Multiagent Systems, Volume
Part 3, ACM Press, pp. 1098-1105. 2002. [ps]
1999
Sequential Optimality and Coordination in Multiagent Systems.
Craig Boutilier. Proceedings of the Sixteenth International Joint
Conference on Artificial Intelligence (IJCAI-99), Stockholm,
Swededn, 1999. [ps]