Computationally-efficient combinatorial auctions for resource allocation in weakly-coupled MDPs

Dmitri Dolgov, Edmund Durfee
2005 Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems - AAMAS '05  
The capabilities of an autonomous agent are often determined by the resources that are available to it. We examine the problem of allocating scarce resources among multiple self-interested agents, operating in complex, stochastic environments (modeled as MDPs), where the value of a particular resource bundle to an agent is the expected payoff of the best control policy the agent can implement using these resources. Combinatorial auctions are popular mechanisms for allocating resource bundles
more » ... ng agents with such complex preferences. In particular, generalized Vickrey auctions (GVAs) yield socially optimal outcomes and have excellent strategic complexity, but suffer from high computational complexity for the agents' preference-valuation and the auctioneer's winner-determination problems. We describe a GVA-based mechanism that exploits knowledge of the agents' MDP-based resource preferences, and we show analytically and demonstrate empirically that this leads to an exponential improvement in computational efficiency over a straightforward GVA implementation with flat preferences. We also present a distributed implementation of the winnerdetermination problem that leads to further speedup while maintaining strategy-proofness of the mechanism, and without revealing agents' private MDP information.
doi:10.1145/1082473.1082573 dblp:conf/atal/DolgovD05 fatcat:ez4u5xlkhvedpnntgij5agmq7a