Coordinated Multi-Armed Bandits for Improved Spatial Reuse in Wi-Fi
Published in Unknown Venue, 2024
Recommended citation: Francesc Wilhelmi and Boris Bellalta and Szymon Szott and Katarzyna Kosek-Szott and Sergio Barrachina-Muñoz (2024). Coordinated Multi-Armed Bandits for Improved Spatial Reuse in Wi-Fi. Unknown Venue. https://ieeexplore.ieee.org/abstract/document/11140340/
Abstract: Multi-Access Point Coordination (MAPC) and Artificial Intelligence and Machine Learning (AI/ML) are expected to be key features in future Wi-Fi, such as the forthcoming IEEE 802.11bn (Wi-Fi 8) and beyond. In this paper, we explore a coordinated solution based on online learning to drive the optimization of Spatial Reuse (SR), a method that allows multiple devices to perform simultaneous transmissions by controlling interference through Packet Detect (PD) adjustment and transmit power control. In particular, we focus on a Multi-Agent Multi-Armed Bandit (MA-MAB) setting, where multiple decision-making agents concurrently configure SR parameters from coexisting networks by leveraging the MAPC framework, and study various algorithms and reward-sharing mechanisms. We evaluate different MA-MAB implementations using Komondor, a well-adopted Wi-Fi simulator, and demonstrate that AI-native SR …